-- Logs begin at Sun 2022-07-24 00:10:26 UTC, end at Sun 2022-07-24 02:55:43 UTC. -- Jul 24 00:51:14.731080 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 24 00:51:14.739456 n-d-master-1 devstack@keystone.service[80576]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 00:51:14 2022] *** Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: nodename: n-d-master-1 Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: machine: x86_64 Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: clock source: unix Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: pcre jit disabled Jul 24 00:51:14.741495 n-d-master-1 devstack@keystone.service[80576]: detected number of CPU cores: 4 Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: current working directory: / Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: detected binary path: /usr/bin/uwsgi-core Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: your processes number limit is 47680 Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: your memory page size is 4096 bytes Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: detected max file descriptor number: 2048 Jul 24 00:51:14.742083 n-d-master-1 devstack@keystone.service[80576]: lock engine: pthread robust mutexes Jul 24 00:51:14.747586 n-d-master-1 devstack@keystone.service[80576]: thunder lock: enabled Jul 24 00:51:14.747586 n-d-master-1 devstack@keystone.service[80576]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 24 00:51:14.747586 n-d-master-1 devstack@keystone.service[80576]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 00:51:14.786897 n-d-master-1 devstack@keystone.service[80576]: Python main interpreter initialized at 0x55e50b0c19c0 Jul 24 00:51:14.786897 n-d-master-1 devstack@keystone.service[80576]: python threads support enabled Jul 24 00:51:14.786897 n-d-master-1 devstack@keystone.service[80576]: your server socket listen backlog is limited to 100 connections Jul 24 00:51:14.786897 n-d-master-1 devstack@keystone.service[80576]: your mercy for graceful operations on workers is 90 seconds Jul 24 00:51:14.787286 n-d-master-1 devstack@keystone.service[80576]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 00:51:14.787362 n-d-master-1 devstack@keystone.service[80576]: *** Operational MODE: preforking *** Jul 24 00:51:14.787610 n-d-master-1 devstack@keystone.service[80576]: *** uWSGI is running in multiple interpreter mode *** Jul 24 00:51:14.787610 n-d-master-1 devstack@keystone.service[80576]: spawned uWSGI master process (pid: 80576) Jul 24 00:51:14.787836 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 24 00:51:14.790619 n-d-master-1 devstack@keystone.service[80576]: spawned uWSGI worker 1 (pid: 80590, cores: 1) Jul 24 00:51:14.790619 n-d-master-1 devstack@keystone.service[80576]: spawned uWSGI worker 2 (pid: 80591, cores: 1) Jul 24 00:51:14.790619 n-d-master-1 devstack@keystone.service[80576]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 00:51:20.310433 n-d-master-1 devstack@keystone.service[80591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:20.310433 n-d-master-1 devstack@keystone.service[80591]: from cryptography.utils import int_from_bytes Jul 24 00:51:20.311221 n-d-master-1 devstack@keystone.service[80591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:20.311221 n-d-master-1 devstack@keystone.service[80591]: from cryptography.utils import int_from_bytes Jul 24 00:51:20.312742 n-d-master-1 devstack@keystone.service[80590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:20.312742 n-d-master-1 devstack@keystone.service[80590]: from cryptography.utils import int_from_bytes Jul 24 00:51:20.313185 n-d-master-1 devstack@keystone.service[80590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:51:20.313185 n-d-master-1 devstack@keystone.service[80590]: from cryptography.utils import int_from_bytes Jul 24 00:51:20.361619 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:51:20.361840 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:51:20.361920 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:51:20.362012 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] command line args: [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:51:20.362089 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:51:20.362283 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:51:20.362361 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] command line args: [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:51:20.362463 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ================================================================================ {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:51:20.362598 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:51:20.362722 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] admin_token = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.362815 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ================================================================================ {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:51:20.362971 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] config_dir = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363077 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] admin_token = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363153 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363338 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] config_source = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363411 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] config_dir = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363521 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] debug = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363603 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363723 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363983 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] config_source = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.363983 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] debug = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364098 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364159 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364302 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364420 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364548 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364671 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364783 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.364899 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365016 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365134 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_config_append = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365251 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365369 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365486 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365596 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_dir = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365749 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_config_append = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365870 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_file = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.365982 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366101 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366213 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_dir = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366334 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366452 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_file = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366563 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366672 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366773 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.366899 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367019 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367019 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367252 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367370 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367453 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367578 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367652 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367652 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367832 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.367832 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368016 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368134 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368253 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368339 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368410 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368533 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368612 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368731 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.368827 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369002 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369129 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369302 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369526 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369638 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369799 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] publish_errors = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.369881 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370000 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370339 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370413 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370533 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] publish_errors = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370616 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370754 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370844 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.370995 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371069 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371190 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371281 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] standard_threads = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371421 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371496 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371661 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371831 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.371831 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372077 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] standard_threads = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372181 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] use_journal = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372248 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372314 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] use_json = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372408 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] use_stderr = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372473 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372589 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] use_syslog = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372763 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372763 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] use_journal = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.372958 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.373029 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] use_json = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.373097 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.373164 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] use_stderr = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.373275 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] use_syslog = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.373356 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.373513 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:51:20.373596 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.373799 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.373879 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374046 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374120 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374284 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374360 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374536 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374611 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374775 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.374861 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375017 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375093 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375265 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375344 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375504 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375583 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375742 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375818 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.375990 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376064 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376228 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376304 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376465 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376716 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376796 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.376956 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377030 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377207 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377362 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377459 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377534 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377719 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377808 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.377980 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378065 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378220 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378301 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378469 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378543 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378709 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378793 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.378967 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379052 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379219 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379293 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379452 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379537 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379686 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379762 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.379919 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380000 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380157 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380233 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380390 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380463 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380629 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380704 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380864 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.380940 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381099 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381173 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381339 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381412 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381575 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381650 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381842 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.381917 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382093 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382166 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382323 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382398 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382561 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382649 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382794 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.382867 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383015 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383087 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383254 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383335 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383485 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383559 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383714 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383788 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.383948 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384027 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384182 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384257 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384412 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384493 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384649 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384725 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384880 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.384955 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385117 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385192 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385348 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385421 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385587 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385714 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385848 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.385924 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386084 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386159 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386322 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386435 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386558 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386639 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386791 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.386867 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.387026 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.387111 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.387257 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.387333 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388012 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388106 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388399 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388532 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388532 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388683 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388788 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388889 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.388969 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389039 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389205 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389296 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389434 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389511 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389689 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389769 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.389934 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390010 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390170 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390253 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390410 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390485 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390668 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390751 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390914 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.390990 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391152 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391227 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391390 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391474 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391627 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391702 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391868 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.391943 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392104 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392187 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392343 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392418 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392603 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392744 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.392878 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393018 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393018 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393298 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393460 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393588 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393759 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393849 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.393975 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394055 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394169 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394242 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394354 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394436 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394507 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394621 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394694 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394807 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.394880 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395036 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395116 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395230 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395348 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395424 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395585 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395669 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395818 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.395906 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396050 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396126 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396281 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396359 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396515 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396609 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396744 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396820 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.396980 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397103 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397214 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397298 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397465 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397579 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397713 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397787 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.397955 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398045 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398196 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398275 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398452 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398527 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398687 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.external = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398765 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398920 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.398996 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399165 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.external = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399239 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399400 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399508 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399641 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.password = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399717 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399883 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] auth.token = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.399960 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400124 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400201 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.password = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400360 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400439 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] auth.token = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400603 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400678 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400832 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.400907 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401080 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401164 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401314 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401391 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401544 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401619 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401817 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.401898 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402052 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402129 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402291 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402373 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402536 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402620 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402772 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.402862 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.403015 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.403096 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.403289 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.403888 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404056 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404168 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404296 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404363 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404552 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404655 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404809 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.404920 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405099 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405176 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405349 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405427 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405613 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405742 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405885 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.405964 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406144 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406222 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406382 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406458 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406619 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406696 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406868 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.406945 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407115 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407191 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407346 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407428 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407594 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407673 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407827 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.407902 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408080 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408205 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408318 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408395 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408573 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408649 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408811 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.408886 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409059 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409135 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409296 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409371 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409545 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409620 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409811 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.409893 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410051 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410134 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410290 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410376 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410530 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410665 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410768 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.410901 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411018 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411142 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411252 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411397 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411494 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411652 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411864 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.411949 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412109 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412184 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412343 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412420 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412580 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412665 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412816 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.412892 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413063 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413139 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413313 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413397 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413560 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413636 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413844 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.413921 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414088 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414176 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414327 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414405 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414560 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414637 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414800 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.414885 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415033 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415116 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415270 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415347 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415503 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415587 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415743 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415818 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.415985 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416060 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416216 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416299 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416465 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416542 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416699 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416774 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.416937 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417023 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417184 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417261 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417422 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417497 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417651 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417802 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417915 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.417993 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418149 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418233 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418387 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418473 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418620 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418696 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418904 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.418985 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419145 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419232 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419463 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419625 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419704 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419871 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.419947 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420120 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420198 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420352 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420427 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420601 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420684 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420840 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.420917 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421074 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421149 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421311 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421387 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421547 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421626 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421809 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.421887 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422052 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422129 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422313 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422392 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422546 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422623 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422795 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.422880 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423042 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423120 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423289 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423365 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423522 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423597 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423752 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423818 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.423987 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424053 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424228 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424364 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424447 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424520 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424682 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424762 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.424918 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425010 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425157 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425237 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425392 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425477 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425639 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425816 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425892 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.425964 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426135 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426214 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426384 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426470 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426620 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426698 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426855 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.426933 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427090 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427175 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427325 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427404 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427561 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427638 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427801 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.427887 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428038 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428116 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428282 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428360 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428515 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428607 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428760 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428839 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.428997 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429075 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429234 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429320 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429471 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429549 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429727 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429808 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.429976 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430067 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430207 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430285 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430445 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430523 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430985 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.430985 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431127 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431383 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431564 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431650 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431826 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.431918 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432082 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432169 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432317 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432395 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432577 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432663 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432818 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.432983 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433063 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433233 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433312 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433492 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433569 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433749 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433831 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] role.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.433996 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.434075 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] role.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.434235 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] role.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.434317 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.434565 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435233 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] role.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435233 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435381 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435466 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435540 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435540 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435668 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435739 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435818 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.435943 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436023 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436198 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436276 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436449 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436535 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436684 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436762 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.436937 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437015 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437169 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437254 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437419 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437499 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437688 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.437768 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438126 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438271 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438353 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438530 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438610 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438843 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.438959 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439112 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439191 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439349 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439436 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439585 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439664 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439843 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.439923 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440103 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440182 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440346 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440424 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440582 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440672 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440820 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.440904 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441054 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441140 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441309 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441389 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441556 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441633 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441819 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.441910 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442058 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442137 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442298 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442377 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442534 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442620 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442774 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.442853 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443009 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443086 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443244 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443330 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443482 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443560 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443721 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443800 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.443970 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444057 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444208 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444287 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444453 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444530 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444700 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444787 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.444939 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445017 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445178 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445255 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445420 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445505 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445657 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445794 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445918 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.445996 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446160 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446251 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446392 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446469 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446637 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446713 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446886 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.446974 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447120 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447198 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.connection = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447362 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447450 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447653 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447731 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447902 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.447989 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.connection = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448148 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448235 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448390 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448469 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448625 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448703 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448864 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.448944 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449097 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449181 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449334 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449413 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449570 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449650 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449831 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.449911 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.450590 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451113 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451237 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451324 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451398 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451398 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451527 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451599 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451680 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451812 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.451899 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.452050 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.452129 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.452225 n-d-master-1 devstack@keystone.service[80590]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:51:20.452313 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.452545 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.452786 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.453019 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:51:20.453191 n-d-master-1 devstack@keystone.service[80591]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:51:20.483284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.483501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.483725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.484645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.484880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.485109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.492244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.493493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.522125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.522340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.522711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.522940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.666536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.667183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.716081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.716407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.717195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.717435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.782713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.782942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.783921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.784095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.784311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.809708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.809896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.810952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.811087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.811168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.811306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.811524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.822539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.822702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.835580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.835721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.835817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.835894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.836980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:51:20.855125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.855257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.855322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:20.855477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:20.855661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.855818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.855901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:20.856022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:51:20.856105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.856361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.856936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.857162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.857252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.857418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.857698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.857969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.868506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.868784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.869937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.877719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.878245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.881011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.881294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.881537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.881847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.881945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.882979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.883998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.884194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.884317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.884460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.911778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.912161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.913397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.913699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.913827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.914111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.919040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.919266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.919495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.919574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.919781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.920070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.926819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.927104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.927400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.927685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.931711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.931997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.932280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.932358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.932564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.932645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.932843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.932923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.933964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.934239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.952852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.953130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.954039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.954327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.957830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.959035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.961454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.961780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.962760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.963066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.967460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.968726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.971399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.972669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.975195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.975493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.975784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.976068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.976353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.976454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.976633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.976762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.977063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.977352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.977650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.977962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.996519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.996975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.997106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:20.997265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.997494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.997594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.997793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:20.998065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.005462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.006010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.007188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.007467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.007722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.008003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.010555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.010838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.011083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.011165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.011367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.011446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.011660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.011783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.012074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.012356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.025599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.025907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.026191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.026316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.026485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.026602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.026770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.026898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.027058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.027184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.027347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.027469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.027759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.028042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.047444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.048774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.050775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.052117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.054110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.055503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.055711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.057101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.057340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.057619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.057928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.058766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.059056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.059415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.065610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.067120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.067397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.068747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.070649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.070944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.071232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.071519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.071999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.072296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.072589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.072869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.081492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.081812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.082096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.082690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.082983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.083266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.090266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.090547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.090889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.091251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:51:21.091336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.091534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.091615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.091814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.091903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.092944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.093938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.094317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.094440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.094567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.094763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.095036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:51:21.133562 n-d-master-1 devstack@keystone.service[80591]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e50b0c19c0 pid: 80591 (default app) Jul 24 00:51:21.134598 n-d-master-1 devstack@keystone.service[80590]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e50b0c19c0 pid: 80590 (default app) Jul 24 00:51:21.137029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0de3a-17d7-41be-827b-f1ff9d823b91 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:21.137325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0de3a-17d7-41be-827b-f1ff9d823b91 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:21.137698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0de3a-17d7-41be-827b-f1ff9d823b91 None None] PATH_INFO: `/v3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:21.141939 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sun Jul 24 00:51:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:28.958709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:28.959281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:28.959281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:28.963647 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:28.970383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:28.970854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:28.970945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:29.038549 n-d-master-1 devstack@keystone.service[80591]: INFO dbcounter [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] Registered counter for database keystone Jul 24 00:51:29.060509 n-d-master-1 devstack@keystone.service[80591]: DEBUG oslo_db.sqlalchemy.engines [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:51:29.066823 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writer thread running {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:51:29.254614 n-d-master-1 devstack@keystone.service[80591]: DEBUG passlib.handlers.bcrypt [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80591) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:51:29.254939 n-d-master-1 devstack@keystone.service[80591]: DEBUG passlib.handlers.bcrypt [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80591) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:51:29.309441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:29.311089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:29.436311 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 24 00:51:29.605146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:29.677293 n-d-master-1 devstack@keystone.service[80590]: INFO dbcounter [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] Registered counter for database keystone Jul 24 00:51:29.697039 n-d-master-1 devstack@keystone.service[80590]: DEBUG oslo_db.sqlalchemy.engines [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:51:29.703610 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writer thread running {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:51:29.822051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db0b1-fac2-407b-8926-8870d28c0afb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:29.826576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:29.827242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:29.827526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:29.827792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:29.836123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:29.888938 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:51:29.889202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fea0bf-92a5-4f3a-ae9c-d244b3e429af admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:29.899364 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Jul 24 00:51:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:51:29.905927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:29.921304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f86b-cb5a-4dae-b960-02a556bad348 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:29.925718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:29.926846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:29.927133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:29.927409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] PATH_INFO: `/v3/projects/a456f944370a42eaa59b5a1926c8339d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:29.931519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] RBAC: Authorizing `identity:get_project(project_id=a456f944370a42eaa59b5a1926c8339d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:29.985066 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:51:29.985773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2bec0-bc38-482b-a2e3-e35e11852406 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:29.990187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sun Jul 24 00:51:29 2022] GET /identity/v3/projects/a456f944370a42eaa59b5a1926c8339d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:32.012439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14a49-5306-4643-9d9f-737fbf708269 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.012975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14a49-5306-4643-9d9f-737fbf708269 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.012975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14a49-5306-4643-9d9f-737fbf708269 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.017134 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:32.022561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.022969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.023113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.042062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:32.044151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:32.051926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 24 00:51:32.074205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14a49-5306-4643-9d9f-737fbf708269 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:32.086406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14a49-5306-4643-9d9f-737fbf708269 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:32.091322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:32.091953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.092235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.092528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.100473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:32.102289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffce9-3076-4690-9b9e-8af986e41520 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:32.111843 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Jul 24 00:51:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:51:32.117498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:32.127052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a52f8-0693-46db-a590-96f3fc52dfa7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:32.131551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:32.132424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:32.132708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:32.132982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:32.134422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:32.136280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61f7e-2a4c-4cc1-9061-9ca08ca11705 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:32.138447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sun Jul 24 00:51:32 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:34.275333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c311-14f4-4611-8ff7-37aafe12501c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.275862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891bd7-908f-4778-a62e-7f9e4ead4aa9 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.276217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c311-14f4-4611-8ff7-37aafe12501c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.276318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891bd7-908f-4778-a62e-7f9e4ead4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.276399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c311-14f4-4611-8ff7-37aafe12501c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.276481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891bd7-908f-4778-a62e-7f9e4ead4aa9 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.277844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:34.278416 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:34.283014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.283305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.283546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.283658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.283836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.284118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.301770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:34.302968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:34.323301 n-d-master-1 devstack@keystone.service[80590]: DEBUG passlib.handlers.bcrypt [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80590) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:51:34.323726 n-d-master-1 devstack@keystone.service[80590]: DEBUG passlib.handlers.bcrypt [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80590) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:51:34.369877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:34.371458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:34.384365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:34.407638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.430866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:34.472704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 6/13] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:34.495757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.510383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491f33-6bec-420c-8504-e459b9149c57 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:34.544709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:34.545368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.545655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.545980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.596792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e203e2-34b0-4075-be80-9685a8cec7e7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:34.599078 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:34.613773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:34.615276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:34.634359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:34.635335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.635623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.635894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.639009 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:34.648584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:34.661871 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:34.662772 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:34.663539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:51:34.669688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.719040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:51:34.724970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.773729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223c9e-5eec-434d-98b8-a73e964d9a76 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:34.806944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:34.807609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.807895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.808171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.809597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:34.809922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:34.811377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:34.823185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 8/16] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:34.829291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d692f-f436-4a35-a303-058b7942e0b1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:34.829426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.854003 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:34.857296 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:34.866481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:34.867281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.867559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.867830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.878348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:34.879821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:51:34.900940 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:34.901931 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:34.902834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:51:34.902834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:51:34.902834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:34.902834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:34.902834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:51:34.907972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:34.933407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cce2b-f20d-4df0-a7a7-b21e80719e88 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:34.969008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:34.969946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:34.970236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:34.970509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:34.972139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:34.973606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:34.975266 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:34.980832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:35.011133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efc5be-4776-4c16-a4ab-871f51a4a468 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:35.044945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:35.045602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.045910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.046184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.046919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:35.047227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:35.048629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:35.066092 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:35.076017 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:35.084029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547521c-a35e-4038-945f-e3874eedc501 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:35.139559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:35.140406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.140693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.140960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.142334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:35.143843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e674de-af53-4d31-b136-264f6368ba79 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:35.145729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:35.158306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:35.195924 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:35.266932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002141-9db3-4ac1-9878-c287daf56bc5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:35.301935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:35.302605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:35.302884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:35.303172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:35.304050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.domain.id=default, user.id=e0e735ce611649f28deffe005a930461) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:35.304361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:35.305893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a43c3-a4be-4db8-9c21-b3940ac128b6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:35.313208 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Jul 24 00:51:35 2022] GET /identity/v3/role_assignments?user.id=e0e735ce611649f28deffe005a930461&scope.domain.id=default&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:37.632832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01de8-5e3b-4115-a18b-e93fe47d19ef None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.633919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01de8-5e3b-4115-a18b-e93fe47d19ef None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.634518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01de8-5e3b-4115-a18b-e93fe47d19ef None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.636127 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.642559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d07a-9722-4cfe-a8f2-a340db302986 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.643502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d07a-9722-4cfe-a8f2-a340db302986 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.644006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483d07a-9722-4cfe-a8f2-a340db302986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.668295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a483d07a-9722-4cfe-a8f2-a340db302986 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.670143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a483d07a-9722-4cfe-a8f2-a340db302986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:37.765228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:37.773767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97744-d27c-4e18-a2a1-fd559250c42b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.774358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97744-d27c-4e18-a2a1-fd559250c42b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.774860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e97744-d27c-4e18-a2a1-fd559250c42b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.776682 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.783065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.783633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.784135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.790178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b3f6-63ce-4a4f-a460-d5c5f92fe206 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.790744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b3f6-63ce-4a4f-a460-d5c5f92fe206 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.791221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5b3f6-63ce-4a4f-a460-d5c5f92fe206 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.792866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.795768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40d8b-f3d6-4eef-86a2-f306d473086d None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.796315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40d8b-f3d6-4eef-86a2-f306d473086d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.796823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f40d8b-f3d6-4eef-86a2-f306d473086d None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.798708 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:37.800095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e402-af06-4dbb-91b4-b2c17ce86397 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.800590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e402-af06-4dbb-91b4-b2c17ce86397 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.801094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e402-af06-4dbb-91b4-b2c17ce86397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.807318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.810063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:37.821018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-20c8e402-af06-4dbb-91b4-b2c17ce86397 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.822266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-20c8e402-af06-4dbb-91b4-b2c17ce86397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:37.836363 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:37.892720 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:37.893491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:37.907287 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:37.908839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:37.909344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:37.909857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:37.943509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:37.945049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:38.021214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e33d6-30c9-4f15-8c69-6099341eb171 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.043842 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:38.049707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.075527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.076209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.076488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.076758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.077516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.078958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.087873 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.177968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee71395-057a-4079-9d4b-ee518d6654e4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.213898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.214919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.215299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.215674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.216527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.218144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.226180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 14/30] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:37 2022] POST /identity/v3/roles => generated 225 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:38.227536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.257443 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.387732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697ff6-49ce-41b6-807e-a050d74e5b9a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.393691 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 17/31] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:38 2022] POST /identity/v3/roles => generated 219 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:38.394545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.433013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.434272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.435475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.435982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.450980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.453604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:51:38.480703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:38.481609 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:38.482550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:51:38.482550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:51:38.482550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:51:38.482550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:38.484993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 15/32] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:38.494039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.531997 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.554995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e273f04-e9af-40a5-a96b-b862af71f010 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.577707 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.598608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.599728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.600203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.600620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.617212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:38.617814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cbcf9-0a80-4dc7-903a-b31bcd6c8021 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:38.626864 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:38.627811 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:38.628529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:38.631233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 18/33] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:38.637173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.662602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.663412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.663772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.664131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.664983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:38.665365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.668518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.684567 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 16/34] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:38.689978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.767097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45c8cd-57e1-4895-8195-010e69914050 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.804817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.805849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.806362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.806819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.807824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:38.808889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.810860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.820565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 19/35] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:38.824432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927b2b3-ea78-44ca-988a-6a107c042bda None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.826813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:38.830906 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.860109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.860776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.861061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.861336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.862331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:38.863559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:38.866090 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:38.897342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 17/36] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:38 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:51:38.954179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6381480-ad4e-4299-a789-55379b1474bb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:38.996044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:38.997096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:38.997379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:38.997788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:38.999281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.000768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.002678 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 20/37] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:38 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:39.008580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:39.124504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c7507-d913-464a-be13-554dfa4a3104 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:39.158697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:39.159512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.159799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.160080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.161267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.163048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3506e-584b-409b-b47d-54d250c95eb0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.164863 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 18/38] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:39.171328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:39.249308 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:39.275137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9aa8-23bd-4d5e-b92e-e713a63cb9bd None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.275458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9aa8-23bd-4d5e-b92e-e713a63cb9bd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.275705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9aa8-23bd-4d5e-b92e-e713a63cb9bd None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.277931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 19/39] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:39.281803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3fb32-52e7-496b-8aa8-61329eee30b9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:39.282398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.282689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.282966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.321426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:39.322365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.322649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.322927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] PATH_INFO: `/v3/domains/default/users/e0e735ce611649f28deffe005a930461/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.325910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e0e735ce611649f28deffe005a930461, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.327409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac333b2-cee7-4088-9eff-f14ec4f490c5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.348861 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Jul 24 00:51:39 2022] PUT /identity/v3/domains/default/users/e0e735ce611649f28deffe005a930461/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:51:39.365622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4239ea-5f9e-4e38-aee4-26f785b8fb7d None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.366027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4239ea-5f9e-4e38-aee4-26f785b8fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.366244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4239ea-5f9e-4e38-aee4-26f785b8fb7d None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.368083 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:39.375409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.375768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.376004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.396175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:39.397839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:39.412146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:39.413797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:39.471282 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:39.482181 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:39.498447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 20/43] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:39.505972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:39.524935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:39.575013 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:39.625116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930470-e612-40f1-b017-9b8c801b444c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:39.634055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14681875-673d-4a35-9268-cfc31ab6f2c2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:39.660750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:39.661563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.661884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.662165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.663382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.664858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.666731 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 24/44] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:39.673066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:39.679154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:39.679842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.680125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.680408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.681166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.682594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4b5d-d7b8-4061-89cb-0e48b9a788bf None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.698235 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Jul 24 00:51:39 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:51:39.788257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9abbf0-5042-4778-b9dd-a35745a0d861 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:39.824797 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:39.832124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:39.833110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:39.833611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:39.834121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:39.835075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:39.836885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1530707-45dc-4767-8e50-9eefc2dab83b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:39.879979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:39 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:41.410115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ab48-47f2-4f90-9982-eb67943b76b2 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.410599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ab48-47f2-4f90-9982-eb67943b76b2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.410599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ab48-47f2-4f90-9982-eb67943b76b2 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.411975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:41.417318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.417757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.417990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.434783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:41.435958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:41.504195 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:41.534357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ab48-47f2-4f90-9982-eb67943b76b2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.578489 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.638627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ab48-47f2-4f90-9982-eb67943b76b2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.674245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.674972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.675259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.675538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.687845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:41.696738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:41.697777 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:41.698963 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 23/49] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:41.703854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.802038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35d232-fbb8-4713-bbdc-13b9d7690466 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.816797 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.838641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.839846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.840195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.840476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.841243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:41.841552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:41.842984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772c809-6eed-4668-89e5-fdeb51c8484e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:41.851412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 27/50] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:41.857870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:41.955336 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:41.958449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f82725-98a9-4164-973e-1ed01ce4d453 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:41.965978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c490a-0d83-40e3-bd8a-ceb42c6dc377 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.966277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c490a-0d83-40e3-bd8a-ceb42c6dc377 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.966561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c490a-0d83-40e3-bd8a-ceb42c6dc377 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.967950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 28/51] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:41.973323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.973616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.973933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.991907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:41.993162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:41.995469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:41.997010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:41.997260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:41.997529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:41.998918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.000432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.002160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 24/52] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:41 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:42.007702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.063391 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 29/53] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:42.086786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.107839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9be939-578f-4632-9d07-6921de382892 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.143612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.144414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.144704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.144984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.146225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.147704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.149344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:42.155765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.190437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2320fae-9305-4488-8f9d-3761c3eb11e8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.191435 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.192959 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:42.226719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.227431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.227713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.227988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.229185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.230792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.232612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 30/55] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:42.237995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:42.269116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0dd2-94a1-4078-9fb8-a9935f95c005 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.304331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.304988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.305279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.305557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.306440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.domain.id=default, user.id=e0e735ce611649f28deffe005a930461) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:42.306753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.309398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9985197-f101-48bf-bba4-425b99a429b6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.316637 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 26/56] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Jul 24 00:51:42 2022] GET /identity/v3/role_assignments?user.id=e0e735ce611649f28deffe005a930461&scope.domain.id=default&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:42.348424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6e72-c1c1-4aa4-8fa8-7379b7a9cff6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:42.389150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:42.389869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:42.390155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:42.390428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:42.391171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:42.392684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62619c8-568c-41bb-a5e1-073381127859 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:42.419979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 31/57] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Jul 24 00:51:42 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:51:44.482793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53371e-903e-4d94-9209-aee9ff7438de None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.483277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53371e-903e-4d94-9209-aee9ff7438de None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.483277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53371e-903e-4d94-9209-aee9ff7438de None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.484660 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:44.490032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af080-da99-47c7-b404-100f5880742a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.490417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af080-da99-47c7-b404-100f5880742a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.490600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af080-da99-47c7-b404-100f5880742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.612798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-230af080-da99-47c7-b404-100f5880742a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:44.614059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-230af080-da99-47c7-b404-100f5880742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:44.632211 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:44.681155 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:44.705886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53371e-903e-4d94-9209-aee9ff7438de None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.808338 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:44.812898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53371e-903e-4d94-9209-aee9ff7438de None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:44.847249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:44.848035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.848315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.848589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.849787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:44.851232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27556e5-9a0b-4340-90c9-3a0a21ed225d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:44.852839 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 28/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:44.859103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230af080-da99-47c7-b404-100f5880742a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:44.955945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230af080-da99-47c7-b404-100f5880742a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:44.989580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:44.990272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:44.990557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:44.990836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:44.991556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:44.993013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc654-650d-4312-8c54-37a710a1955d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:45.017864 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:51:44 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:48.141908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c617-630f-43ab-b725-6bc0f7e1e74b None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.142401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c617-630f-43ab-b725-6bc0f7e1e74b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.142472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365c617-630f-43ab-b725-6bc0f7e1e74b None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.143859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 29/62] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:48.148970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff966-082b-400b-99a7-6a3dba2cbfc4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.149358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff966-082b-400b-99a7-6a3dba2cbfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.149540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ff966-082b-400b-99a7-6a3dba2cbfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.177873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6b4ff966-082b-400b-99a7-6a3dba2cbfc4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:48.179103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b4ff966-082b-400b-99a7-6a3dba2cbfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:48.187401 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:48.283042 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 34/63] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:48.331240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c617-630f-43ab-b725-6bc0f7e1e74b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.337854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87666e-8592-4b5f-9a4e-5526216fe43c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.338154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87666e-8592-4b5f-9a4e-5526216fe43c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.338438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87666e-8592-4b5f-9a4e-5526216fe43c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.340510 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 35/64] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:48.351615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa72e-2fda-475a-a91b-62774544af5d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.352022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa72e-2fda-475a-a91b-62774544af5d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.352307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa72e-2fda-475a-a91b-62774544af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.387038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a62aa72e-2fda-475a-a91b-62774544af5d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:48.388211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a62aa72e-2fda-475a-a91b-62774544af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:48.491716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365c617-630f-43ab-b725-6bc0f7e1e74b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:48.496606 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:48.497775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745b6d-43fc-4731-9b26-f98c38f389a7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.498069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745b6d-43fc-4731-9b26-f98c38f389a7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.498344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745b6d-43fc-4731-9b26-f98c38f389a7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.499755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 37/66] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:48.506365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.506651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.506929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.537268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:48.538517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:48.539290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:48.540257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.540780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.541195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.560040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:48.568229 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:48.569237 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:48.570135 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:48.572043 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 30/67] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:48.578507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.611664 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:48.627247 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:48.633450 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 38/68] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:48.634334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.692262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77400f-8181-4fd3-a064-6a4ed271d642 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:48.731132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:48.731933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.732219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.732495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.743775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:48.747773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4ebab-6269-443d-929d-817558436cb9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:48.751822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:48.752703 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:48.753421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:48.758012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 31/69] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:48.758846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.786416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:48.787106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.787427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.787708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.788469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:48.788775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:48.790206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa5da-ed1e-482d-ab54-56e557195998 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 39/70] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2dae-6cd4-4887-bcdd-b9e654db13b7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2dae-6cd4-4887-bcdd-b9e654db13b7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2dae-6cd4-4887-bcdd-b9e654db13b7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 40/71] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:48.805788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2dae-6cd4-4887-bcdd-b9e654db13b7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.871417 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:48.884133 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:48.886786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2aa14-971c-4f6d-866f-cc96ba2fc026 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:48.924819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:48.925637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.925952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.926238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.933012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2dae-6cd4-4887-bcdd-b9e654db13b7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:48.937902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:48.946112 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:48.946936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:48.947665 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 32/72] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:48.948825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:48.976043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:48.976727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.977009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.977287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:48.978098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:48.978588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:48.980375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4037d1-0330-49d0-b2d9-28549ab69f54 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:48.990795 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 41/73] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:48.992188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:48.992475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:48.993284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.012454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:49.013663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:49.054254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db100214-edb9-42fe-b2da-df83c1f0bca3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.079810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 42/74] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:49.086544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.088479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.089479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.089791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.090070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.105064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.106587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf85f-d18e-4e49-a4c7-fe91155844b4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.108290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 33/75] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:48 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:49.109521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a28c-a355-44a3-bdda-2fc9e243bbb4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.109830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a28c-a355-44a3-bdda-2fc9e243bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.110107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541a28c-a355-44a3-bdda-2fc9e243bbb4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.113933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 34/76] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:49.113933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a28c-a355-44a3-bdda-2fc9e243bbb4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.122156 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.149925 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.196833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a011a-30b7-4e6d-93e9-043dae560f4c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.220301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541a28c-a355-44a3-bdda-2fc9e243bbb4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.232645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.233313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.233595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.233901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.234658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:49.234962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.236337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.244171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 43/77] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:49.246538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.257823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.258701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.258981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.259256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.260462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.262309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.263957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 35/78] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:49.268730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.345889 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.353329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65a67-6bf6-4715-bf27-a34a4c1f4423 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.370988 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.382379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ce8c-5360-4f8c-8090-218e80e2a591 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.390085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.390894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.391180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.391455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.402228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-73da4c76-3c26-427a-b934-5bb01a85e25b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:49.410094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:49.410918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 44/79] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:49.414804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.416071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.416071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.419857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.420513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.420797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.421093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.431159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:49.432394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:49.508548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.508850 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 45/80] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:49.509761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.509989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.602065 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.627381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17254e9b-0850-4c3d-8a07-5733714b67b3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.635413 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.642278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 36/81] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:49.642278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.671473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.672363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.672642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.672913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.674164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.675641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.677303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 46/82] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:49.681954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.761279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a9b43-2300-4e50-b597-511b24e29f95 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.796170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce103-664c-4885-8515-b23bd2a688c4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:49.803964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.804621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.804902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.805176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.832345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:49.833023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:49.833317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:49.833589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:49.834380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:49.834688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.836086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.846403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 47/83] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:49.847237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:49.857981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.887744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:49.889551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:49.890133 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:49.960584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c572f-0b2f-4216-a666-57e61a900362 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.002228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.003058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.003339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.003613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.004962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.011146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 37/84] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:50.011400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.011498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.011580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 48/85] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.011580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.101004 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.126839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1b05-9189-4552-84c4-27a5003f7376 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.129252 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.133473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1597ab3-025c-4bf1-a826-ee9b0b5fca1d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.164198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.164866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.165155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.165438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.180363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.181237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.181581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.181887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.183393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.184895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.187427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 38/86] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.188217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.255640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.258084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.305197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b816-63a7-43a4-8d9b-b9fcfb010054 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.350782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.352530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.352530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.352530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.353810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.355338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.357157 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 39/87] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.357779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.370168 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.379683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 49/88] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:50.380887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.385459 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.462610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311d68e-ec5a-4995-94a1-9dd635e3f1e2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.488992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df1988-6cf0-458b-be2f-05b6e50a0091 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.498929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.499787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.500066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.500341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.501550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.503047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.504759 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 40/89] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.505537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.524688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.525360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.525643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.525947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.526926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.528188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.547120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 50/90] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:51:50 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:50.547948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.607495 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.631589 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.635739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d95bf-c69a-45e2-a304-e86b00852c60 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.673230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.673928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.674212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.674488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.675337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:50.675657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.677130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.684368 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 41/91] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.685050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.686040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdbee-205c-44cf-a53f-b0ff02e0a60a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.740056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.740742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.741033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.741316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.844246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eeac7-be29-4dc5-bbc3-98eb71551d53 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:50.849833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.851607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.899827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:50.900674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:50.900959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:50.901268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:50.903312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:50.904815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:50.906650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 42/92] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:50.907449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:50.928718 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.937985 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:50.999882 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 51/93] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:51.001770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.040313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0c918-7d5b-4dc6-9464-1cc79d364623 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.091369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.092057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.092348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.092718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.093873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=e0e735ce611649f28deffe005a930461) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:51.094194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.095721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.112438 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 43/94] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/role_assignments?user.id=e0e735ce611649f28deffe005a930461&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.113325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.173809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cbd6b-8c5f-4c86-a073-94133d315d91 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.243302 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.270531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.271447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.271739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.272019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.272888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:51.273208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.274877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.284191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 52/95] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:50 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.324955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c576c-7065-436a-b0a0-1b3c60d19fc5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.393223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.394134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.394425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.394713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] PATH_INFO: `/v3/projects/a71ce16244f84042b0bc4c65a045360b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.398571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] RBAC: Authorizing `identity:get_project(project_id=a71ce16244f84042b0bc4c65a045360b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.400088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468bb9-8a63-4ba8-aa89-94913fc18c5f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.402658 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 44/96] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/projects/a71ce16244f84042b0bc4c65a045360b => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:51.408715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:51.441846 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:51.555342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b5d0a-939e-4ab5-8f44-d51b241a5af7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:51.601284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:51.601986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:51.602265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:51.602539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:51.603386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=a71ce16244f84042b0bc4c65a045360b, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:51.603695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:51.605738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1fab5-3e6d-42e5-b519-3b41975749b3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:51.612068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 53/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:51 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=a71ce16244f84042b0bc4c65a045360b&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.307581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5c6e-d339-47a4-b0fe-08da1b1f01b5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.308082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5c6e-d339-47a4-b0fe-08da1b1f01b5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.308346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5c6e-d339-47a4-b0fe-08da1b1f01b5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.309752 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 45/98] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:53.315063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9db9-9093-4eb1-8585-670753d9d42e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.315486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9db9-9093-4eb1-8585-670753d9d42e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.315658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9db9-9093-4eb1-8585-670753d9d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.337857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16fc9db9-9093-4eb1-8585-670753d9d42e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:53.339864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16fc9db9-9093-4eb1-8585-670753d9d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:53.427713 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 54/99] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:53.463459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5c6e-d339-47a4-b0fe-08da1b1f01b5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.595605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5c6e-d339-47a4-b0fe-08da1b1f01b5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.640016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f62c1-d47a-46f1-9fdf-725c6cfd995e None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.640194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.640313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f62c1-d47a-46f1-9fdf-725c6cfd995e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.640701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f62c1-d47a-46f1-9fdf-725c6cfd995e None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.640864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.641106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.641390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.641987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 55/100] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:53.647669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0488-7a8f-4ea9-8cd1-e3c471a5c2db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.647958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0488-7a8f-4ea9-8cd1-e3c471a5c2db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.648236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b0488-7a8f-4ea9-8cd1-e3c471a5c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.661953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:53.667783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-455b0488-7a8f-4ea9-8cd1-e3c471a5c2db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:53.668995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-455b0488-7a8f-4ea9-8cd1-e3c471a5c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:53.670334 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:53.671637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:53.672559 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 46/101] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:53.678663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.689898 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.690098 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:53.800561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 56/102] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:53.820673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c95a7-abd5-4b13-893a-efe3d14ae40c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.820987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c95a7-abd5-4b13-893a-efe3d14ae40c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.821234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c95a7-abd5-4b13-893a-efe3d14ae40c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.822918 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 57/103] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:53.829711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.829977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.830265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.857839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:53.859049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:53.888119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04c59-2ef2-46e5-857d-5951d6e32518 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:53.925287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:53.926014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.926346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.926629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.927441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:53.927695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:53.929144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ab15f-edf1-4c71-ac72-013198f8a446 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:53.937656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 58/104] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:53.942049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 47/105] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:53.943077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:53.943409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea66a-ef3f-4e0b-b979-3fcdb53246fb None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:53.943703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea66a-ef3f-4e0b-b979-3fcdb53246fb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:53.944000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea66a-ef3f-4e0b-b979-3fcdb53246fb None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:53.945223 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 48/106] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:53.957692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea66a-ef3f-4e0b-b979-3fcdb53246fb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.016854 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.060070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea66a-ef3f-4e0b-b979-3fcdb53246fb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.070134 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.082347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfc9a-7bae-472a-964a-2c808379ee48 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.096533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.097486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.097734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.098071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] PATH_INFO: `/v3/users/34cac08b39594a099a0925b089b59a5b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.113587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] RBAC: Authorizing `identity:get_user(user_id=34cac08b39594a099a0925b089b59a5b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.115211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c4d38-553b-4e93-94b8-682251b045e6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.117342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 49/107] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/users/34cac08b39594a099a0925b089b59a5b => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:54.118716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.119047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.119284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.132115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.134647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.134935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.135268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.148111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:54.157294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:54.158245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:54.159031 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:54.159576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:54.160980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:54.161760 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 59/108] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:54.162732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.261787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 50/109] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:54.261787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.303917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a9bb2-fb66-4db3-a20e-daad98de17a1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.328792 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.340964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.342347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.342774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.343459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.344909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.346582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.348403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 60/110] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:54.349347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.359419 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.390798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28dcb8-401c-4f3c-9592-3ddebdbe69f6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.430797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.431723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.432155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.433290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.458493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4053-e292-48d0-8419-c4165fd10670 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.497351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.498656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.499545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.500026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.501010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:54.501524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.504087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.520959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 61/111] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:54.520959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.530557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.532481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.592015 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.594244 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.632315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f53160-27ef-4baf-a648-57bb723c34de None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.649370 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 51/112] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:51:54.650522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.672692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.673620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.674011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.674365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.694599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:54.706573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:54.707413 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:51:54.708135 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:54.713036 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 62/113] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:54.714458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.772299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc6-eae9-41b8-a15e-064383445b4c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.810607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.811607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.812062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.812495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.813285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.814786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.824762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a108e-2962-4229-b2bc-1290074d0143 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:54.842004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 52/114] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:51:54 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:54.842822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.847681 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.867144 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:54.877136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:54.878087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:54.878369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:54.878646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:54.880035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:54.881602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:54.885883 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 63/115] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:54.885883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:54.980714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4d483-d74e-4298-acc2-4d1e467297c4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.023826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19763fad-6f3a-46ff-9bbd-a126900caf72 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.027152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.028432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.028725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.029007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.031038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.031787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b4d87-fde0-46f0-9bc4-47cf2e5469a4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.034729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 53/116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.034856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e087-f2ae-4ae3-b914-f65a4c917a5c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.036725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e087-f2ae-4ae3-b914-f65a4c917a5c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.036725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e087-f2ae-4ae3-b914-f65a4c917a5c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.036725 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 54/117] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:55.037310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e087-f2ae-4ae3-b914-f65a4c917a5c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.066237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.067012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.067298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.067575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.068330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:55.068642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.070068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ded92-de19-43ea-b636-11660c5b686b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.079083 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 64/118] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.080372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3376829-e03f-4416-a074-a9c2774ae22c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.080658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3376829-e03f-4416-a074-a9c2774ae22c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.080932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3376829-e03f-4416-a074-a9c2774ae22c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.082192 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 65/119] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:55.087064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.087064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.087064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.104853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:55.106203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:55.128323 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.163874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e087-f2ae-4ae3-b914-f65a4c917a5c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.164673 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.183353 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 66/120] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:55.184515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.208828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.209990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.210281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.210953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.212170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.214350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.216114 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 55/121] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.216888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.312894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265fbd0-3490-46c9-ad2b-23974735ed07 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.325790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8298ee-a4ac-444f-97d6-53dda350d02d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.358303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.358975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.359244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.359517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.360387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=34cac08b39594a099a0925b089b59a5b) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:55.360725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.361882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.362252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.362773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.363061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.363340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.364570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.366202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c62db-a71a-4729-b7c3-5bd97513c522 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.372779 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 56/122] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.372951 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 67/123] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/role_assignments?user.id=34cac08b39594a099a0925b089b59a5b&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.372951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.379822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.380464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.380927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.406692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:55.408937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:55.412239 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.443280 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.514993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea29eb-7f97-4091-b8cd-d30bf3b72305 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.534940 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 57/124] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:55.536237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.587962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.587962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.587962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.587962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.611374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:55.622416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:55.623247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:55.623985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 68/125] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:55.625718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.676325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905fb40-0e43-4309-943c-1da44bee441b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.728018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.729186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.729581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.729995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/79e43ff7d96f451a9c642d5fde017105/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.733220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, user_id=79e43ff7d96f451a9c642d5fde017105, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.735454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.744366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2ce40-9bf6-4474-aab7-1caea16bfc35 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.756590 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 58/126] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:55 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/79e43ff7d96f451a9c642d5fde017105/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:55.758250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.761035 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.764151 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:55.812151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.814499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.814863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.815149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:55.818130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:55.821335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:55.823809 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 69/127] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:55.831547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:55.940153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa819-249a-4037-91d3-a75bc87615a1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:55.985342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:55.986923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:55.987428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:55.988164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.009396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:56.019730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:56.020588 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:56.021318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:56.024010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 59/128] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:56.025257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.069242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a764972-a528-470b-b803-2ddd46aafca2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.131519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.132221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.132502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.132780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.133551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:56.133889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.135828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.140802 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.164064 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 70/129] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.164757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.208736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7285ec-039e-427f-ab7a-6ef64c93aa14 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.236782 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.303443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.304202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda061-2eee-43fe-a17f-fbbbd3580b99 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.304386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.304647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.304933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/e0e735ce611649f28deffe005a930461/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.310528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, user_id=e0e735ce611649f28deffe005a930461, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.312037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.341093 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 60/130] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:56 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/e0e735ce611649f28deffe005a930461/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:56.343695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.351175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.352281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.352769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.353267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.354364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:56.354913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.356538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.367301 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 71/131] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.373519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.559090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fa45c-7791-43e8-b7ff-4c1463688f10 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.568425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a299c-612a-44be-8da3-6d0426c6c6b7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.571254 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.585840 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:56.615792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.617053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.617542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.618085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.620121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.622321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.623468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.624358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.624642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.624926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.625689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 72/132] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.630446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.630956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.631948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.633933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 61/133] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.640257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.752991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752819-edc5-4b42-ab30-5da3fb6316b7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.800305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.801569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.802092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.802584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] PATH_INFO: `/v3/projects/a71ce16244f84042b0bc4c65a045360b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.806454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] RBAC: Authorizing `identity:get_project(project_id=a71ce16244f84042b0bc4c65a045360b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.808864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.813756 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 73/134] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/projects/a71ce16244f84042b0bc4c65a045360b => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.816803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.825220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf403-1d49-46cd-8bb8-9c99b075bf07 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:56.899775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:56.900670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:56.901016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:56.901304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:56.902769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:56.904699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:56.907014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 62/135] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:56 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:56.912521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:56.927960 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.026078 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.060055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bc77a-f555-4f3e-bc08-445fa846143b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.136508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384de246-61ea-4619-9b03-4059cbcaf322 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.178423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.179342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.179632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.179913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] PATH_INFO: `/v3/projects/a71ce16244f84042b0bc4c65a045360b/users/79e43ff7d96f451a9c642d5fde017105/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.186540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a71ce16244f84042b0bc4c65a045360b, user_id=79e43ff7d96f451a9c642d5fde017105, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.188046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbcb01-c97c-49a9-a1be-f0cb0f8f12aa None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.209019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.210455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.211025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.211536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/79e43ff7d96f451a9c642d5fde017105/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.214674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, user_id=79e43ff7d96f451a9c642d5fde017105, role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.222006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 74/136] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:56 2022] PUT /identity/v3/projects/a71ce16244f84042b0bc4c65a045360b/users/79e43ff7d96f451a9c642d5fde017105/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:51:57.222482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d4158-624a-40e9-a6c9-2050b4774da4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.255184 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 63/137] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:56 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/79e43ff7d96f451a9c642d5fde017105/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:57.367879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd86-078f-4af1-ab46-df0353e438f5 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.368416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd86-078f-4af1-ab46-df0353e438f5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.368416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767fd86-078f-4af1-ab46-df0353e438f5 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.370746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 75/138] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:57.377059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.377797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.378412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.402213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:57.404112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:57.500994 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 64/139] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:51:57.539093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767fd86-078f-4af1-ab46-df0353e438f5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.652608 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.656581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767fd86-078f-4af1-ab46-df0353e438f5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.705165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.705997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.706275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.706548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.710522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.712023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d78bb-04df-438b-bd39-cd7a7b855450 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.714320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 76/140] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:57.720344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:57.808824 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:57.900612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321993-9d93-47ab-b1e6-d9ef61150569 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:57.937182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dcffc-b5d6-4876-83a7-233785a06b1e None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.937433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dcffc-b5d6-4876-83a7-233785a06b1e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.937662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dcffc-b5d6-4876-83a7-233785a06b1e None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.939216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 77/141] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:57.949836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.949836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.949836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.965641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:57.966641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:57.967076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:57.967510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:57.968670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:57.970331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:57.986306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:57.987748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:58.019320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 65/142] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:51:58.097830 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 78/143] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:58.115744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.255910 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.262582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a140f6-aa63-4c80-b77f-33a9a5c2c17c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.307633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.308659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.308949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.309231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.324610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:58.332584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:58.333471 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:51:58.334277 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 66/144] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:51:58.340777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.467712 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.472398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311b46-b24f-45b8-bd46-f17616881a56 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.527097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.527792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.528083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.528363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.529138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:58.529448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.530894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc1db-45a2-4c4b-b4ed-e1f0d843db37 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.544231 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 79/145] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.549851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.687162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486d71-76ba-43e7-9fed-ab1b0993b579 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:58.695877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829e30-3d13-45ff-909d-0dfa2af4f955 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.696203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829e30-3d13-45ff-909d-0dfa2af4f955 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.696442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829e30-3d13-45ff-909d-0dfa2af4f955 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.698632 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 80/146] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:51:58.704391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.704684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.704968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.733444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:58.734703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:58.761931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:58.762831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:58.763118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:58.763397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] PATH_INFO: `/v3/users/34cac08b39594a099a0925b089b59a5b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:58.764906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] RBAC: Authorizing `identity:get_user(user_id=34cac08b39594a099a0925b089b59a5b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:58.769003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:58.770942 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 67/147] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/users/34cac08b39594a099a0925b089b59a5b => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:58.781703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:58.834832 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:58.873907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 81/148] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:51:58.898599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.026561 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.026903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e0cc0-484d-4144-83ac-46a741bcabd4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.051449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d45d6f-f9b5-43cc-a077-188a4f611643 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.107736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.108622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.108911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.109193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.112180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.113726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.116903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 68/149] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:51:59.128691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.131494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.133184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.133468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.133767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.170204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:51:59.178476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:51:59.179366 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:51:59.180089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:51:59.182786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 82/150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:51:59.187458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.330163 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.336835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07391959-68fa-4f09-b081-c5182013c33e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.384455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9091f1-0ade-4bab-85fd-83c12b244c3d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.397787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.398984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.399419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.399843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/34cac08b39594a099a0925b089b59a5b/roles/9fa19dcc76cb463fa4edc18e0c7c9842` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.402919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, user_id=34cac08b39594a099a0925b089b59a5b, role_id=9fa19dcc76cb463fa4edc18e0c7c9842)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.404611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.430412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 69/151] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:51:59 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/users/34cac08b39594a099a0925b089b59a5b/roles/9fa19dcc76cb463fa4edc18e0c7c9842 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:51:59.452327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.453269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.453726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.454169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.455086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:51:59.455543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.457159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.467805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 83/152] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:59.474717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.621621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa4a3a-7303-4ad5-8f0d-fd12cbc2c0f9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.668591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.669779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.670235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.670673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.673661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.675391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7590a-29f0-4a0d-af1a-b118988127c7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.677288 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 70/153] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:51:59.683939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:51:59.702769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.813261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605b8d-9204-4f01-bcb3-409fd67aa7cb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:51:59.831039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4bfc2-1e04-4a9a-9285-9e79a6eefe66 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.832110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4bfc2-1e04-4a9a-9285-9e79a6eefe66 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.832615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4bfc2-1e04-4a9a-9285-9e79a6eefe66 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.834300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 71/154] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:51:59.842944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.843830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.844314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.852448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:51:59.853168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:51:59.853460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:51:59.853824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:51:59.878851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:51:59.880405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:51:59.910122 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:51:59.934407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:51:59.935938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:51:59.951870 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:00.007280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 72/155] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:00.057785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.153178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 84/156] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:00.159160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.303747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764881d2-63eb-4832-9c9c-dcea0e508f31 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:00.389079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dbf97-6e6c-4781-a324-2db863aeb6d7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:00.390842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:00.391671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.391957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.392236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.406546 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:00.424476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:00.432916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:00.434032 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:00.434855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:00.438399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 73/157] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:00.441948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.446375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:00.447262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.447697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.448556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.449600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:00.451203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:00.453237 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 85/158] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:00.459624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.485916 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:00.654290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fd0-e50a-4829-8589-9128167aa33b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:00.658615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7055eac-6e9c-4d36-adca-0b9e6c96743c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:00.720522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:00.721578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.722080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.722570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.723549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:00.724061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:00.726004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:00.738512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:00.739482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.739924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.740350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.741429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:00.741827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 74/159] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:00.741967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:00.744563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7f6d9-f2b4-4145-8516-06b37f8b3282 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:00.748639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:00.756978 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 86/160] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:00.800226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf055d-fa8d-48f7-aac4-db3fa68936fd None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.800911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf055d-fa8d-48f7-aac4-db3fa68936fd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.801429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf055d-fa8d-48f7-aac4-db3fa68936fd None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.803129 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 87/161] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:00.811122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.811720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.812187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.853604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:00.855261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:00.879874 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:00.918023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8985fb-2f92-4e64-b7ba-9912a6ba3bd8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:00.958839 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:00.974544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:00.975458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:00.975742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:00.976021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] PATH_INFO: `/v3/users/e0e735ce611649f28deffe005a930461` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:00.977344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e735ce611649f28deffe005a930461)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:00.979015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:00.981463 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 75/162] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/users/e0e735ce611649f28deffe005a930461 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:00.986862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.006433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 88/163] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:01.048896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.213999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1ade-e8c5-47fe-9d34-e47d48659481 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.281128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.281822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.282106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.282382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.310033 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.327645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da8eb4-b2fe-4205-b082-906a02228c95 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.415100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.415999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.416354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.416851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.438858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.440668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad7f11-eaea-4948-b091-9a3c80873d17 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.441367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d2d0199c-3a92-4d9f-a021-c0041a84d714 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:01.450577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:01.451688 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:01.452660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:01.455055 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 89/164] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:01.458380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563984b-d1a3-4660-8741-89a1d311e84d None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.458816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563984b-d1a3-4660-8741-89a1d311e84d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.459559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563984b-d1a3-4660-8741-89a1d311e84d None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.461044 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 90/165] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:01.466403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563984b-d1a3-4660-8741-89a1d311e84d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.531630 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.621341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 76/166] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:01.621982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563984b-d1a3-4660-8741-89a1d311e84d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.622795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.623086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.623370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.650827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:01.652082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:01.658984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.660229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.660752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.661213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.662205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:01.662721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.664311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.675328 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 91/167] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:01.676775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.725779 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.767625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 77/168] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:01.768492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.858084 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:01.873334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4d34-c56f-447d-a268-5cf3df0cb365 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.927633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70c36d-c6d4-4de0-a4e2-2cb0f3264c85 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:01.954476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.955373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.955666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.955933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.959599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:01.961076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:01.963601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 92/169] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:01.964186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:01.993350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:01.995034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:01.995464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:01.995985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:01.999894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.001614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.004064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 78/170] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.005108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.062047 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.142827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579d0e3-63c5-41f0-9db9-92c473b19f30 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.210357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22556-8a29-4dca-a909-a05a7c278775 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.246286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.247332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.247860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.248373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.250269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=e0e735ce611649f28deffe005a930461) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:02.250846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.261833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.276924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 79/171] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/role_assignments?user.id=e0e735ce611649f28deffe005a930461&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.277876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.277983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.278862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.279144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.279420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.300914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:02.313984 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:02.314903 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:02.315632 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 93/172] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:02.323271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.365450 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.498386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca8a3-65f7-4a5b-8c98-3cea2538b2eb None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.507121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f45769-eb13-48cd-bbce-8cde5de38873 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.518027 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.555880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.556917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.557380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.557830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.611027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.612003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.612432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.612855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.613804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:02.614274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.615829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.633799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 94/173] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:02.638791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.659600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.665705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb4692-a8b2-4019-b975-7faf75623bb8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.799858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 80/174] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:02.801820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df2e4-a659-4c94-89f9-2dd0437935cc None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.802259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df2e4-a659-4c94-89f9-2dd0437935cc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.802681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df2e4-a659-4c94-89f9-2dd0437935cc None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.804393 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 81/175] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:02.810175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df2e4-a659-4c94-89f9-2dd0437935cc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:02.826064 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.870259 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:02.895630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02068e1-02c9-4708-a677-a81f8a752194 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:02.968570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:02.969462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.969776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.970052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] PATH_INFO: `/v3/users/79e43ff7d96f451a9c642d5fde017105` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:02.972402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] RBAC: Authorizing `identity:get_user(user_id=79e43ff7d96f451a9c642d5fde017105)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:02.973923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c843e39-58fd-40f2-b333-4a7f3809548c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:02.975608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 95/176] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/users/79e43ff7d96f451a9c642d5fde017105 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:02.976775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:02.977053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:02.977333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.014686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df2e4-a659-4c94-89f9-2dd0437935cc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.023241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.024651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.082272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.083069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.083350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.083623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.085356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.086855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.088677 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 82/177] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:02 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:03.089475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.169531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 96/178] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.170218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.232389 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.262366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9b94-9eeb-4dee-a956-a6d9ce8043d7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.288068 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.304238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.304901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.305187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.305465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.307735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02133bda-9ccf-4bb4-8839-2dbc38749c2c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.351389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.351974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.352259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.352539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.354439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:03.354755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.356732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b30c4-a78b-4544-8d50-3a01f0441efc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.365235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 97/179] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.366555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb478c8-d0f7-4e04-8daf-510c55d048e3 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.366853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb478c8-d0f7-4e04-8daf-510c55d048e3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.367132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb478c8-d0f7-4e04-8daf-510c55d048e3 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.368388 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 98/180] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:03.369089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb478c8-d0f7-4e04-8daf-510c55d048e3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.424191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.425868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65818b73-8c71-4d29-a530-fbad6fda6d26 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.500734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb478c8-d0f7-4e04-8daf-510c55d048e3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.520441 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.549003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.549848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.550125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.550396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.554629 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 83/181] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:03.555216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab71fad-d6e3-474c-bbaf-bac8f4c79251 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.555603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab71fad-d6e3-474c-bbaf-bac8f4c79251 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.555787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab71fad-d6e3-474c-bbaf-bac8f4c79251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.563702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a72c6944-be87-43ea-b5fe-0fbafc7789fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:03.572015 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:03.573504 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:03.574879 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 99/182] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:03.575537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6ab71fad-d6e3-474c-bbaf-bac8f4c79251 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.575616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753b4-fecd-471b-9754-f5c64139be76 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.576003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753b4-fecd-471b-9754-f5c64139be76 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.576159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753b4-fecd-471b-9754-f5c64139be76 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.576424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6ab71fad-d6e3-474c-bbaf-bac8f4c79251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.577387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 100/183] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:03.579291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55eaee-2ed0-4dad-afc9-a1c0968a350f None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.579291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55eaee-2ed0-4dad-afc9-a1c0968a350f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.579291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55eaee-2ed0-4dad-afc9-a1c0968a350f None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.583692 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 101/184] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:03.585299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55eaee-2ed0-4dad-afc9-a1c0968a350f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.597977 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.659860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 84/185] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.661129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b999-2cbf-4074-bc80-995bf96bf341 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.661423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b999-2cbf-4074-bc80-995bf96bf341 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.661751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b999-2cbf-4074-bc80-995bf96bf341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.681449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2c43b999-2cbf-4074-bc80-995bf96bf341 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.683263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2c43b999-2cbf-4074-bc80-995bf96bf341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.700370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55eaee-2ed0-4dad-afc9-a1c0968a350f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.733745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.734604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.734881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.735157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] PATH_INFO: `/v3/projects/a71ce16244f84042b0bc4c65a045360b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.736320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a71ce16244f84042b0bc4c65a045360b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.737780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.739455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 102/186] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/projects/a71ce16244f84042b0bc4c65a045360b => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.740205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.755591 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 85/187] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.756866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.757150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.757440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.782160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:03.783387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:03.810088 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.820260 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:03.844945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bbf-c3f6-416c-9710-e85c0776e8e0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.852539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 86/188] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:03.856608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.878809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:03.879475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:03.879754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:03.880026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:03.880790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:03.881091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:03.882499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:03.891556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 103/189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:03.892556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:03.963983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091f2d2-e2d0-4301-bbc7-43217039f117 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.996797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c828cd1-31b5-4bf9-976d-c3393cdeb088 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:03.999694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.000510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.000789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.001059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.002287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.003819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.005431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 87/190] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.006241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.035620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.036279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.036564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.036843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.037698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=a71ce16244f84042b0bc4c65a045360b, user.id=79e43ff7d96f451a9c642d5fde017105) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.037806 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.038211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.039479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.045619 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 104/191] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:03 2022] GET /identity/v3/role_assignments?user.id=79e43ff7d96f451a9c642d5fde017105&scope.project.id=a71ce16244f84042b0bc4c65a045360b&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.046431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.048964 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.117622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c778-e538-4ad8-9bd9-bd3c857f0179 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.166669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.167637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.167802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.168116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.181191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:04.186914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7264-97c7-46cd-b144-aa02fd44db8e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:04.190154 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:04.191067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:04.191837 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 88/192] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:04.194734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.233389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.234280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.234563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.234841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.252049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:04.260384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:04.261479 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:04.262321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 105/193] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:04.263405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.320175 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.334765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0fbf-2ec1-401c-9741-09420df62ace None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.339426 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.372386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.373257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.373532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.373841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.386583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2da392-498a-4963-b1c8-27aa93aa6185 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.388221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.389790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.391656 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 89/194] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.392226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.427526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.428198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.428472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.428742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.429457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.430953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.452164 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 106/195] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:04 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:04.453042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.534182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052be6c-b405-4992-af1a-be43278f758e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.587752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160d1f-1633-4210-b837-712df061df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.589954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160d1f-1633-4210-b837-712df061df6e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.590281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160d1f-1633-4210-b837-712df061df6e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.590560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160d1f-1633-4210-b837-712df061df6e None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.591368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160d1f-1633-4210-b837-712df061df6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.591675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160d1f-1633-4210-b837-712df061df6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.593365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160d1f-1633-4210-b837-712df061df6e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.602988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b7934-182b-4b4c-8c47-1dcfaa5bf39b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.603377 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 90/196] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.604479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160d1f-1633-4210-b837-712df061df6e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.623382 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.624315 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.649359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.650238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.650411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.651297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.652269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:04.652578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.654024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.664906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 107/197] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.665105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.753605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160d1f-1633-4210-b837-712df061df6e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.816053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.816053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.816053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.816053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.818756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e5ecb-38e5-46a1-a56e-145c59c47320 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:04.868597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:04.870957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:04.871244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:04.871516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:04.873063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.875386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.877337 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 108/198] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:04.878603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:04.905018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:04.906554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:04.926331 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:04.970098 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.024597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f07e95-58e6-4c2f-8e78-41b1e32babd0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.026845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 91/199] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:05.032530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.069063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.070217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.070654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.071096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] PATH_INFO: `/v3/users/34cac08b39594a099a0925b089b59a5b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.072667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] RBAC: Authorizing `identity:get_user(user_id=34cac08b39594a099a0925b089b59a5b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.074431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.081052 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 109/200] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:04 2022] GET /identity/v3/users/34cac08b39594a099a0925b089b59a5b => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.082319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.142085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285ce7-d871-4c8e-9fab-5326af81655f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.157792 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.182741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.183895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.184251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.184661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.208674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52b04-d128-4893-a0fb-c7dda31ba8ad None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.228651 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.251273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.252711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.253281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.253768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.255302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.257136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.264325 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 110/201] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.264516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.265236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.266283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.376838 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 92/202] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:05.376838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.389383 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.397350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb013e4-e41a-46c1-957a-decb26f57651 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.437550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.438609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.439105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.439604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.481644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1df8-0cc5-4120-8ea1-ad9bba1b0942 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.504971 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.518750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.519327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.519607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.519870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.520714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=c5979c10691e44189112a3b7e3634677) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:05.521035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.522523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.533712 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 93/203] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/role_assignments?user.id=c5979c10691e44189112a3b7e3634677&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.533712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.553370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.554934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.695988 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:05.720516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d06a7-76b6-4857-b417-8663f64ea653 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:05.768073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:05.768944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:05.769220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:05.769495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:05.770757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:05.772211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:05.782033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 94/204] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:05.788965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.795463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 111/205] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:05.801127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:05.972314 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:06.003596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d0bc6-9086-4f76-b0f8-047c0eff6adc None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.015548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bff8-3f0b-4691-8de7-c17036b55d9f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.050453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.052607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.052890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.053161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.056816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.060870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.066015 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 112/206] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:06.068530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:06.081831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.082502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.082783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.083054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.083895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=c5979c10691e44189112a3b7e3634677) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:06.084201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.085682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2470-0b12-471c-b07c-115831cf800a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.100339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 95/207] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:05 2022] GET /identity/v3/role_assignments?user.id=c5979c10691e44189112a3b7e3634677&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:06.247527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d78550-3c98-4ead-9550-a78386e1e292 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:06.300337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16853-76df-4318-9d44-100828065d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:06.301021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16853-76df-4318-9d44-100828065d60 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.301301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16853-76df-4318-9d44-100828065d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.301573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16853-76df-4318-9d44-100828065d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.302462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16853-76df-4318-9d44-100828065d60 None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7, user.id=34cac08b39594a099a0925b089b59a5b) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:06.302771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16853-76df-4318-9d44-100828065d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:06.304247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16853-76df-4318-9d44-100828065d60 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:06.314471 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 113/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:06 2022] GET /identity/v3/role_assignments?user.id=34cac08b39594a099a0925b089b59a5b&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:06.900462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb48b9-360d-4921-8cad-b5fbaa212658 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.901006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb48b9-360d-4921-8cad-b5fbaa212658 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.901006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb48b9-360d-4921-8cad-b5fbaa212658 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.902849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 96/209] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:06.908008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabde8-692a-4246-b925-f02e596b41cd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:06.908302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabde8-692a-4246-b925-f02e596b41cd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:06.908585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabde8-692a-4246-b925-f02e596b41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:06.927734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eaeabde8-692a-4246-b925-f02e596b41cd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:06.928963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eaeabde8-692a-4246-b925-f02e596b41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:06.941930 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.003089 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 114/210] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:07.027496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb48b9-360d-4921-8cad-b5fbaa212658 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.044673 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.136551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b34cc-a4c8-4f03-907b-fea8703a767c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.136849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b34cc-a4c8-4f03-907b-fea8703a767c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.137114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b34cc-a4c8-4f03-907b-fea8703a767c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.139808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 115/211] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:07.143858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.144145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.144421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.148162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb48b9-360d-4921-8cad-b5fbaa212658 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.162203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:07.163329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:07.195706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.197570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.198139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.198759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.213234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:07.224047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:07.225127 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:07.226090 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:07.234352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 97/212] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:07.235401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.253836 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 116/213] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:07.272427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.332733 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.360765 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.376158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7754c-5310-4d9f-adb6-0e7e55623f57 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.388889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4b3e3-bac0-42e8-ab20-fbaeb3d38cef None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.427431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.428579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.429062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.429535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.430973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.431125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.431685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.431969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.432244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.433014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:07.433318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.434059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.434864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.436743 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 117/214] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:07.447788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.448113 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 98/215] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:07.454727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.560523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20c6e-15bf-4c4c-83fc-612ece735acd None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.570735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83040371-ac4b-49f1-9778-c6a11b38faae None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.599426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.600180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.600466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.600743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.601579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.603189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.605978 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.615125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.617376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.618163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.619016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] PATH_INFO: `/v3/users/b64865f02f1d4a62853ca732da40b925` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.625453 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.633589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 118/216] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:07 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:07.638832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b64865f02f1d4a62853ca732da40b925)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.640738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4e609-720d-449e-97e6-362a8af3f6e0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.643538 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 99/217] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/users/b64865f02f1d4a62853ca732da40b925 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:07.649913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:07.775229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077773d-f5d7-48c7-b9aa-ee44b18bc468 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:07.816157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:07.816830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.817113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.817454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.843618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b0f9-b4e5-4276-8460-1f39ea461871 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.844087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b0f9-b4e5-4276-8460-1f39ea461871 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.844505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600b0f9-b4e5-4276-8460-1f39ea461871 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.846961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 100/218] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:07.853097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:07.853448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:07.853762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:07.874390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:07.875949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:07.910110 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:07.914330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:07.916919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:07.972885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 101/219] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:08.006916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.073705 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 119/220] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:08.079453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.146784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583310ea-987a-4146-ace7-fa51bca0ee71 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.178816 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.195846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.197618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.198308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.198910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.205556 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.211313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc540e1-f67c-4db7-be5b-0fc51429f617 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.215005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:08.223519 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:08.224432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:08.225187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:08.227260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 102/221] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:08.234775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.261698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.261698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.261698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.261698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.262153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.262153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.262153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 120/222] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.263908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.412671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e23f48-c98c-4432-acca-9d884ad079ec None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.428639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da79960-5acc-4606-b595-3e0a652baa26 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.468900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.469588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.469900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.470173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.470942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:08.471244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.472681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2394-fc1f-4384-b2d9-874bc85aaea5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.486322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 103/223] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.488299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f2b3-b8e1-4f61-b8df-ce50a061bd46 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.488587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f2b3-b8e1-4f61-b8df-ce50a061bd46 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.488861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f2b3-b8e1-4f61-b8df-ce50a061bd46 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.495814 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 104/224] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:08.495814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f2b3-b8e1-4f61-b8df-ce50a061bd46 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.504198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.505314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.505314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.505578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.506480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=b64865f02f1d4a62853ca732da40b925) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:08.506786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.508344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47616322-96f8-45d8-ab57-480aaf260cd7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.515634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 121/225] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/role_assignments?user.id=b64865f02f1d4a62853ca732da40b925&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.516973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.517189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.517463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.553270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:08.562306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:08.570077 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.586798 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:08.639824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 122/226] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:08.680146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.734536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f2b3-b8e1-4f61-b8df-ce50a061bd46 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.778027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.778931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.779214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.779494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.786609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:08.788127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:08.794023 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 105/227] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:08.802698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.808748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e3f70-50c8-4c1d-98a0-6e14b7444980 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:08.848504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:08.849321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:08.849602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:08.850023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:08.862928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:08.872306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:08.873195 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:08.873987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 123/228] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:08.880921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:08.926114 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.026286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d694cc-5667-407a-accb-ed19c7e4c944 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.095043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919b6ee-e4b1-4eed-948a-240d104f117c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.108488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.109196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.109423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.109876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.110774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:09.111246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.112791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.145909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 124/229] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:09.147282 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.151300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.178064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.179183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.179637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.180051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.181792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.183431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.185373 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 106/230] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:08 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:09.193620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.305939 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.324072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926e3a0-fd05-43ab-8068-8285267e33c3 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.359594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.360831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.361309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.361868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.363405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.365194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.367120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 125/231] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:09.373159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.411658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9d485-d361-4bd2-96de-7ad4f39052c3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.483031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.483954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.484235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.484509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/c5979c10691e44189112a3b7e3634677/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.487213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, user_id=c5979c10691e44189112a3b7e3634677, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.488705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.514942 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 107/232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:09 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/c5979c10691e44189112a3b7e3634677/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:09.539228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151fff8-87e2-4daa-8304-9899225b0906 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.600332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.601797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.602308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.602873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.606519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.609449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2defe3-6ab3-41b8-8eb2-2b0745477405 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.612901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 126/233] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:09 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:09.622314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:09.701061 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:09.817298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c32b40-56e1-455b-ad86-30a3ada160cc None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:09.870555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:09.872283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:09.872782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:09.873277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/c5979c10691e44189112a3b7e3634677/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:09.875945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, user_id=c5979c10691e44189112a3b7e3634677, role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:09.877816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dcdbd-9cae-427d-abb6-93f09e441039 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:09.899459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 108/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:09 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/c5979c10691e44189112a3b7e3634677/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:10.356947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30422-c43c-417c-9b59-07ee67bd0de6 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.357986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30422-c43c-417c-9b59-07ee67bd0de6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.358492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30422-c43c-417c-9b59-07ee67bd0de6 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.360094 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 127/235] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:10.365765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.366638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.367109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.386166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:10.387699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:10.454475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc74c-fcd4-4c50-a495-d669eca16df2 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.455134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc74c-fcd4-4c50-a495-d669eca16df2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.455656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbc74c-fcd4-4c50-a495-d669eca16df2 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.457292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 128/236] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:10.463222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.463830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.464497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.488398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:10.490570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:10.503096 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 109/237] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:10.526735 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.564736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.609487 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.618934 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 129/238] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:10.659499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.708854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dc23b-6890-4390-ac48-3d458a477498 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.770778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.771600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.771876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.772145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.774623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:10.776332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:10.778053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 110/239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:10.799999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.865099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe492-ba58-46b0-a03e-cb707495201a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:10.909831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:10.910994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:10.912295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:10.914276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:10.937827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:10.947955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:10.948878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:10.949618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:10.952917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 130/240] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:10.960396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:10.982595 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:10.997110 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.014238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338b5a8-6872-466f-95ae-1eb4c0d7a576 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.086964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.088285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.088574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.088841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.089785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.093362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5174d36-9015-4e0d-a2ba-aa2a702319de None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.114173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ab29d-d71c-4e3b-b0f6-4d778d26da91 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.123601 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 111/241] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:10 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:11.125129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c228-05b5-4cae-a406-4ad375a4df20 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.125645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c228-05b5-4cae-a406-4ad375a4df20 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.126088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c228-05b5-4cae-a406-4ad375a4df20 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.127757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 112/242] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:11.134108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.134934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.136022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.157989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:11.159752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:11.191206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.192076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.192316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.192593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.193373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:11.193694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.195227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.218337 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 131/243] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:11.226064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.254822 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 113/244] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:11.280838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.344192 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.383698 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.390047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c404f0-6b8b-4c58-b803-56646e5e755a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.413393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00209a2-ab64-4f83-9893-43a2cc41a857 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.449515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.451078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.451835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.452749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] PATH_INFO: `/v3/users/87b1f154138e48d09e71d87de5e20b63` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.461828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.462926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.463629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.463629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.475237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=87b1f154138e48d09e71d87de5e20b63)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.477358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.477567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:11.480303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 132/245] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/users/87b1f154138e48d09e71d87de5e20b63 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:11.490146 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:11.491061 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:11.491823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:11.492487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.496973 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 114/246] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:11.508567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.666743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816590b-0bba-435a-8eb5-928e7beadbf0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.677140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efa37-c6b4-45e7-8b47-6680e6e71010 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.706364 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.717560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.719101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.719809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.720020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.729456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.730171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.730452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.730729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.731499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:11.731803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.733218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.742967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 115/247] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:11.749427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.754555 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:11.812245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.814943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.891633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1303f2-ff25-4930-9c9b-52836733397f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:11.931630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:11.932446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:11.933200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:11.933200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] PATH_INFO: `/v3/users/b64865f02f1d4a62853ca732da40b925` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:11.934338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] RBAC: Authorizing `identity:get_user(user_id=b64865f02f1d4a62853ca732da40b925)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:11.935840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:11.942065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 116/248] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/users/b64865f02f1d4a62853ca732da40b925 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:11.943622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:11.951368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 133/249] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:11.958938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.001489 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.022131 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.064221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3363e-3543-4702-a31e-cf981877a61c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.090478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d039c-caae-455f-8d47-433ab40adb33 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.130839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.131992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.132441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.132910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.137484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.139371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.141659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 134/250] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:12.147817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.160546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.161448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.161755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.162053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.165818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.167423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.169306 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 117/251] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:11 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:12.175261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.257502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f5995-6742-4bf2-85a4-0cacb2d9e5f0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.259608 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.298154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.299193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.299548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.299880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.300795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=87b1f154138e48d09e71d87de5e20b63) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:12.301171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.302823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d219ce-a16e-44da-8489-96aa77d238e5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.309924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 135/252] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/role_assignments?user.id=87b1f154138e48d09e71d87de5e20b63&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:12.384125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ba8f-9648-4a15-8b42-eadec0c84723 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.427086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f9656-cd73-4fad-b677-e793caf3bf8f None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.428044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f9656-cd73-4fad-b677-e793caf3bf8f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.428540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f9656-cd73-4fad-b677-e793caf3bf8f None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.430725 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 136/253] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:12.438083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.438704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.439209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.440190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.441124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.441409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.441711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/b64865f02f1d4a62853ca732da40b925/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.448607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, user_id=b64865f02f1d4a62853ca732da40b925, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.452058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.471476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:12.473304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:12.481434 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.485811 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 118/254] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:12 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/b64865f02f1d4a62853ca732da40b925/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:12.582717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 137/255] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:12.608025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.732925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e627fc-1251-4ea9-80a9-d760562a9aa1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.771172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.771979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.772258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.772531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.785452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:12.793589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:12.794538 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:12.795294 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 119/256] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:12.801075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:12.928580 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:12.939583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af9a53-195d-46d9-a1c6-090eb3ff5c9f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:12.976291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:12.976961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:12.977238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:12.977509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:12.978926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:12.979385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:12.980907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2f7e-6dc5-41ec-b2e6-416d190ebea2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:12.989860 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 138/257] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:12.995696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.062662 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.108538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724514fb-1fd4-4da4-9db8-08bbba9508c2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.132629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae191b-e5b4-4510-973a-b760a74d68bf None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.132971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae191b-e5b4-4510-973a-b760a74d68bf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.133175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae191b-e5b4-4510-973a-b760a74d68bf None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.134948 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 139/258] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:13.150656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.151818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.151934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.152330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.152469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.152791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.153023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.154492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.156122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.158270 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 120/259] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:12 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:13.168842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.188246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:13.189594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:13.356492 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 140/260] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:13.398270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d29a-c5ce-4102-a6e1-23533aa2fe5f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.416711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.478735 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.499890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.500807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.501237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.501665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.579709 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.633547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a4f16-77cf-43f1-b528-c4e12fe8daec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:13.706880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:13.708395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:13.717556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:13.718685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:13.718965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:13.719362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:13.749465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:13.758563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:13.759921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:13.760749 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 141/261] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:13.767062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.878536 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 121/262] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:13.887670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:13.932508 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:13.951955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945f73-5f7b-4c40-a6c4-cb62ba8edaa1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.012652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.013237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.013515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.013814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.014770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:14.014904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.016336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.031842 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 142/263] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:14.037251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.038927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d89d5-dc63-4263-82ec-f12d2da4d875 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.049031 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.090401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.091654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.092158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.092905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.094398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.096055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.099190 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 122/264] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:13 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:14.104353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.238676 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.248162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539622b-d7b0-4d3d-9c65-654d7b3b8ba5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.251940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1697-2213-4de2-bfe5-09f92168daae None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.294575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.295620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.296101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.296596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.297637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=c5979c10691e44189112a3b7e3634677) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:14.298166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.299827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.311946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 123/265] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/role_assignments?user.id=c5979c10691e44189112a3b7e3634677&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:14.335003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.335924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.336208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.336484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] PATH_INFO: `/v3/users/c5979c10691e44189112a3b7e3634677` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.343029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] RBAC: Authorizing `identity:get_user(user_id=c5979c10691e44189112a3b7e3634677)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.344647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf4813-ea6a-437c-977b-dddffb3deb1e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.346578 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 143/266] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/users/c5979c10691e44189112a3b7e3634677 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:14.352506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.492839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab754fe5-fd16-46eb-ab06-deb7fce43d7a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:14.537240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:14.538342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.538826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.539297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.577959 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.631745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:14.633229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:14.652052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c972-07d2-403a-a804-383003e1971c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.652566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c972-07d2-403a-a804-383003e1971c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.652651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c972-07d2-403a-a804-383003e1971c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.654306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 144/267] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:14.660090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:14.660384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:14.660756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:14.691479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:14.698255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:14.813623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 124/268] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:14.820242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.837593 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 145/269] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:14.879795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:14.883385 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:14.926246 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.007391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c092a47-5af5-4b5f-b9dc-827dff9eaef5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.058467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.059731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.060185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.060566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.062031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.064151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e8d43-1e2e-4fdf-b04d-45835f0006f5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.065719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9722eb-84f4-4dc5-9bf7-eb98a185703e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.066262 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 125/270] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.067613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550adb34-4322-4c0f-a7d3-d2ddb0b6182b None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.068071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550adb34-4322-4c0f-a7d3-d2ddb0b6182b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.068356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550adb34-4322-4c0f-a7d3-d2ddb0b6182b None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.070592 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 126/271] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:15.076812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550adb34-4322-4c0f-a7d3-d2ddb0b6182b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.108916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.110091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.110635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.111107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.125649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-89a9c1ca-686c-4725-b71b-049a5e590f92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:15.135611 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:15.136501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:15.137295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:15.139993 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 146/272] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:15.142008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.142596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.143153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.161725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:15.163230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:15.203517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550adb34-4322-4c0f-a7d3-d2ddb0b6182b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.241711 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.245399 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.253329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.254105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.254462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.254810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.255937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=c5979c10691e44189112a3b7e3634677) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:15.256317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.257832 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 147/273] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:15.257956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.258938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.273640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 127/274] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/role_assignments?user.id=c5979c10691e44189112a3b7e3634677&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.289339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.403357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454283c-f4a3-4d4b-9ae4-c5a2ef67282f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.420941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968e000-1ef6-423a-ac41-9a573891e2bd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.454327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.455332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.455815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.456263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.457219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:15.457739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.459481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.480707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 148/275] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.486601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.492757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.495092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.498104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.498725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.501754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.503569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.508592 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 128/276] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:15.519524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.591345 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.608897 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.641924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c2701-86c1-4281-ba82-0b056dcb4c7b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.657087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75a13a-6407-4561-9f58-c542ad24092b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.676510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.677381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.677657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.677949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] PATH_INFO: `/v3/users/50b943ad5acb4d73b16f8cce1ec488db` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.691187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586862-651a-4902-bc97-d909e938181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.691419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] RBAC: Authorizing `identity:get_user(user_id=50b943ad5acb4d73b16f8cce1ec488db)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.691842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586862-651a-4902-bc97-d909e938181b None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.692183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586862-651a-4902-bc97-d909e938181b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.692462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586862-651a-4902-bc97-d909e938181b None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.692945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310dbc9-ce87-4cac-a096-c3c1f09105e8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.693277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586862-651a-4902-bc97-d909e938181b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.694642 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 149/277] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/users/50b943ad5acb4d73b16f8cce1ec488db => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.694756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586862-651a-4902-bc97-d909e938181b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.698993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d045-bd75-46e0-878e-b9ee670e4186 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.699290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d045-bd75-46e0-878e-b9ee670e4186 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.699570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d045-bd75-46e0-878e-b9ee670e4186 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.700890 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 150/278] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:15.702834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df120-a28f-48c4-8aac-0970ac84d315 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.703124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df120-a28f-48c4-8aac-0970ac84d315 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.703421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df120-a28f-48c4-8aac-0970ac84d315 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.705298 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 151/279] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:15.706087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df120-a28f-48c4-8aac-0970ac84d315 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.719228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 129/280] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:15 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:15.720480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd8567-c4c8-4340-bb6a-05a68eeb3446 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.720768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd8567-c4c8-4340-bb6a-05a68eeb3446 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.721032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd8567-c4c8-4340-bb6a-05a68eeb3446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.745090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dacd8567-c4c8-4340-bb6a-05a68eeb3446 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:15.746897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dacd8567-c4c8-4340-bb6a-05a68eeb3446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:15.833440 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 130/281] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:15.834559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.834846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.835124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.856730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df120-a28f-48c4-8aac-0970ac84d315 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:15.860415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:15.861644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:15.880451 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.909163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:15.909859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:15.910147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:15.910422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:15.911286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, user.id=50b943ad5acb4d73b16f8cce1ec488db, scope.system=all) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:15.911592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:15.913642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:15.913860 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:15.920840 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 152/282] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/role_assignments?user.id=50b943ad5acb4d73b16f8cce1ec488db&scope.system=all&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:15.921773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:15.953029 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 131/283] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:15.980965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.063262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038e04-ebf0-43ce-96f5-bdab2025337a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.102808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046769-a10d-42aa-8499-07e8f11b6894 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.105266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.106106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.106389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.106663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.123053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:16.128851 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:16.129911 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:16.130685 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 153/284] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:16.139065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.154996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.155837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.156117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.156387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.173988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:16.181184 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:16.182800 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:16.183551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:16.184860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 132/285] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:16.190837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.206094 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.296734 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.438653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6428-998f-44ed-a80b-1cd5bc96b776 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.443924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb61c-e7cf-40f7-9592-a535afa8eb4e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.517306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.518879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.519160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.519432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.520197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:16.520494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.521924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.539728 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 133/286] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:16.545838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.551831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.552509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.552788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.553086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.553846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:16.554172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.555553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.567960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 154/287] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:16.573644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.722188 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.731098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a8410-1134-4967-a613-b09f17fb11d6 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.765828 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:16.769329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e966f-10b9-4683-9bd5-3abf76fd888c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:16.798350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.799234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.799515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.799781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] PATH_INFO: `/v3/users/b64865f02f1d4a62853ca732da40b925` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.801187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] RBAC: Authorizing `identity:get_user(user_id=b64865f02f1d4a62853ca732da40b925)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.802674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.809268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 134/288] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/users/b64865f02f1d4a62853ca732da40b925 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:16.811755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:16.825840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:16.826725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:16.827002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:16.827274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] PATH_INFO: `/v3/users/87b1f154138e48d09e71d87de5e20b63` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:16.828515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] RBAC: Authorizing `identity:get_user(user_id=87b1f154138e48d09e71d87de5e20b63)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:16.830012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:16.832021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 155/289] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/users/87b1f154138e48d09e71d87de5e20b63 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:16.837125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.017271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d0fc-cac2-48db-bdff-44451d30bc34 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.039005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9434f-df0a-404f-be40-9e4b320c98a1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.060602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.061356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.061755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.062098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.101935 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.115539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.116422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.116699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.116969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.122585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.124074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.126212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 156/290] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:17.133021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.165034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.168201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.183066 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.284828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963f5b0-3111-4542-80ca-eba91fa2837e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.320715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 135/291] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:17.323392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.324512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.325130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.325621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/87b1f154138e48d09e71d87de5e20b63/roles/9fa19dcc76cb463fa4edc18e0c7c9842` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.326646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.328138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, user_id=87b1f154138e48d09e71d87de5e20b63, role_id=9fa19dcc76cb463fa4edc18e0c7c9842)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.329840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.346968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 157/292] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:17 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/users/87b1f154138e48d09e71d87de5e20b63/roles/9fa19dcc76cb463fa4edc18e0c7c9842 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:17.453337 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.512716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6067b4-ab55-434c-958a-97283f85e8ac None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.553458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.554304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.554589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.554855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.556605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.558190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130a304-bb37-4696-9a99-63cb392ae5f9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.560192 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 136/293] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:17.566067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:17.707505 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:17.716863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149ffff-5eee-4cb6-8e02-81530cd130e9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:17.755887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:17.756545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:17.756828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:17.757104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:17.757997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=b64865f02f1d4a62853ca732da40b925) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:17.758308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:17.759809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce486-3205-4674-bdf0-73d97f4f045a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:17.766338 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 158/294] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:17 2022] GET /identity/v3/role_assignments?user.id=b64865f02f1d4a62853ca732da40b925&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:18.279417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23050-929d-4e27-b2b8-2746ed56457e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.279781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23050-929d-4e27-b2b8-2746ed56457e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.279980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23050-929d-4e27-b2b8-2746ed56457e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.281651 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 137/295] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:18.287385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f430-38cd-4348-a83e-90241ef06ae5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.287671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f430-38cd-4348-a83e-90241ef06ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.287959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453f430-38cd-4348-a83e-90241ef06ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.311880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c453f430-38cd-4348-a83e-90241ef06ae5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:18.313098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c453f430-38cd-4348-a83e-90241ef06ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:18.397726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 159/296] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:18.420551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23050-929d-4e27-b2b8-2746ed56457e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.471013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143d8e-271d-4244-b4cd-4bf0b6cccbcf None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.471318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143d8e-271d-4244-b4cd-4bf0b6cccbcf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.471581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143d8e-271d-4244-b4cd-4bf0b6cccbcf None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.473233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 160/297] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:18.478942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ff-608d-4fb4-9660-7e5ab2160ff6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.479221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ff-608d-4fb4-9660-7e5ab2160ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.479495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b66ff-608d-4fb4-9660-7e5ab2160ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.500500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-550b66ff-608d-4fb4-9660-7e5ab2160ff6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:18.501819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-550b66ff-608d-4fb4-9660-7e5ab2160ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:18.536995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23050-929d-4e27-b2b8-2746ed56457e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.570560 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.578789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.579596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.579880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.580157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.585416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 161/298] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:18.591027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957d4b-424f-4fcf-93d2-9f4463386487 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.591301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957d4b-424f-4fcf-93d2-9f4463386487 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.591571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957d4b-424f-4fcf-93d2-9f4463386487 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.593179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 162/299] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:18.598668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:18.600831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.601115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.601388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:18.610180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:18.611080 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:18.611862 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 138/300] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:18.612980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.622556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:18.623752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:18.639437 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.695402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 163/301] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:18.698601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.737762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f037b7-22b1-40f2-be3d-d7da44599a0e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.772780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.773576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.773932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.774204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.775675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.777131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.783290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 139/302] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:18.783290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.812274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe5124-5cf6-4ca7-a3ea-696167bf582f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.849070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.849860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.850142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.850416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.851206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:18.851509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:18.851602 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.855193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:18.862839 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 164/303] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:18.863658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.886143 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:18.910466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4583b-d586-499c-b8df-6cf9959412ff None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:18.948538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:18.949648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:18.950138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:18.950582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:18.965558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:18.973709 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:18.974589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:18.975343 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 140/304] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:18.975969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:18.985237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3183c-1f7d-4701-99d3-65dcdcb87987 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.021786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.022970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.023546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.023820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.025084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.026586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.053703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 165/305] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Jul 24 00:52:18 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:19.053703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.124244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db8b2-14aa-45ab-a118-2cbee0f62676 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.151348 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.161138 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.169253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.170559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.171098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.171570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] PATH_INFO: `/v3/users/b5f88678b1da44139d20289441fddceb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.187878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] RBAC: Authorizing `identity:get_user(user_id=b5f88678b1da44139d20289441fddceb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.189903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.192392 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 141/306] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:18 2022] GET /identity/v3/users/b5f88678b1da44139d20289441fddceb => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:19.198223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.207186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cb5b-7d64-46cf-93bc-641add351dc6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.254428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.255239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.255519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.255789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.256550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:19.256851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.258292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.268041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 166/307] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:19.273640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.327213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3905de-87e2-443f-8622-af117e0ace26 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.370477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.371141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.371417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.371690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.372534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, user.id=b5f88678b1da44139d20289441fddceb, scope.system=all) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:19.372840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.374812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.381610 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 142/308] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/role_assignments?user.id=b5f88678b1da44139d20289441fddceb&scope.system=all&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:19.409070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393961e3-d69f-49e6-a10b-ca6ce488c952 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.450731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.451665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.451945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.452218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] PATH_INFO: `/v3/users/50b943ad5acb4d73b16f8cce1ec488db` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.453583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] RBAC: Authorizing `identity:get_user(user_id=50b943ad5acb4d73b16f8cce1ec488db)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.455183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa1e01-1157-441c-a4e9-292d8afadb9a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.457428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 167/309] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/users/50b943ad5acb4d73b16f8cce1ec488db => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:19.463697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.520927 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:19.589158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c55d-dc44-431b-871a-046c6b7238c1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:19.627394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:19.628682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.629188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.629664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] PATH_INFO: `/v3/system/users/50b943ad5acb4d73b16f8cce1ec488db/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.631435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=50b943ad5acb4d73b16f8cce1ec488db, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:19.633112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70cba-7db1-4d07-b52f-a63cd3f411e2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:19.644742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 143/310] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Jul 24 00:52:19 2022] PUT /identity/v3/system/users/50b943ad5acb4d73b16f8cce1ec488db/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:19.834121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89aadd-43ee-4982-991a-49b3e19a33fe None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.834627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89aadd-43ee-4982-991a-49b3e19a33fe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.834702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89aadd-43ee-4982-991a-49b3e19a33fe None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.836040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 168/311] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:19.842160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:19.843007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:19.843476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:19.862545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:19.864056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:19.939352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 144/312] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:19.965482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89aadd-43ee-4982-991a-49b3e19a33fe None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:19.968730 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.080695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89aadd-43ee-4982-991a-49b3e19a33fe None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.127664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.127664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.127664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.127664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.139569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:20.147930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:20.149047 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:20.150148 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:20.152486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 169/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:20.157919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.197850 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.275093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf462-2db8-4834-9300-66910448ae3e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.315582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.316564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.316982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.317393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.318321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:20.318767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.320308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.329318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 145/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:20.335039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.407036 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.448531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92e83-bc9f-491b-9bcb-e7e639e0a495 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.484460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.486171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.486171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.486171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] PATH_INFO: `/v3/users/87b1f154138e48d09e71d87de5e20b63` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.487225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=87b1f154138e48d09e71d87de5e20b63)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.488694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.490732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 170/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/users/87b1f154138e48d09e71d87de5e20b63 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:20.496484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.607459 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.615316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd137dac-ee49-4820-b351-65fe48ca3833 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.652780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.653433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.653734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.654009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.727768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.729158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.835372 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.841216 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 146/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:20.846807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:20.954893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eec-6943-4d49-9f6f-4e88cf27ecc9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:20.985949 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:20.992356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:20.994066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:20.994530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:20.994959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:20.996379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:20.998034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d55513-217c-4cc8-999e-07b393e73b9a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:20.999975 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 171/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:20 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.005917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.111767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a0d4b-6b44-49ed-9505-8b975827b0ac None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.158823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.159488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.159764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.160036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.160884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, scope.project.id=d22480e62d6643db8d91dd9ed370d422, user.id=87b1f154138e48d09e71d87de5e20b63) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:21.161191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.162677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8fa8e-5d8c-49ee-9d43-0d4ebf54d8af None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.170236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 147/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/role_assignments?user.id=87b1f154138e48d09e71d87de5e20b63&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.345068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d69ef-68f9-42d8-9b7d-26b5006df15e None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.345428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d69ef-68f9-42d8-9b7d-26b5006df15e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.345622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d69ef-68f9-42d8-9b7d-26b5006df15e None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.347168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 172/319] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:21.353532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d6365-1b0e-418a-af54-3151fa9b6e54 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.354114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d6365-1b0e-418a-af54-3151fa9b6e54 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.354593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d6365-1b0e-418a-af54-3151fa9b6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.372324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ff9d6365-1b0e-418a-af54-3151fa9b6e54 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:21.373944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff9d6365-1b0e-418a-af54-3151fa9b6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:21.448557 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.459394 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 148/320] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:21.483540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d69ef-68f9-42d8-9b7d-26b5006df15e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.567570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854205-1ab1-45c5-8578-7502b16189fe None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.567912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854205-1ab1-45c5-8578-7502b16189fe None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.568189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854205-1ab1-45c5-8578-7502b16189fe None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.569666 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 149/321] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:21.575092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.575386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.575664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.593046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:21.594272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:21.596352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d69ef-68f9-42d8-9b7d-26b5006df15e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.632621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.633430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.634285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.634572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.635782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.637240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.639080 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 173/322] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:21.644457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.666628 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 150/323] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:21.688946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.724477 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.760361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae128c-8745-4d95-95d7-50fba96890c7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.791658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84b985-912b-4a79-9725-e2992c8aabf2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:21.794488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.795162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.795439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.795709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.796402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:21.797866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199c4cb-6f17-46a0-97ab-bbf309a0638b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:21.812028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 174/324] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Jul 24 00:52:21 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:52:21.813539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690325-0f18-4c8b-9f29-dc351ab17443 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.813874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690325-0f18-4c8b-9f29-dc351ab17443 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.814171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690325-0f18-4c8b-9f29-dc351ab17443 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.815471 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 175/325] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:21.821938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.822263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.822532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.829814 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:21.841521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:21.843080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:21.847409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:21.848185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:21.848473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:21.848744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:21.873445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:21.885720 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:21.886686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:21.887502 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 151/326] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:21.893650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:21.925124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 176/327] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:21.951837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.029419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e4b74-a97c-45ae-bc71-9c5427e1917d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.033861 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.070272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.070957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.071262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.071823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.073092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:22.073402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.074843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.085166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 152/328] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:22.091487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.098073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864a1eb-6ad2-4e82-aea4-499dea4a06b0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.148031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.149089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.151440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.151882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.158072 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.171711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:22.180499 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:22.181431 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:22.182384 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:22.183561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 177/329] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:22.188923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.237103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de94868-0256-485e-b742-86354227c3f1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.284382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.287401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.287401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.287401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] PATH_INFO: `/v3/users/b5f88678b1da44139d20289441fddceb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.288297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] RBAC: Authorizing `identity:get_user(user_id=b5f88678b1da44139d20289441fddceb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.289946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.291904 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 153/330] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/users/b5f88678b1da44139d20289441fddceb => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:22.297413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.322689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12df1d2-0cfb-4688-90ef-024553fa51f9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.343011 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.364307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.364895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.365175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.365447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.366340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:22.366530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.369390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.380026 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 178/331] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:22.386169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.444754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f1ae-51ef-4e54-90ac-f732f0ccddfc None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.462728 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:22.487229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.488117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.488395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.488668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] PATH_INFO: `/v3/system/users/b5f88678b1da44139d20289441fddceb/roles/9fa19dcc76cb463fa4edc18e0c7c9842` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.491384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5f88678b1da44139d20289441fddceb, role_id=9fa19dcc76cb463fa4edc18e0c7c9842)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.493178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.503653 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 154/332] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Jul 24 00:52:22 2022] PUT /identity/v3/system/users/b5f88678b1da44139d20289441fddceb/roles/9fa19dcc76cb463fa4edc18e0c7c9842 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:52:22.515781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39e6be-230d-4d4c-9f3a-5e2bc970949a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.565132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.566486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.566993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.567504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] PATH_INFO: `/v3/users/50b943ad5acb4d73b16f8cce1ec488db` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.569053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] RBAC: Authorizing `identity:get_user(user_id=50b943ad5acb4d73b16f8cce1ec488db)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.570859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c301ed-6587-46a6-bde6-a2de9f1ffeef None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.573922 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 179/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/users/50b943ad5acb4d73b16f8cce1ec488db => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:22.579566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:22.717732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432f4a1-78af-4db7-bd7e-96bf0b78a670 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:22.760109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:22.761226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:22.761738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:22.762221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:22.763283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] RBAC: Adding query filter params (role.id=46803c1bdede4cdebd5ce9ec067eb1a1, user.id=50b943ad5acb4d73b16f8cce1ec488db, scope.system=all) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:22.763799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:22.765644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4356ae-926e-476f-a026-fd49b6fdc4d8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:22.779931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 155/334] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:22 2022] GET /identity/v3/role_assignments?user.id=50b943ad5acb4d73b16f8cce1ec488db&scope.system=all&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:25.174471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d25b-53a7-4c0c-9233-362b1981f4b5 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.175557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d25b-53a7-4c0c-9233-362b1981f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.176101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d25b-53a7-4c0c-9233-362b1981f4b5 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.177750 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 180/335] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.184469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bdb18-ab64-4cca-ae50-112162ce60c1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.185394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bdb18-ab64-4cca-ae50-112162ce60c1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.185936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bdb18-ab64-4cca-ae50-112162ce60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.209056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cb8bdb18-ab64-4cca-ae50-112162ce60c1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.210675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb8bdb18-ab64-4cca-ae50-112162ce60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.242135 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.294382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 156/336] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:25.334657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d25b-53a7-4c0c-9233-362b1981f4b5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.396034 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.463205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d25b-53a7-4c0c-9233-362b1981f4b5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.463388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ecb1-583d-4913-819c-13fd3573d828 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.463682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ecb1-583d-4913-819c-13fd3573d828 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.463969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ecb1-583d-4913-819c-13fd3573d828 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.465860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 157/337] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.471845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc675-b5ec-4fc1-b306-ed5626f1644c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.472658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc675-b5ec-4fc1-b306-ed5626f1644c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.472949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc675-b5ec-4fc1-b306-ed5626f1644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.505367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-22bdc675-b5ec-4fc1-b306-ed5626f1644c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.506616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22bdc675-b5ec-4fc1-b306-ed5626f1644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.538162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.538973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.539253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.539527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.569219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-085ad1ab-d851-480d-bad0-279a4d6045e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:25.577512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:25.578442 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.579186 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:25.596500 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 181/338] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:25.598059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082830-5bd8-4c61-bfbd-f26c3184dc22 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.598348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082830-5bd8-4c61-bfbd-f26c3184dc22 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.598628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d082830-5bd8-4c61-bfbd-f26c3184dc22 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.600220 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 182/339] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.600749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082830-5bd8-4c61-bfbd-f26c3184dc22 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.648389 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 158/340] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:25.648389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc02a6-6d37-4c67-af6d-7473b9aa6d00 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.648389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc02a6-6d37-4c67-af6d-7473b9aa6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.648389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc02a6-6d37-4c67-af6d-7473b9aa6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.674420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4edc02a6-6d37-4c67-af6d-7473b9aa6d00 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.675861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4edc02a6-6d37-4c67-af6d-7473b9aa6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.769057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d082830-5bd8-4c61-bfbd-f26c3184dc22 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.770061 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 159/341] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:25.772881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c11-cca2-461c-abde-23266c81e412 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.773170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c11-cca2-461c-abde-23266c81e412 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.773449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c11-cca2-461c-abde-23266c81e412 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.775849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 160/342] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.776429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d585c11-cca2-461c-abde-23266c81e412 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.777129 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.816122 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:25.821144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.822737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.822878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.823115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.823815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:25.824121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:25.825516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57d9c1-f20f-4480-ae5b-cb767f2593c2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:25.839596 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 183/343] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:25.840767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56f92-50a0-4b66-8d5e-505dad47cc57 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.841167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56f92-50a0-4b66-8d5e-505dad47cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.841336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56f92-50a0-4b66-8d5e-505dad47cc57 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.844210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 184/344] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:25.845402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.845597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.846105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.863428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:25.864612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:25.914425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d585c11-cca2-461c-abde-23266c81e412 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:25.945807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 185/345] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:25.947567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:25.961066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:25.962066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:25.962246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:25.962564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:25.974525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:25.983853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:25.984759 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:25.985521 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:25.992103 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 161/346] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:25.992103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.083143 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.091516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8372-8dda-4095-b702-823d839a0ba2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.107868 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.126393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a160c-b77f-4183-ba8c-1410002a6b2d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.136812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.137970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.138349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.138712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.150101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6b0107ed-4a87-43b6-abe9-07adb4593928 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:26.159439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:26.160383 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:26.161168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 186/347] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:26.162525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.163094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.163445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.177974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.179073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.179577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.180053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.184291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:26.186341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:26.271172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.271695 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 187/348] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:26.272460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.273753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.386759 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.394334 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.410897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7c759-7f35-4faf-aab4-1f427603575e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.415365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 162/349] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:26.416763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.462915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.464804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.465235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.465664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.480601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:26.489107 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:26.490076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.490807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:26.494247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 188/350] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:26.495384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.558481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd42a00-4f20-4629-a722-d732b7845221 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.600023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.601419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.601790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.602067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.603591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:26.603915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.605500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.618475 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 163/351] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.619382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.630367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240e13-6b29-4a16-996a-27cd3e154b54 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.672262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.672937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.673566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.673833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.674597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:26.675682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.676350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.677423 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.690656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 189/352] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.691507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.712072 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.748315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172ac62-d28f-4793-8df3-f1dc146401f3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.793780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.794541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.794825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.795101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.807329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:26.815532 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:26.816415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:26.817187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 164/353] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:26.818439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.822501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f9bc-96ff-4b1c-aeb4-4a6044d5cb92 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.865779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.866658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.866941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.867221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.868803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:26.870340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:26.872296 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 190/354] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:26.874154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:26.948048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab0ad-1c62-49b8-9860-2bda2923de0c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.959736 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.967069 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:26.991275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f995-bc63-47ab-9cc8-8e3524fc39df None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:26.997449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:26.998167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:26.998499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:26.998725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:26.999496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:26.999807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.001264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.011430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 165/355] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.012190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.033642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.034318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.034605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.034885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.116523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.123313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.140846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5bac-6608-493d-9788-26bc8cb5f2b4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.179558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.181112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.181390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.181699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] PATH_INFO: `/v3/users/b5f88678b1da44139d20289441fddceb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.183180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] RBAC: Authorizing `identity:get_user(user_id=b5f88678b1da44139d20289441fddceb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.184782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f226c5-68ad-4004-904e-9931a8c4e74d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.189021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 166/356] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/users/b5f88678b1da44139d20289441fddceb => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.189021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005bf5-8ebb-4003-880a-090f5ec44e0c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.189021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005bf5-8ebb-4003-880a-090f5ec44e0c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.189021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6005bf5-8ebb-4003-880a-090f5ec44e0c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.189820 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 167/357] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:27.190532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6005bf5-8ebb-4003-880a-090f5ec44e0c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.228172 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.242388 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.260940 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 191/358] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:27.261902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.332539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6005bf5-8ebb-4003-880a-090f5ec44e0c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.379833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.380518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.380796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.381069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.381880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:27.382184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.384133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.388850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b503e-20fe-400d-8f00-e63f6f9e0fd8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.398470 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 168/359] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.399619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.429615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.431119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.431399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.431670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.443282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.446698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.449826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 192/360] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.451162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.518308 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.530283 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.535835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ae8fa-c939-403d-bfef-ef6c81afdf4f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.574619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.575271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.575545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.575812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.587838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a61ab-2bd8-4e67-9388-4e10646ef673 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.621939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.622591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.622874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.623149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.623978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] RBAC: Adding query filter params (role.id=9fa19dcc76cb463fa4edc18e0c7c9842, user.id=b5f88678b1da44139d20289441fddceb, scope.system=all) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:27.624284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.625741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ddd53-8f75-4d80-9f0a-00c5ac984160 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.637569 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 193/361] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/role_assignments?user.id=b5f88678b1da44139d20289441fddceb&scope.system=all&role.id=9fa19dcc76cb463fa4edc18e0c7c9842 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.638869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.639154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.639429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.651577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.653131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.658863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:27.660157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:27.744721 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 194/362] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:27.745590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.778949 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.786865 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:27.788797 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 169/363] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:27.790452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.881941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e7eca-5576-40a9-9df5-f47ceaaea353 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.917185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff012-8cf1-4e17-b722-772152229d51 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:27.926966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.928384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.928384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.928384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:27.933595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:27.933595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:27.934427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 195/364] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:27.935198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:27.959508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:27.960172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:27.960460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:27.960730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.042880 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.046841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.048469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.048633 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.052630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63e3bc-4beb-42e3-906a-9c1cfd88002b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.087365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.088045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.088323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.088707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.089546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=d22480e62d6643db8d91dd9ed370d422) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.089890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.091337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.097000 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 196/365] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.098560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.165339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 170/366] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:28.166381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.223867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798929-8810-4363-915b-1947d3c228c9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.264831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.265630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.265935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.266200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.277617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:28.283065 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:28.285686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:28.286555 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:28.287386 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 197/367] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:28.288105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7fc1-1256-463d-8ca1-54fcc7733eec None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.288183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.313351 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.328273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.329138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.329416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.329712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.330912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.332369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.338947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 171/368] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.338947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.402364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12023aaa-83bd-49e0-aff8-cc4fd4f7b401 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.438465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.439348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.439629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.439901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.441075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.442561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.449931 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 198/369] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.450118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736de0f-1489-44c7-8113-cf9f4670e8a3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.450216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.487196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.488171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.488446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.488714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.489929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.491383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.498009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 172/370] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.498009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.534699 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.550031 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.563938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e21fd0-9821-4915-aab5-2ef999c5d2ed None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.603149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.603926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.604210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.604731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.605376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.605656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.607209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.613026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b21c9-0c70-4d05-bf3c-fad520ed35e0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.616389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 199/371] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.617025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.653529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.654565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.654864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.655119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.656329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.657845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.664459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 173/372] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.664459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.729619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2ce9-97d2-4a4b-a056-53967e0dd587 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.766153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63227-2cb1-4319-8dd7-8ffdc3717796 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.766575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a70a-704f-423e-8610-83b623402eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.767207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a70a-704f-423e-8610-83b623402eed None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.767684 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.768217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a70a-704f-423e-8610-83b623402eed None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.768501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a70a-704f-423e-8610-83b623402eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.769344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a70a-704f-423e-8610-83b623402eed None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:28.769722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a70a-704f-423e-8610-83b623402eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.771549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a70a-704f-423e-8610-83b623402eed None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.785707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 200/373] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.785707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a70a-704f-423e-8610-83b623402eed None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.807252 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:28.820486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.821659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.821971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.822244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.823815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:28.826119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:28.828385 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 174/374] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:28.830097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:28.922037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a70a-704f-423e-8610-83b623402eed None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:28.963913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:28.965381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:28.965661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:28.965964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:28.972477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630dadb-5f6e-4ec7-baec-ea69fef11eb2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.014704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.015368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.015652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.016367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.017222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:29.017535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.019412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.029764 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 175/375] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.030875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.078084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.079508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.108439 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.133126 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.188775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89a8f-f299-4acd-ba47-6cd6d66ec5f6 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.232911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.233610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.233932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.234215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.235230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=d22480e62d6643db8d91dd9ed370d422) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:29.235556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.237035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.245616 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 176/376] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.313073 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 201/377] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:29.318892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.466445 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.471661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853070e-cf96-4fed-871c-3b2205a2d551 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.521488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.522386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.522672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.522944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] PATH_INFO: `/v3/projects/a456f944370a42eaa59b5a1926c8339d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.524258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] RBAC: Authorizing `identity:get_project(project_id=a456f944370a42eaa59b5a1926c8339d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.525626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.527666 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 177/378] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/projects/a456f944370a42eaa59b5a1926c8339d => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.533063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.667510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc971-56a8-4b97-9c55-c4e7a536fd66 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.695208 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:29.720783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.721571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.721877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.722154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] PATH_INFO: `/v3/groups/1dafdd55e0594442bd93530eaa9e14b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.730305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] RBAC: Authorizing `identity:get_group(group_id=1dafdd55e0594442bd93530eaa9e14b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.731776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2519d-c4c4-4546-94b7-663a37198acf None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.733806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 202/379] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/groups/1dafdd55e0594442bd93530eaa9e14b2 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:29.739507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:29.862127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdb9b7-a572-485e-a4d7-bb1a4715495c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:29.896648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:29.897317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:29.897597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:29.897904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:29.898752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] RBAC: Adding query filter params (group.id=1dafdd55e0594442bd93530eaa9e14b2, role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=a456f944370a42eaa59b5a1926c8339d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:29.899712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:29.901303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86431100-e162-40ba-9cac-0134b2bc5b21 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:29.907152 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 178/380] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:29 2022] GET /identity/v3/role_assignments?group.id=1dafdd55e0594442bd93530eaa9e14b2&scope.project.id=a456f944370a42eaa59b5a1926c8339d&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:30.556306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc13-e08d-4153-b9d9-74593d4daf7b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.557037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc13-e08d-4153-b9d9-74593d4daf7b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.557037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc13-e08d-4153-b9d9-74593d4daf7b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.558675 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 203/381] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:30.563673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.564190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.564361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.590719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:30.591942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:30.622703 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:30.687539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 179/382] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:30.724799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7fc13-e08d-4153-b9d9-74593d4daf7b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:30.865026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7fc13-e08d-4153-b9d9-74593d4daf7b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:30.914361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:30.915446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:30.915734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:30.916013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:30.938858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:30.947723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:30.949922 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:30.951968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 204/383] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:30.957694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.101652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefcf8-9459-4e81-a8be-be7668cf8f55 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.155828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.156515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.156795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.157072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.157871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:31.158180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.159569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a242e99-1149-4e7a-b38a-cd6021c9075f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.173661 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 180/384] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:31.179166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.238291 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.270289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eabce-f790-40f5-9767-8f7202321af4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.270601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eabce-f790-40f5-9767-8f7202321af4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.270848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eabce-f790-40f5-9767-8f7202321af4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.272502 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 181/385] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:31.281502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.281502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.281502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.311099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:31.312680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:31.324365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337515ef-2c55-4105-9ecd-5b04c79ff371 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.354061 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.371013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.371816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.372092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.372366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.373841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.377468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.379324 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 205/386] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:31.387494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.479868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 182/387] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:31.505773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.637722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c45af-32a9-4ae6-8815-c9b1c0e83bc6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.661634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.705282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.706176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.706459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.706734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.707973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.709539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab59d1-d9d6-4011-a19a-0deb2c9f2a29 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.711670 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 206/388] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:31.717093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad451-3c31-4cb6-a6d7-a69fac47ec56 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.717853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c15f3-1cf5-4713-a3d9-37b03b1295d7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.718094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c15f3-1cf5-4713-a3d9-37b03b1295d7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.718381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c15f3-1cf5-4713-a3d9-37b03b1295d7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.720033 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 207/389] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:31.720744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c15f3-1cf5-4713-a3d9-37b03b1295d7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.770791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.771923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.772216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.772503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.791833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9d4859b6-52d3-4547-9be0-eee18d03f3f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:31.803550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:31.804464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 183/390] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:31.805902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.807155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.807155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.840427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:31.841732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:31.851987 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:31.866775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c15f3-1cf5-4713-a3d9-37b03b1295d7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:31.913131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:31.914526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.915619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.916680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/groups/33afca6198c449a0a63e603a4117b0c5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.919520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, group_id=33afca6198c449a0a63e603a4117b0c5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:31.921855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe01b-a25b-431e-9938-5639a1ece08b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:31.937725 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 184/391] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:31.937725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:31.950794 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 208/392] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:31 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/groups/33afca6198c449a0a63e603a4117b0c5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:31.952498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6323f-09d4-4a4f-9829-38574cc7da50 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:31.952951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6323f-09d4-4a4f-9829-38574cc7da50 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:31.953430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6323f-09d4-4a4f-9829-38574cc7da50 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:31.955135 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 209/393] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:31.962348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6323f-09d4-4a4f-9829-38574cc7da50 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.008968 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.106652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6323f-09d4-4a4f-9829-38574cc7da50 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.119499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585875-2a31-47f6-b92d-45d779c7f261 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.160863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.161723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.161996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.162273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.168431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.169342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.169857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.170391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.171468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] RBAC: Adding query filter params (name=member) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:32.171950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.173510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d102b37-04f1-435f-a899-141f9dc00051 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.173816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:32.183479 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 185/394] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:32.184354 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:32.185274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:32.186086 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 210/395] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:32.188139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.188638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.189120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.191125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.197533 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.209731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:32.211456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:32.300890 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 186/396] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:32.302172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.323745 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.335093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96584d09-84a9-48da-abc5-1ec6f275632a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.386217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.387246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.387528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.387845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.389151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.390815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef465b7-dbc4-46bd-8b27-d1f7b3354271 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.392631 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 211/397] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.398287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05d7bd-1379-47e4-87a3-4197181b3b09 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.398574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05d7bd-1379-47e4-87a3-4197181b3b09 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.399438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05d7bd-1379-47e4-87a3-4197181b3b09 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.404873 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 212/398] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:32.404873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05d7bd-1379-47e4-87a3-4197181b3b09 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.416969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c1cb-d1db-4591-84c0-e8c3a898c25f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.453650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacea2-605c-4669-9250-a84396532705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.454294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacea2-605c-4669-9250-a84396532705 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.454579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacea2-605c-4669-9250-a84396532705 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.455013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacea2-605c-4669-9250-a84396532705 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.455784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adacea2-605c-4669-9250-a84396532705 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:32.456089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adacea2-605c-4669-9250-a84396532705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.457469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adacea2-605c-4669-9250-a84396532705 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.458942 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.468174 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 187/399] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.468823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacea2-605c-4669-9250-a84396532705 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.521877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05d7bd-1379-47e4-87a3-4197181b3b09 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.557022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.557860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.558144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.558420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.569900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-eb236b3f-850e-4adc-b92d-323df3a21a26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:32.581629 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:32.582512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:32.583287 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:32.584466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacea2-605c-4669-9250-a84396532705 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.584757 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 213/400] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:32.586681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.587176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.587526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.604900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:32.606120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:32.622811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.623907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.624365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.624839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.625855 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.626288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.627885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.629899 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 188/401] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.630410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.686276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 214/402] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:32.696918 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.697304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.740318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f875-05cc-473c-952e-800f26917716 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.776897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.777846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.778168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.778452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.779677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.781142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.782807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 189/403] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.783547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.824439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b9ed-0306-41d8-8ec6-b25d1d8d1e16 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.860918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.861909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.862367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.862841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.863883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:32.864374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.866039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.875230 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 215/404] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:32.876334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:32.895126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4368de-2000-4017-a10c-98d803f77866 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:32.895879 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.926033 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:32.932095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:32.932984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:32.933272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:32.933551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/groups/33afca6198c449a0a63e603a4117b0c5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:32.935570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, group_id=33afca6198c449a0a63e603a4117b0c5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:32.937039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:32.950774 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 190/405] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:32 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/groups/33afca6198c449a0a63e603a4117b0c5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:32.951800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.005704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd400-b675-457b-822b-df1eb5438db3 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.055535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.056722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.057070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.057738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.077581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:33.089792 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:33.090737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:33.091509 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:33.093828 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 216/406] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:33.094942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.102897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e9bee-6d5b-472b-a9f7-ffe423c852d9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.159385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.160890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.161175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.161451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.162815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.164821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.167544 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 191/407] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:32 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.168118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.208282 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.241897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc6f03-257e-4194-a895-8fb329470a74 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.246239 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.278597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.279453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.279728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.279994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.281171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.282621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.284523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 217/408] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.285259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.307559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcd2e8-5e52-4f6f-8dcf-3cf4129da677 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.356597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.357513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.358525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.358813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.359863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:33.360174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.362715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.373548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 192/409] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.374651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.406305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e694-7c6c-4c38-8892-2696cd891b51 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.445096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.446583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.446858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.447130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422/groups/33afca6198c449a0a63e603a4117b0c5/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.449459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] RBAC: Authorizing `identity:create_grant(project_id=d22480e62d6643db8d91dd9ed370d422, group_id=33afca6198c449a0a63e603a4117b0c5, role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.450983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.468843 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 218/410] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:33 2022] PUT /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422/groups/33afca6198c449a0a63e603a4117b0c5/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:33.469807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.482530 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.517704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ce5f-c8fd-499c-8fda-08ea245065cd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.554270 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.559819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.563581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.563915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.564142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.565878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.568251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.573383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 193/411] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.579239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.693328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f9665-5e0f-4eaf-882d-e2160625e84b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.760699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cb56-08aa-41b7-84fc-60b1c9613b24 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.763991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.764861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.765133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.765404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] PATH_INFO: `/v3/groups/1dafdd55e0594442bd93530eaa9e14b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.768108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] RBAC: Authorizing `identity:get_group(group_id=1dafdd55e0594442bd93530eaa9e14b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.769580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.772398 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 219/412] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/groups/1dafdd55e0594442bd93530eaa9e14b2 => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:33.787203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:33.849534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.850368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.850648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:33.850921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/groups/33afca6198c449a0a63e603a4117b0c5/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:33.859178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] RBAC: Authorizing `identity:create_grant(project_id=6d449bab7db34dd59aaa8033eec34fc7, group_id=33afca6198c449a0a63e603a4117b0c5, role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:33.860669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:33.896451 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 194/413] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:33 2022] PUT /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7/groups/33afca6198c449a0a63e603a4117b0c5/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:33.914059 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:33.949164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bf97-4270-41a8-a1d5-16dc4a5adcfb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:33.998714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:33.999597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:33.999875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.000149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] PATH_INFO: `/v3/projects/a456f944370a42eaa59b5a1926c8339d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.001646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] RBAC: Authorizing `identity:get_project(project_id=a456f944370a42eaa59b5a1926c8339d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:34.003154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e76bfa-6186-4375-9517-a968f2124b24 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:34.005251 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 220/414] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:33 2022] GET /identity/v3/projects/a456f944370a42eaa59b5a1926c8339d => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:34.014944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.076595 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:34.144105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6b60e-c34f-4069-810c-a620bc79ca1a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:34.158854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462add-9998-474d-b730-a92a683786e4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.159139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462add-9998-474d-b730-a92a683786e4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.159409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462add-9998-474d-b730-a92a683786e4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.161035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 221/415] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:34.167861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.168144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.168337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.188017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:34.188903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.189187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.189464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] PATH_INFO: `/v3/projects/a456f944370a42eaa59b5a1926c8339d/groups/1dafdd55e0594442bd93530eaa9e14b2/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.191951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a456f944370a42eaa59b5a1926c8339d, group_id=1dafdd55e0594442bd93530eaa9e14b2, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:34.193392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:34.198763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:34.200056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:34.221579 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 195/416] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Jul 24 00:52:34 2022] PUT /identity/v3/projects/a456f944370a42eaa59b5a1926c8339d/groups/1dafdd55e0594442bd93530eaa9e14b2/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:34.289124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 222/417] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:34.327969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.458261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95cb1-928e-4ace-90cf-c1696a5bc1b4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:34.470035 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:34.498694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:34.499500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.499786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.500061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.511799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:34.519640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:34.520511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:34.521287 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 196/418] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:34.527360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.622087 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:34.655360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298e855-6200-4867-ba68-e3dec9f0d8f3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:34.697375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:34.698164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.698355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.698635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.699390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:34.699701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:34.701076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:34.709901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 223/419] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:34.715692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:34.823646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d826e3-6c53-4716-b46c-e93a0411ad29 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:34.859712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:34.860369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:34.860651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:34.860929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:34.903498 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:34.934249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:34.935731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.038569 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 197/420] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:35.044239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.186409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce38f9e-b3d5-46c2-880f-091a7cd48399 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.225707 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.231388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.232881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.233263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.233543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.234780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.236330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.240657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 224/421] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.246956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.342878 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.366629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d557d8-8ce5-4f5a-b4a8-c34188658b6e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.405018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.405968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.406254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.406533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.407720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.409179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5241d-b786-47eb-8612-9e41db99f7fa None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.411149 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 198/422] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.416909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.537781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcc914-f14a-450b-93a3-ed3dcd65259c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.584655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:35.585316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.585602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.585906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.586780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=d22480e62d6643db8d91dd9ed370d422) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:35.587095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:35.588545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea603-60d6-44c1-ad4a-704d5d35d784 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:35.598246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 225/423] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:35.717875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a82c1-27ba-4beb-9500-21b7e5b8eac0 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.718224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a82c1-27ba-4beb-9500-21b7e5b8eac0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.718431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a82c1-27ba-4beb-9500-21b7e5b8eac0 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.720183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 199/424] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:35.725466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d0a3-80a8-4f95-8e9c-83055f810030 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.725956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d0a3-80a8-4f95-8e9c-83055f810030 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.726141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7d0a3-80a8-4f95-8e9c-83055f810030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.745191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-21d7d0a3-80a8-4f95-8e9c-83055f810030 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:35.746447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21d7d0a3-80a8-4f95-8e9c-83055f810030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:35.830683 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:35.840079 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 226/425] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:35.866736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a82c1-27ba-4beb-9500-21b7e5b8eac0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:35.960624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd1e3-83f3-4d30-b697-0fa25b9ae111 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.960996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd1e3-83f3-4d30-b697-0fa25b9ae111 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.961965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd1e3-83f3-4d30-b697-0fa25b9ae111 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.963610 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 227/426] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:52:35.969269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:35.969550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:35.969845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:35.986291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a82c1-27ba-4beb-9500-21b7e5b8eac0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:35.990935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:35.992172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:36.043096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.043921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.044200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.044476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.053576 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.061260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:36.074727 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:36.075856 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.076612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:36.079283 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 200/427] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:36.082588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.103996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 228/428] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:36.127278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.228579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f7363-085d-4842-96b0-663e25c8eb69 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.229110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4b21-9456-45de-aa4a-8ff77cd713dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.255675 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.273858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.275145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.275689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.276171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.276716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.277560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.277867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.278145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.278968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:36.279474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.285351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.290273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:36.298303 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:36.299175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:52:36.299934 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:36.300964 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 201/429] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.301850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.307435 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 229/430] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:36.309426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.372834 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.416320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb60e-3a6c-4cd9-be0d-26c3c177f67f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.419567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a035-ad9d-438c-a8c3-03279942ed4a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.454949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.455712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.455815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.455999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.456267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.456368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.456628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.456904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.457051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] RBAC: Adding query filter params (name=member) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:36.457323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.458852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67e081-ca92-4fdb-9a35-9b23f00d478d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.475191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 230/431] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:36.475191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dde4b-554c-4d2c-ad0f-fe8cb7bff61a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.475191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dde4b-554c-4d2c-ad0f-fe8cb7bff61a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.475191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dde4b-554c-4d2c-ad0f-fe8cb7bff61a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.475191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 231/432] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:36.476187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dde4b-554c-4d2c-ad0f-fe8cb7bff61a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.527950 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.536928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.538486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584796b-bb7e-4d9a-ba49-9ade1b929b04 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.587650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dde4b-554c-4d2c-ad0f-fe8cb7bff61a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.602948 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.623524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.624091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.624377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.624653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.647824 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 202/433] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:36.649899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.649899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.649899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.668770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:36.670005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:36.702817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.704286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.749813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 203/434] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:36.750729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.754325 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.819683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 232/435] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:36.821353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.860264 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:36.873261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcce92-8acc-4817-8924-0a857ec723ac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.911722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.912508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.912779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.913054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] PATH_INFO: `/v3/projects/d22480e62d6643db8d91dd9ed370d422` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.914850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] RBAC: Authorizing `identity:get_project(project_id=d22480e62d6643db8d91dd9ed370d422)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:36.916254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:36.922646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 204/436] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/projects/d22480e62d6643db8d91dd9ed370d422 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:36.923319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.923497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f4cb-49b6-4c54-89c2-1a78383ca3ba None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:36.963089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:36.963890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:36.964166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:36.964435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:36.974871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:36.983520 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:36.984428 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:36.985185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 233/437] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:36.985867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:36.996239 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.028324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35253-ef27-4595-8a24-04602b812c6a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.062667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.063647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.064012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.064329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.065616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.067086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25819-61e0-4323-9246-444e4bc4eeba None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.068764 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 205/438] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.069937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37ddf-2e54-4ddc-a511-6d6bd0b3b731 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.070215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37ddf-2e54-4ddc-a511-6d6bd0b3b731 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.070520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba37ddf-2e54-4ddc-a511-6d6bd0b3b731 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.071731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 206/439] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:37.073828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba37ddf-2e54-4ddc-a511-6d6bd0b3b731 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.087342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452dfee-5c30-431c-8ebe-1ab4f901a82f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.100097 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.126469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.127361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.127628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.127909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.129107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.130598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615e949-9fd4-42bb-9318-670fce43fb64 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.132387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 234/440] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:36 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.133487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.133766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.134046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.150895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:37.152066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:37.179075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba37ddf-2e54-4ddc-a511-6d6bd0b3b731 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.212905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.213572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.213884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.214163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.214917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.215226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.216614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.218639 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 235/441] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:37.219464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.223265 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.229882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 207/442] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.229882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.319502 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.321797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f93cd7-0d7f-4aca-869e-9a36f9829b28 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.331833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f63ba-0109-4b7f-8cc7-1ee57cacfa82 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.356418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.357274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.357554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.357860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.359044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.360481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.362142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 236/443] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.362891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.371163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.371932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.372218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.372489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.373315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=d22480e62d6643db8d91dd9ed370d422) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.373622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.375079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.380956 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 208/444] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=d22480e62d6643db8d91dd9ed370d422&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.381730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.455337 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.491723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68220d33-1943-4ca2-b5a0-4cd3c5922756 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.500721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028e856-6317-4578-9a7b-70408180d978 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.530149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.530799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.531077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.531346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.544228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.545483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.545483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.545825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.557983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:37.565633 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:37.566747 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 209/445] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:37.567887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.586708 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.615120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.616603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.672965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47153-7b43-4f4f-8e03-eb4a54f3cf9d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.684603 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.707021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.707601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.707879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.708148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.708973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=46803c1bdede4cdebd5ce9ec067eb1a1, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.709277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.710767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.716029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 237/446] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:37.725933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 210/447] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=46803c1bdede4cdebd5ce9ec067eb1a1 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.726166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.726259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.814266 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:37.840236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84cbf5-a3f3-4a20-a9ee-57c80761011f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.849855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167aa5-8cae-4d08-8bf4-46f00f942df1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:37.887875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.888551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.889035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.889157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.889917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:37.890225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.891639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.899569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:37.900450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:37.900735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:37.901070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] PATH_INFO: `/v3/projects/6d449bab7db34dd59aaa8033eec34fc7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:37.901625 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 238/448] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.902526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] RBAC: Authorizing `identity:get_project(project_id=6d449bab7db34dd59aaa8033eec34fc7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:37.903991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:37.905828 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 211/449] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/projects/6d449bab7db34dd59aaa8033eec34fc7 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:37.910320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.911220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:37.966544 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.051558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbf96-146c-45e9-b460-c866a320e124 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.052398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde696-166f-41fb-b62e-b4faaae8c9ea None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.095917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.096817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.097102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.097381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] PATH_INFO: `/v3/groups/33afca6198c449a0a63e603a4117b0c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.098616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] RBAC: Authorizing `identity:get_group(group_id=33afca6198c449a0a63e603a4117b0c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.101163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.101270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.102127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.105747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.105879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 212/450] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/groups/33afca6198c449a0a63e603a4117b0c5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:38.105977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.108454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.126840 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.174855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.176315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.209233 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.213111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa861-209e-454d-a50f-10a82be5ff02 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.246736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.247312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.247591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.247860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.248688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] RBAC: Adding query filter params (group.id=33afca6198c449a0a63e603a4117b0c5, role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=6d449bab7db34dd59aaa8033eec34fc7) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:38.249092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.251018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.259150 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 213/451] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/role_assignments?group.id=33afca6198c449a0a63e603a4117b0c5&scope.project.id=6d449bab7db34dd59aaa8033eec34fc7&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:38.278989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 239/452] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:38.284960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.369028 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:38.393406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fb34-228b-4b3f-886d-d5c9667c0fdd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.431661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.432633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.432984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.433277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] PATH_INFO: `/v3/projects/a456f944370a42eaa59b5a1926c8339d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.434521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a456f944370a42eaa59b5a1926c8339d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.435968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.437872 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 214/453] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/projects/a456f944370a42eaa59b5a1926c8339d => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:38.443213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.546776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282f8f2-d052-4fdd-a411-1dd9cd506b32 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.582825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.583690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.583965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.584240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] PATH_INFO: `/v3/groups/1dafdd55e0594442bd93530eaa9e14b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.585422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] RBAC: Authorizing `identity:get_group(group_id=1dafdd55e0594442bd93530eaa9e14b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.587915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346629-3afb-47eb-85ab-27a244be3fad None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.589558 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 240/454] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/groups/1dafdd55e0594442bd93530eaa9e14b2 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:38.595688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:38.702282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d989d10-0a51-4ee2-9fb3-15fb134cd2c6 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:38.737373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:38.738065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:38.738347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:38.738620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:38.739457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] RBAC: Adding query filter params (group.id=1dafdd55e0594442bd93530eaa9e14b2, role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=a456f944370a42eaa59b5a1926c8339d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:38.739765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:38.741205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad9cbf-acf5-4464-b28d-c2e453d88c42 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:38.749967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 215/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Jul 24 00:52:38 2022] GET /identity/v3/role_assignments?group.id=1dafdd55e0594442bd93530eaa9e14b2&scope.project.id=a456f944370a42eaa59b5a1926c8339d&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:41.382508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c60a-2ddf-4f38-b33e-abea80a97b40 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.382999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c60a-2ddf-4f38-b33e-abea80a97b40 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.383132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c60a-2ddf-4f38-b33e-abea80a97b40 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.385255 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 241/456] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.392020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.392956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.393381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.418705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:41.420190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:41.422529 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.509395 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 216/457] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:41.539323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47f35-ec18-46f3-b462-5b27a82b5a81 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.539633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47f35-ec18-46f3-b462-5b27a82b5a81 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.539874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47f35-ec18-46f3-b462-5b27a82b5a81 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.541250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 242/458] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.542289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.546665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.546952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.547229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.563463 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.582704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:41.584070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:41.683643 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 243/459] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:41.697626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2d72-2263-4d33-9208-6e6504ceb94d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.721287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.766048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.767227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.767706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.768176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.776925 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.781994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.783778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:41.806314 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:41.807238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:41.808037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:41.808037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:41.808037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.808037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:41.810824 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 217/460] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:41.816420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.887422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ab5eb-9251-4f06-bcbb-c934f59c5424 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.920112 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:41.925650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.926478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.926756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.927028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.931732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d718-5ccd-4e1d-9917-497a0d9ea7e0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:41.937824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.939221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1edc5b77-7619-4f79-b2b3-5f21bc650378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:41.958265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:41.959094 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:41.959910 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:41.959910 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:41.959910 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:41.959910 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:41.959910 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 244/461] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:41.961599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618a04-a6d2-4485-953d-3a8dc4ff4083 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.962106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618a04-a6d2-4485-953d-3a8dc4ff4083 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.962388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618a04-a6d2-4485-953d-3a8dc4ff4083 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.963810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 245/462] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.969148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1320-c8b2-4643-91f1-d15192fbacbc None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.969441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1320-c8b2-4643-91f1-d15192fbacbc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.969749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1320-c8b2-4643-91f1-d15192fbacbc None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.970974 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 246/463] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:41.971719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1320-c8b2-4643-91f1-d15192fbacbc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:41.979125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:41.980068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:41.980545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:41.981141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:41.982006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:41.982369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:41.983901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03760c1-6ece-44e1-b208-d87f4b878485 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:41.998400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 218/464] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:42.004211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4d9c-3127-47a5-9c82-df971d71ec53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.004499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4d9c-3127-47a5-9c82-df971d71ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.004772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4d9c-3127-47a5-9c82-df971d71ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.024497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0a1a4d9c-3127-47a5-9c82-df971d71ec53 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:42.025695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0a1a4d9c-3127-47a5-9c82-df971d71ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:42.073779 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.090749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1320-c8b2-4643-91f1-d15192fbacbc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.098333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 219/465] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:42.107855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.108663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.109133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.136044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:42.137246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:42.138652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.139381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.139729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.140072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.140863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:42.141328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.142898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.161756 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 247/466] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:42.162800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.218160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 220/467] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:42.218160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.223621 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.291651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518ff0-e908-469a-99e2-7a573de438b0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.328901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.329572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.329895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.330173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.330880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.332335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.337182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3135-c1be-4093-99f0-ffed74c725dd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.349598 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.355754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 248/468] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:42.356730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.391173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.393552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.395085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.396174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.412360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.415011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:42.459751 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:42.460878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:42.461888 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:42.461888 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:42.461888 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.461888 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:42.463304 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 221/469] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.463993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.486423 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.489542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c11ca-96b5-478c-9634-f39e3dfeac19 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.534670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.535357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.535624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.535896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.536607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.538092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.560862 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 249/470] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:42.561660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.614454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863e9f0-f5c2-4aa0-bce4-81fd6ed82e41 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.668321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.669529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.670052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.670576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.682315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.684151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.700894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1eb15-2a14-401f-881a-826c3ac61750 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4400b35e-031e-4104-9cc3-892e8ba5b00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:42.706612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:42.707594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:42.708442 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:42.708442 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:42.708442 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:42.708442 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:42.711242 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 222/471] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:42.713301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542e7d-fa52-4c2d-8a13-902293ae0eb5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.713821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542e7d-fa52-4c2d-8a13-902293ae0eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.714290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542e7d-fa52-4c2d-8a13-902293ae0eb5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.716094 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 223/472] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:42.717320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542e7d-fa52-4c2d-8a13-902293ae0eb5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.739565 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.745628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.746333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.746613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.746888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.747626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:42.747929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.749311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d0a1d-5754-4910-9b64-16cb40522078 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.762990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 250/473] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:42.768668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.768960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.769241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.790455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:42.792121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:42.806971 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:42.866847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542e7d-fa52-4c2d-8a13-902293ae0eb5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:42.894505 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 251/474] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:42.895623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:42.923598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:42.924632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:42.924632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:42.924944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:42.925684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:42.926025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:42.927468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:42.940773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 224/475] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:42.941775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:43.032701 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:43.033621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cb4c-28c1-4e4c-91bf-5ffce4efb07e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.072125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1edc0-9bcb-4710-ae1e-1f361bbfb4e6 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.085407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.086165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.086455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.086729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.087440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:43.089613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:43.114494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.115618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.115919 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 252/476] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:43.117867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:43.118552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.119091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.119889 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:43.120508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:43.131490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:43.141473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.sql.core [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:43.141473 n-d-master-1 devstack@keystone.service[80591]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:52:43.141473 n-d-master-1 devstack@keystone.service[80591]: [parameters: {'id': 'e647d0d3f0dc4cc1b5bb3ae1c603a0a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:52:43.141473 n-d-master-1 devstack@keystone.service[80591]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80591) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 00:52:43.166994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return ref.to_dict() Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:52:43.167984 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application yield resource Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise self.value Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application session.commit() Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:52:43.168835 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:52:43.169645 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:52:43.170513 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:52:43.171281 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [parameters: {'id': 'e647d0d3f0dc4cc1b5bb3ae1c603a0a2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:43.172047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:52:43.172797 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.176732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 225/477] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Jul 24 00:52:42 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:43.184827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:43.265755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afa458-f8f1-4124-9e5b-8f0c24d9f46c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.310186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.311139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.312073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.312489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.313495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:43.315491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:43.354157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 253/478] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:43 2022] POST /identity/v3/users => generated 249 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:43.381813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aadd1c-f212-40b6-88ca-7ead75e1ff47 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.425061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.425867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.426135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.426454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.440536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:43.446792 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d86c9534-c53f-4a3c-a54f-5b9d6b1c45bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:43.451244 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:43.452233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:43.452996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 226/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:52:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:43.460870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:43.532882 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:43.582525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee68d37-7361-4e3d-b3d6-215feaacbca7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:43.624239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:43.624924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:43.625211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:43.625491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:43.629128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:43.629128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:43.629128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc903d3d-5d0f-48ff-baca-149b6f997236 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:43.642173 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 254/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:44.875873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052742-4da2-44bc-a246-33d49681822f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.876870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052742-4da2-44bc-a246-33d49681822f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.877390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9052742-4da2-44bc-a246-33d49681822f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.879275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 227/481] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:44.885447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a808b-ff22-4a10-bed6-9198a5576875 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:44.886285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a808b-ff22-4a10-bed6-9198a5576875 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:44.886776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a808b-ff22-4a10-bed6-9198a5576875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:44.910644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d98a808b-ff22-4a10-bed6-9198a5576875 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:44.912213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d98a808b-ff22-4a10-bed6-9198a5576875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:45.005666 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 255/482] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:45.030414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9052742-4da2-44bc-a246-33d49681822f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.141328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9052742-4da2-44bc-a246-33d49681822f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.176115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661f3-cc95-4d4b-9754-a0b63495e819 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.176688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661f3-cc95-4d4b-9754-a0b63495e819 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.176903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.177474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661f3-cc95-4d4b-9754-a0b63495e819 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.177719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.178007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.178280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.179995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 256/483] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:45.185740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.186267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.186759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.192507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:45.198903 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.199833 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.200577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:45.205727 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 228/484] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.207640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.232238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:45.234648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:45.302321 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.324975 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.348218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bfa-5405-4b3c-bba1-d650bdcb7abd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.370356 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 257/485] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:45.384786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.385459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.385772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.386053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.386816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.387122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.388497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.397098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 229/486] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.403770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.408256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.529899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2b6f6-eb41-4668-a2ed-66f72e7f7ca2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.554773 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.566332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.567328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.567619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.567896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.581217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:45.590023 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.590902 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:45.591653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:45.592518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 230/487] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:45.598451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.716492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4e3b-ba26-4c68-8ec2-8e1b91059155 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.735914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6e22e-df55-4f9c-b540-852f44592ec1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.758079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.759362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.759652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.759928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.760761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:45.761072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.762779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.773442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 231/488] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:45.780177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:45.833082 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:45.850537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:45.851926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:45.852211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:45.852516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:45.890602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:45.892103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:45.901621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5408f-30ee-41db-ae71-00dd7223cc86 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:45.928028 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:45.930014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:45.931326 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:45.931326 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:45.931326 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:45.931326 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:45.934535 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 258/489] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:45.936727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.006260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.007995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.009056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.009056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.013216 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.031992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.035181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-cb906c5d-600b-4d64-b151-0652edc7cd15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:46.075335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.076998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.079534 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:46.079534 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:46.079534 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:46.079534 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:46.079534 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 232/490] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:46.080050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d3f5-3727-4b72-8dc1-e8e02c025ebd None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.080576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d3f5-3727-4b72-8dc1-e8e02c025ebd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.080810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d3f5-3727-4b72-8dc1-e8e02c025ebd None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.089815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 233/491] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:46.089815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66d3f5-3727-4b72-8dc1-e8e02c025ebd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.159250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94e462-3c93-48c1-92b4-eff5822f71c2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.214666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.215709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.216176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.216624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.218183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.218708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.220816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c0ed-cf83-42bc-b0ca-9d9b0671a242 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.241726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 259/492] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:46.244670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.245175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.245761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.251915 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.261293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66d3f5-3727-4b72-8dc1-e8e02c025ebd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.269135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:46.270551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:46.297317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.298119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.298404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.298681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.299397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.299696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.301099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11d00-e441-48e3-a00f-56865d84ec2d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.314293 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 234/493] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.315595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80ae6-24e7-48dc-b4af-37ba73adf2f3 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.315875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80ae6-24e7-48dc-b4af-37ba73adf2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.316170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80ae6-24e7-48dc-b4af-37ba73adf2f3 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.317636 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 235/494] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:46.322782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80ae6-24e7-48dc-b4af-37ba73adf2f3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.378166 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 260/495] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:46.381297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.424076 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.461383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80ae6-24e7-48dc-b4af-37ba73adf2f3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.498321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.499110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.499392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.499675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.506786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.508510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.517202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0bc47-5a75-44d8-9de2-7d7e10521d7d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-055adc6d-e414-4999-96d0-a9050054dc80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:46.524738 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.525821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:46.526700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 236/496] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.527691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b76e-d4b1-41a5-9309-7f4b50f7d650 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.527691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b76e-d4b1-41a5-9309-7f4b50f7d650 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.527691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7b76e-d4b1-41a5-9309-7f4b50f7d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.544604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-14a7b76e-d4b1-41a5-9309-7f4b50f7d650 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:46.545831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14a7b76e-d4b1-41a5-9309-7f4b50f7d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:46.555622 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.557732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.558736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.559017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.559295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.566468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.567923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:46.583594 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.584638 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:46.585537 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 261/497] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.586674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.615856 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 237/498] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:46.617779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab681-107c-408e-9882-2e063655bc1c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.618085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab681-107c-408e-9882-2e063655bc1c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.618361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ab681-107c-408e-9882-2e063655bc1c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.619624 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 238/499] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:46.620315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ab681-107c-408e-9882-2e063655bc1c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.682961 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.702214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa5b5-b515-4165-8e3b-fcadaf3cb982 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.727884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ab681-107c-408e-9882-2e063655bc1c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.736334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.737126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.737410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.737698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.748315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:46.756085 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:46.756994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 262/500] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:46.758350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.767022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.767746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.767977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.768252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.769110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.769415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.770906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fc261-e4bf-4ec4-bc3d-b4a98e28b4ce None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.813780 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 239/501] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.815076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.815363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.815638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.820941 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.833916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:46.835122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:46.866284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7553-bdc5-485e-bd98-a07ae7b63bcf None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:46.900641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:46.901299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:46.901580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:46.901908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:46.902744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:46.903048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:46.903582 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 240/502] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:46.912513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:46.912617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:46.944194 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:46.948199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 263/503] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:46.949357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.006185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8f58d-3a21-422d-a982-ba969419b54f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.035715 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.042066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.042855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.043134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.043400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.048455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11625-cc9f-4e22-9135-10888092fa4b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.053371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:47.061351 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.062279 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:47.063145 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 241/504] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.063779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.083980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.084644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.084923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.085192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.086516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.086821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.088194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.096263 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 264/505] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.097033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.158890 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.169880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549d64b-19da-41c0-8b0c-a5e34a095780 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.198862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d3e1-8772-4ac6-88b9-76d2b24e514d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.203018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.203666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.203948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.204219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.231942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.232721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.233023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.233264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.243520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.244968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.261616 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.262014 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.263189 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.264062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.264062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.264062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.264062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:47.264062 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 265/506] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.264458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.275651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.277146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.373964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ae57-d130-4687-b295-edff23210cac None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.383342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 242/507] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:47.384182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.393216 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.414296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.414950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.415228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.415497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.488925 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.489231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.490750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.498411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810ecd-5a84-47b7-916e-6440a12cc176 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.538303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.539589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.539856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.540121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.540884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.541185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.542615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.552996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 243/508] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.555046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.594302 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 266/509] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:47.595226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.614581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.678276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30388364-5f9c-4950-bc74-fd69fbae0170 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.698655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45260ae-1b37-418e-a8e2-6fa3ec2a420e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.712551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.713354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.713634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.713931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.725715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.728068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.733856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.734517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.734793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.735074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.735818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:47.736124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.737465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.745873 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.746909 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.748010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.748010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.748010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.748010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:47.748010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 244/510] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.748483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.750570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 267/511] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:47.752628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.757993 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.827529 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:47.852207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0677a31-c0ec-49d3-a9ff-1f889e5c1d50 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.854294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0a91d-b85d-448c-86bd-6a4f307f8fa7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:47.886307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.887093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.887362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:47.887465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.887639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.888149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:47.888432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:47.888711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:47.899041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.899736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:47.900505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.901192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.917535 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.918637 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.924266 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.924266 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.924266 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.924266 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:47.924525 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:47.925301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:47.926156 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:47.926156 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:47.926156 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:47.926156 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:47.926363 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 245/512] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.926427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 268/513] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:47.926488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.926563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:47.981722 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.022494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13d670-5930-4048-ac9e-96a7703842ba None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.032242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4c38-52f4-4866-a9ed-b461260a0f6f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.048085 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.057919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.058578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.058862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.059138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.059862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.060169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.061553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.066891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.067676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.067952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.068222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.073921 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 269/514] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.074697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.079012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.080482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:48.098129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.099149 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.100218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:48.100218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:48.100218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:48.100218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:48.100218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 246/515] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.100568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.183537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ebf7-a3e1-4c0d-b484-5f740455ca56 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.202551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cf39-5b44-4c54-af4f-e7192bb87247 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.214311 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.220635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.221315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.221592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.221898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.222618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.224080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.241445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.243018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.243283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.243558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.244306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.244613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.246058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.246796 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 270/516] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:52:48 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:52:48.247900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.260689 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 247/517] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.262736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.321618 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.391898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af920-73f6-4ccd-8ecb-0d664d96adc5 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.394968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd353551-fc8d-47d8-8673-30164fc71246 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.432189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.432685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.433508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.433508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.434066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.434343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.435743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.439553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.440374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.440646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.440920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.450393 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 271/518] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.451482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.457122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.458654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:48.474805 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.475740 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 248/519] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.477098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.509130 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.570440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5a82e-19e9-4acc-ac33-dad68f51f27f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.572297 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.593133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563472c2-44e9-4a35-aae0-3b247442c2e5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.610398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.611381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.611759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.612034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.612774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.613081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.614474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.631661 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 272/520] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.631661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.637656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.638542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.638830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.639226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.647722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.649231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:48.665245 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.666217 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:48.667075 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 249/521] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.667615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.744155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12bcf-87aa-4205-8aec-0cfa584c5c73 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.775009 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.784034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.784839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.785119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.785392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.785786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cdf43-ae3b-4135-89b0-11ab5ac43051 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.793337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.794995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:48.811678 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.812684 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 273/522] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.813834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.830170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.830852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.831133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.831406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.832273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:48.832584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.834084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.842604 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:48.860439 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 250/523] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:48.860439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:48.925381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b310f5-c7f3-42a7-83d1-a3b4ee37b476 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.961843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:48.962645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:48.962924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:48.963204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:48.970652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:48.972111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:48.973150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7c43a-5e46-4151-834d-f19616f460c0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:48.986435 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:48.987300 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:48.988187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 274/524] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:48.988627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.016575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.017746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.018355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.018707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.019570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.019875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.021642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.046810 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 251/525] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:49.046810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.056036 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.082977 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.104900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b64d-0965-4a30-a642-62eaeef1d8b0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.146802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.147460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.148284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.148626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.149611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.149954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.151409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.159827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a65433-cc0c-49f1-b61d-8bf84b06c811 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.170394 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 275/526] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:49.171251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.203223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.203876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.204159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.204431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.279313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.280795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.286301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788bab8-0270-4c61-94ab-150d0d094b1f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.289195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.325880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.326476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.326750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.327034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.327852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.328145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.329586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.347130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 276/527] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:49.347130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.349971 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.393103 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 252/528] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:49.398301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.460021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eba2e8-5a13-4ae3-ad53-5aa8407d3c69 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.496178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.496836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.497121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.497399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.504369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e25344-be0f-4525-bb09-72d0af1e8813 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.512790 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.542888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.543546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.543882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.544097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.544936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=1d7eafaa369f49bb9ea2c818d977d3a0) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.545240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.546696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.552464 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 253/529] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/role_assignments?user.id=1d7eafaa369f49bb9ea2c818d977d3a0&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:49.559570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.580670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.582189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.584482 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.681357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a0a71-f759-4250-b34d-1550836af581 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.697278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 277/530] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:52:49.702442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.722696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.723700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.724183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.724715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.725904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:49.726456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.728292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.742056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 254/531] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:49.743210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:49.822636 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.900459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b993e-c777-45b3-93be-d288677d0b93 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.909308 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:49.926370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5067b46-8371-457e-b25e-6f301cd6542c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:49.967298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.968105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.968386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.968661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:49.987002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:49.987817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:49.988624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:49.988753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:49.988913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:49.989172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.011481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.012991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:50.024259 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.025146 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.025981 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:50.025981 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:50.025981 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.025981 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:50.026860 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 278/532] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:50.041802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:50.044431 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.045233 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.046077 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:50.046077 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:50.046077 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:50.046077 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:50.046077 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 255/533] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:50.055120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.178553 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.198047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970949e-1971-4b27-90a3-0391cd492358 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.239048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.239732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.240018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.240295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.241044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.241384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.243100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.258614 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 256/534] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.264879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.285489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb6427-2551-48f5-b39d-d8b59f4bd5fd None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.365810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.366655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.367073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.367362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.368248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.368556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.370005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.396053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4a66-c13d-4bf3-a7e8-e462245120d8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.400704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 279/535] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.407439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.427177 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.443665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.445976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.445976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.446147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.454876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.456351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-067f9525-ccba-4f54-83d7-505e1671fa68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:50.476204 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.477470 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:50.478898 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:50.481756 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 257/536] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:50.483512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83b5c-398a-42a7-b021-04582eff1d00 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.483795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83b5c-398a-42a7-b021-04582eff1d00 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.484070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b83b5c-398a-42a7-b021-04582eff1d00 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.485557 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 258/537] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:50.487288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b83b5c-398a-42a7-b021-04582eff1d00 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.504481 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.550734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44450e93-5aa4-4699-b46b-ceae9e4bb095 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.600225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.601644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.602191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.602632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.610896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.612796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-088bee24-718a-4cdc-9309-b2b956bc70be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:50.631889 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:50.632838 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:50.633736 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:50.634123 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 280/538] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:50.635210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.635641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.635924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.644970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b83b5c-398a-42a7-b021-04582eff1d00 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.656576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:50.657849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:50.696630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.697915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.698464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.698959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.700029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.700590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.703531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.729564 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 259/539] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.729564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.753835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 281/540] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:50.755033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.758916 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.801002 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:50.840552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f81d2-65a2-4400-aff0-5dda10048a89 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.878616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.879287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.879568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.879838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.880626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.880944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.882687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.899483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a6a2e-7f3e-43e9-a82c-969a27b2a5e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:50.901787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 260/541] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.902918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:50.948906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:50.949486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:50.949793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:50.950071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:50.950959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=c3abde5d3aa4477c972e6be521345741) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:50.951671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:50.952770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:50.965942 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 282/542] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/role_assignments?user.id=c3abde5d3aa4477c972e6be521345741&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:50.965942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.088139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bbf3-04e2-479e-8d01-1ab38e209b71 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.098299 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.135580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c58dae-03bf-478f-a419-e8c51408a65c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.161981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.178975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.180080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.180530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.180879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.181158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.181429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.181694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.182194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.183255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=5a901a3ca2b749adb54c7b99a7ff1e04) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.183829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.185629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.192686 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 283/543] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/role_assignments?user.id=5a901a3ca2b749adb54c7b99a7ff1e04&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:51.202638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:51.212359 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.213293 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:51.214116 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:51.218134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 261/544] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:51.221843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.386805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4d18-837a-4de8-8ad9-6fb4e6cdbad3 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.432536 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:51.439605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.440328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.440611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.441948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.441948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.441948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.443426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.455422 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 284/545] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:51.462077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.618791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb2792-f31f-4114-95ca-d3434a8cb664 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.667377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.668542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.669015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.669502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.682862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.684679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:51.704156 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:51.705046 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:51.705932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:51.705932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:51.705932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:51.705932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:51.708380 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 262/546] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:51.718994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:51.864814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3805-4c4d-4d9a-abf7-d9ac13fb50b5 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:51.912497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:51.914412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:51.915061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:51.915529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:51.916465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:51.916978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:51.918641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d04e7-ab9a-4aa0-92b2-66077d49607f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:51.943398 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 285/547] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:51.949386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.010590 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.087612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e062-52a4-442c-a85a-bf91d4005887 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.088367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e062-52a4-442c-a85a-bf91d4005887 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.089047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e062-52a4-442c-a85a-bf91d4005887 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.094306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 286/548] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:52.099345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8feb-aa77-4a0c-ae49-0ebde8e0976a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.099898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec42d-ffbd-4759-918a-628efd9f840b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.100736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8feb-aa77-4a0c-ae49-0ebde8e0976a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.101316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8feb-aa77-4a0c-ae49-0ebde8e0976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.147426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a81c8feb-aa77-4a0c-ae49-0ebde8e0976a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:52.149151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.150147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.150425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.150722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.151215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a81c8feb-aa77-4a0c-ae49-0ebde8e0976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:52.165497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.165497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-93e485bf-509f-428d-b628-3fde35e88239 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:52.176877 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.178787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 263/549] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.179973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace17e8-65c5-4507-afe2-ddc1fdce0236 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.180788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace17e8-65c5-4507-afe2-ddc1fdce0236 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.180788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace17e8-65c5-4507-afe2-ddc1fdce0236 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.186801 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 264/550] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:52.192528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace17e8-65c5-4507-afe2-ddc1fdce0236 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.233052 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.256359 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 287/551] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:52.258846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.259455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.259938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.278842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:52.280486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:52.297392 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.302869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace17e8-65c5-4507-afe2-ddc1fdce0236 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.340644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.341368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.341649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.342258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.343111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.343462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.345042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.362315 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 288/552] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:52.369692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.369865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 265/553] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.370994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.476276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d412-b193-4b84-b5f5-e270cc1cef78 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.512506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.513160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.513436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.513735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.550229 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.551397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f12d-fd5d-4a17-bca7-a2a2573f6def None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.577776 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.585624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.587176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.623585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.625339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.626134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.626907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.641141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:52.650140 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.651158 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.651929 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:52.654651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 289/554] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.655675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.691926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 266/555] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:52:52.692823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.762079 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.771259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d6b1d-ed84-46d1-8ae6-6f860a788510 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.809002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.810172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.810357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106d0d9-4a9b-4b73-b4e6-cdd86f77b770 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.810853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.811329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.824243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:52.832416 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:52.833365 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:52.834190 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:52.842405 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 290/556] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:52.844140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.848280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.848956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.849231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.849503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:52.851321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:52.851321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:52.852924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:52.862320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 267/557] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:52.863149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:52.884119 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:52.957218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b202eb-a45b-48cd-a30f-8f0936d0ab36 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.973204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c0dc-6883-4af9-8359-9edbae6fefd8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:52.994199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:52.995310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:52.995796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:52.996272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.002046 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.007858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.009612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.010439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.011490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.012151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.013276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.014604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.015089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.016657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.027797 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 268/558] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.028877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:53.034778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.035706 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.036559 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:53.036559 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:53.036559 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.036559 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:53.036559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 291/559] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.036829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.152128 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.160223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401fb55-defc-4485-b68c-18c543fe0de7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.168851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac9af9-f3aa-4338-ae0a-47d3e2a4ccae None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.199754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.201006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.201552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.202037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.206373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.207170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.207452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.207731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.216007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.218243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.221296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.223337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:53.237849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.238754 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.239589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:53.239589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:53.239589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.239589 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:53.241664 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.242488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.243327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:53.243327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:53.243327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:53.243327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:53.244194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 269/560] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.245293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.247710 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 292/561] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.248700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.283248 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.361888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27525-a26c-49ec-8065-b7ff8da34ef5 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.362562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584396-0ac7-4af7-a344-9bbc76372e5c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.398899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.399465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.399793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.400028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.400780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.401082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.401858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.402511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.402945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.403441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.404030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.405058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.405561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.407165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.410684 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.417203 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 293/562] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.418102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.428580 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 270/563] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.429939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.526028 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.532118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbc56e-1684-4075-9921-3625e6b46936 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.535720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b5e08-552d-495a-8813-6cf5abc0279e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.572028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.572249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.573061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.573230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.573515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.573918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.574047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.574449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.575341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.575808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.577587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.582564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.584117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.596666 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 294/564] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.597881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:53.600463 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.601456 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:53.602405 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 271/565] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.602984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.668208 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.711616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec8ea-6f30-41b1-9336-f9f78b6eb122 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.713982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0e16-6a2f-40b0-bed5-447da48f8221 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.748941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.749781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.750108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.750323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.751220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.752010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.752299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.752552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.759036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.760355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.760482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.761928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:53.775702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.776849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:53.778163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-5130ce89-0089-417f-bc13-d70d2888e06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:53.778694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:53.779452 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:53.780313 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:53.780707 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 272/566] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.780707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.782186 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 295/567] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:53.782896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b96c3-b08f-4156-aab3-7cb876fd982c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.783181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b96c3-b08f-4156-aab3-7cb876fd982c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.783457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b96c3-b08f-4156-aab3-7cb876fd982c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.784739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 296/568] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:53.785812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bafd-9b41-4b64-876c-ac82d4285b1d None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.786091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bafd-9b41-4b64-876c-ac82d4285b1d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.786358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bafd-9b41-4b64-876c-ac82d4285b1d None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.787548 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 297/569] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:53.788599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bafd-9b41-4b64-876c-ac82d4285b1d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.798418 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.887061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947495b-97fe-4ce6-8c92-f16d6114716b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.894195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bafd-9b41-4b64-876c-ac82d4285b1d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:53.911974 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:53.921387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.922075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.922351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.922651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.923501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.923808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.925240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.930539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:53.931262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.931550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.931834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.932676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:53.932983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:53.934462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b564119-8135-4dca-b414-6f5d016357b2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:53.942410 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 273/570] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.943230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:53.956944 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 298/571] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:53.958222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ee06-bff4-4293-b4ee-4b717e2325dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:53.958495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ee06-bff4-4293-b4ee-4b717e2325dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:53.958772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ee06-bff4-4293-b4ee-4b717e2325dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:53.975566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8049ee06-bff4-4293-b4ee-4b717e2325dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:53.976776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8049ee06-bff4-4293-b4ee-4b717e2325dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:54.017628 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.043031 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 299/572] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:54.044377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.044663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.044939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.050682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ebd1-1353-4980-9f56-fc520dedbb6a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.075967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:54.077185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:54.089896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.090553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.090830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.091102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.092160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.092461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.093973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.105556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 274/573] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.106459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.151454 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 300/574] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:54.152316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.189094 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.217620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063423-5b60-4dd1-8a43-d3d2f5763c08 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.246673 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.252871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.253700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.253980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.254256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.254639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b2f5-3163-4935-96d8-d8bd635e499d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.265044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.266530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:54.284117 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.285030 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.285929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:54.285929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:54.285929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.285929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:54.285929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 275/575] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.286195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.292062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.292941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.293229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.293506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.303969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.305528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:54.323916 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.324947 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 301/576] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.326050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.386873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750728-9acd-4cfb-8db0-c21320053c53 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.412270 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.421480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.422402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.422686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.422959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.426106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa1c4-c793-4ed6-993e-9c4921b7691b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.434863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:54.442691 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.443752 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:54.444967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 276/577] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.445813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.465402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.466079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.466361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.466636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.467738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=fdc4ad8dc59b4974a08e687a78764471) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.468047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.469490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.474998 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 302/578] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/role_assignments?user.id=fdc4ad8dc59b4974a08e687a78764471&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.476456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.500808 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.571203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c758c7a-7a9b-4ebf-bbe0-20230a26fced None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.594514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fafd76-536a-4a4a-8d54-27b492b5e5bf None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.612219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.613123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.613469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.613845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.626374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:54.634564 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:54.635571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 277/579] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:54.637302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.643118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.643996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.644293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.645716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.645716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.645921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.647386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.660874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 303/580] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.661535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.681281 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.750370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb3301-72b3-452a-a9b6-1f83600541ac None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.752134 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.774176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6c96-36fa-4157-82d4-d4168f844de1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.789144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.789839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.790121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.790394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.791125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.791424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.792796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.809576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 278/581] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.809576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.815409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.816210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.816565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.816913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.817789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.818164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.820413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.829149 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 304/582] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.834491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.915011 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.916209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d04e-3024-418f-9b8a-cae53b195365 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.942351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac411b55-d690-4a4a-813a-94b49aed6797 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:54.953645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.954612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.954612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.954895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.955715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:54.956016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:54.957378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:54.972799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 279/583] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:54.972799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:54.987465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:54.988424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:54.988779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:54.989264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:54.996972 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:54.998478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.000035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:55.015450 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.016356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:55.017242 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 305/584] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.017742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.081842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44436-0fd1-4c77-8328-00703048531e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.120218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.121714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.121714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.121714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.129121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.130605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.130924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a510ab-0c59-41e3-991d-76a1cebf8632 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:55.146787 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.148243 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:55.149218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 280/585] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.149735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.174505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.175395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.175703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.175972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.178418 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.189735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.191210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:55.212304 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.213213 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.214126 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:55.214126 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:55.214126 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.214126 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:55.214126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 306/586] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.214412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.249048 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.265620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1baf62-9d9d-4f8f-a8d1-edb8b6c6830b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.301062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.301902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.302188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.302465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.313019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.314574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.326554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d1fe-74bf-4cd9-a39c-a647de49dd68 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:55.334584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.336129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 281/587] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.342495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.362562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.363226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.363512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.363791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.365014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.365339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.366967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.383682 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 307/588] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.383682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.429394 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.459940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d5fd8-4a71-4d04-a7e2-919bdd309955 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.489213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cb3a1-ce6a-4b61-9bf9-bab189ae4f04 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.499143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.500124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.500408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.500778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.501488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.501830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.503558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.506319 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.519151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 282/589] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.519839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.530805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.531824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.532164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.532447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.533491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.533833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.535209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.549098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 308/590] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.549906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.639541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471b5d-87dc-49b4-877e-7ebdd592bc69 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.658947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fcdba-114a-41ba-9945-cb07ca9a7700 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.667573 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.677120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.677736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.678018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.678294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.679025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:55.679328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.680706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.697755 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 283/591] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:55.697755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.704839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.706091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.706374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.706810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/1d7eafaa369f49bb9ea2c818d977d3a0/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.724898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=1d7eafaa369f49bb9ea2c818d977d3a0, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.726733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.739709 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 309/592] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:55 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/1d7eafaa369f49bb9ea2c818d977d3a0/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:55.742524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.759457 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:55.814428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cfb0f-2373-433c-9d8f-9d5b7473a7bc None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.867753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.868711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.868991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.869264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.892456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=301e817770344ea89321aa8d85756547, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.895965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.898665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02802-51cd-4046-9853-c6e5664150d2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:55.917134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 284/593] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:55 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:55.918138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:55.940766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:55.942019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:55.942501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:55.942993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:55.956976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:55.958574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:55.982971 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:55.983962 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:52:55.984853 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:55.988018 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 310/594] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:55.996763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.033570 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.057741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be24c1-2f8b-49fb-9df4-bab534856e51 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.064270 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.118006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.119190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.119669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.120778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.139103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.141215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:56.165171 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.166373 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:56.167486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 285/595] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.173011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.221709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b303-1ca1-4f19-9ac2-56b1a6bbfe40 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.288903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.290041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.291636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.292265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.293952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.294646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.296976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.336205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 311/596] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:56.346744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.419756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825935ec-054d-47cb-a821-db7dc10b8148 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.434142 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.462894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc82f7-52d4-480a-b85e-ad2fb7b62b0c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.503901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.504570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.504849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.505121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.506009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.506308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.509267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.529569 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 286/597] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:56.539385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.549030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.550025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.550404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.550815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.574557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.579385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.588321 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:56.608737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.609808 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.610659 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:56.610659 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:56.610659 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.610659 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:56.625784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 312/598] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.631538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.704889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320f925-1220-4af7-9878-5bdce15c484d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.742067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.742858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.743154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.743408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.756089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.759797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.769951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab003bb-d447-44cf-bcf5-1116164bfe58 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6a38e7d9-ecf9-414f-a50c-da91ff95d02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:56.794304 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:56.796050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:56.797728 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:56.797728 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:56.797728 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:56.797728 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:56.799535 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.810055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 287/599] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:56.811967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077d8b-ca7d-4b3a-a635-b675b9c4df73 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.812243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077d8b-ca7d-4b3a-a635-b675b9c4df73 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.812512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077d8b-ca7d-4b3a-a635-b675b9c4df73 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.814172 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 288/600] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:56.815305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077d8b-ca7d-4b3a-a635-b675b9c4df73 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.818412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:56.819101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.820103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.820260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.820925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:56.821253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:56.822671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5881a8-d2b2-4d4b-ae98-7c842525bdee None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:56.842053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 313/601] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:52:56.843767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:56.844260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:56.844764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:56.863130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:56.864921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:56.925236 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:56.950007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 314/602] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:52:56.950767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:56.956538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077d8b-ca7d-4b3a-a635-b675b9c4df73 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.006626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.007310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.007595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.007873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.008613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.009302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.011110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.026492 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 289/603] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.027672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.070456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad2718-2517-4e63-a220-e907a511f018 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.094055 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.109629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.110596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.110972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.111342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.119742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.121497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:57.140540 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.141624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:57.142675 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:57.145741 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 315/604] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.145741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.166558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd757c-5927-4c83-8f88-85e5dfca7c37 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.209358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.210812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.211099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.211382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.222237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:57.230192 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.232389 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 290/605] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.234415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.248132 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.277703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad599955-c297-4445-9925-3573cf63c516 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.323832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.324917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.325198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.325468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.335213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.337212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.341533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800979e-65fa-424c-90c3-805071849a55 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:57.356332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.357233 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 316/606] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.358761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.386083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.386753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.387037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.387314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.388238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.388435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.389899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.403315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 291/607] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.404287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.409517 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.469445 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.499875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffd5d3-946f-47bb-85ee-05ab24387ef9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.527527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490836-3e45-4ab3-a80f-0bcb07b60567 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.547531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.548298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.548648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.549011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.549866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.550236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.552231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.564276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 317/608] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.565210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.566618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.567562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.568036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.568813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.569878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:57.570462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.572124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.586510 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 292/609] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:57.587752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.709197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a828e-d633-4764-b3de-bead2f6b905d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.714209 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.720020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9b420-8612-4a1b-8d42-37718bbf0310 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:57.730765 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:57.762191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.763014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.763569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.763911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.770161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:57.771129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:57.771470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:57.771809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/5a901a3ca2b749adb54c7b99a7ff1e04/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:57.782361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.784458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.791819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=5a901a3ca2b749adb54c7b99a7ff1e04, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:57.793963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:57.806966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:57.807967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:57.808823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:57.808823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:57.808823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:57.808823 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:57.808823 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 293/610] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:57.811793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.813593 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 318/611] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:57 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/5a901a3ca2b749adb54c7b99a7ff1e04/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:57.815764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:57.984150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c83ba-06f8-4704-a006-7190a0363013 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.027880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681088a1-e65c-42f6-92f8-51fb546d1d65 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.042866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.044087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.044919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.045353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.046580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.047050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.049086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.070744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 319/612] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.076370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.081647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.082865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.083301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.083730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/c3abde5d3aa4477c972e6be521345741/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.114061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.138663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=c3abde5d3aa4477c972e6be521345741, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.140908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de072404-a22d-48e8-9b79-d1d5d444311b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.157368 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 294/613] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:52:57 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/c3abde5d3aa4477c972e6be521345741/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:52:58.163473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad038c-2d7a-42bf-bd21-474210c55ff9 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.163931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad038c-2d7a-42bf-bd21-474210c55ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.164226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad038c-2d7a-42bf-bd21-474210c55ff9 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.166026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 295/614] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:58.171974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44c5b-3ac1-4903-a731-0807adcae104 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.172262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44c5b-3ac1-4903-a731-0807adcae104 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.172542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44c5b-3ac1-4903-a731-0807adcae104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.196114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-46b44c5b-3ac1-4903-a731-0807adcae104 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:58.197959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-46b44c5b-3ac1-4903-a731-0807adcae104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:58.246208 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.343391 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 296/615] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:58.349480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bb018-70cf-4d55-ae68-01c322f4c682 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.350060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a90a-9eb7-44a4-8429-67dd76fcd99a None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.350382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a90a-9eb7-44a4-8429-67dd76fcd99a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.350909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a90a-9eb7-44a4-8429-67dd76fcd99a None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.353408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 297/616] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:52:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:52:58.359735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.360040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.360294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.384175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:52:58.385392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:52:58.400519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.401319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.401607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.401934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.413232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.415432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:58.436222 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.437179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:58.438672 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 320/617] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:52:58.439388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.480008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 298/618] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:52:58.481041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.540200 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.587345 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.592762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a333f-c5db-482d-a4f0-8082662943ae None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.616194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd02d2-0a98-453b-a939-bb85c6c8f524 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.643717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.645266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.646002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.646446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.666450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.667662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.668255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.668656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:58.668834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.669972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.670457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.672997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:58.680387 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.681610 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.682687 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:58.684826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 321/619] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:58.685859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.701556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 299/620] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.702661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.808365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f9194-4be2-43c7-9a8d-709925078841 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.847961 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.848382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d5eb-0211-40dd-bf1d-a09d2dacd84d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:58.859083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.860780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.861231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.861719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.877863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:52:58.890497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:58.891567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:52:58.892391 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:58.894987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 322/621] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:58.895882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:58.896154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:58.896940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:58.897479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:58.897961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:58.898906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:58.899305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:58.901091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:58.904704 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:58.915139 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 300/622] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:58.916206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.036903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df47b1d-10d7-432f-9c73-60a2672da331 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.039014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324574b-a2a5-438e-94f2-8a3136d6e841 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.076883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.078003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.078488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.078884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.087809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.088776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.089220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.089658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.091011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.092015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.092777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.093790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.094580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.106930 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 301/623] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.108019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:59.117265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.118397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.119265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:59.119265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:59.119265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.119265 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:59.122165 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 323/624] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.123263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.183430 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.190714 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.240343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4346f92-b751-4370-acab-3d412c4ef04c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.263091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05144a2-df71-4283-a302-87665d1c361f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.286593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.287602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.288497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.289214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.302468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.304122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.304676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.304799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.305315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.306601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.317487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.319309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:59.327329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.337968 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 302/625] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.340301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:52:59.347488 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.348356 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.349228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:52:59.349228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:52:59.349228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:52:59.349228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:59.352242 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 324/626] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.353884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.462846 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.472845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c9653-6a8f-44aa-b1e9-03aa2c43ac82 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.474677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45331ca-64e6-44e5-8212-b31053ae310f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.488657 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.518615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.519789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.519900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.520406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.520511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.520792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.521074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.521411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.521912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.522871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.524162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.524444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.524895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.526664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.540681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 325/627] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.545863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.546330 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 303/628] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.547667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.675606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706c73-43a3-489a-994c-7834b12a218c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.683267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81010949-57d3-4c50-ae9e-35d114e8a92d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.724184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.724886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.725125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.725506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.726538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:52:59.726847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.727415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.728354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.728660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.729150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.729654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.738816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.742276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.742857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 326/629] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:52:59.743936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:59.760476 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.761512 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:52:59.762457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:59.763821 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.766271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 304/630] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.767393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.808696 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:52:59.877623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea48f-62e6-498b-9b77-c538fcd47ee8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.901486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95caa4-429b-4f2c-b365-269b88f8cfb9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:52:59.922976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.923784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.924063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.924336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.933796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.935715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.943247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:52:59.944940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:52:59.945641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:52:59.946162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:52:59.953534 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.954492 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:52:59.955341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:52:59.958862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:52:59.959468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 327/631] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.960882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:52:59.962028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:52:59.981067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:52:59.982105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:52:59.982994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:52:59.986914 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 305/632] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:52:59.988121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.037109 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.072190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d8c32-a47f-48f5-88ca-9bfe25d430e8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.105329 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.120009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.124086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.124086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.124086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.124086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.124086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.124670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020eddd-c26e-4c2d-b9a6-3de0a286d0fe None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.127101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.158625 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 328/633] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.160059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.174116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.174788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.175078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.175814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.176648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.176962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.179036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7517278-470d-4c4c-8827-8822a219b62e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.192556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 306/634] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.199861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c074-cadf-4e95-a2a9-c2741793bafb None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.199861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c074-cadf-4e95-a2a9-c2741793bafb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.200144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9c074-cadf-4e95-a2a9-c2741793bafb None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.201430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 307/635] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:00.202215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9c074-cadf-4e95-a2a9-c2741793bafb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.297573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c0dce-039f-4132-b8c2-c7b701486154 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.318640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9c074-cadf-4e95-a2a9-c2741793bafb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.329426 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.339096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.340383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.341274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.342054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.343131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:00.343688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.346339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.360256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.360939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.361224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.361496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.372494 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 329/636] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:00.373149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.392188 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.444704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.446375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.480508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de0d90-6960-4921-9f43-afab6ca7bda8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.521804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.523066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.523349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.523631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/fdc4ad8dc59b4974a08e687a78764471/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.540273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=fdc4ad8dc59b4974a08e687a78764471, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.541831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052c9b-b000-423c-8f2e-eb22d71e0850 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.555908 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 330/637] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:00 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/fdc4ad8dc59b4974a08e687a78764471/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:00.557268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9ce33-8709-4df2-aa16-efbfdf733d4b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.557561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9ce33-8709-4df2-aa16-efbfdf733d4b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.557872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9ce33-8709-4df2-aa16-efbfdf733d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.558643 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 308/638] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:00.559538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.577775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-43f9ce33-8709-4df2-aa16-efbfdf733d4b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:00.579209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-43f9ce33-8709-4df2-aa16-efbfdf733d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:00.616717 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.634701 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 331/639] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6a3f-f7ac-49be-b4e4-4505588d681c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6a3f-f7ac-49be-b4e4-4505588d681c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6a3f-f7ac-49be-b4e4-4505588d681c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 332/640] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:00.673714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6a3f-f7ac-49be-b4e4-4505588d681c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.717233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7354fb4-c53e-4210-abf9-3726fd7fbd5d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.766537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.766955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.767237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.767523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.798311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6a3f-f7ac-49be-b4e4-4505588d681c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:00.838240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:00.839050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.839347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.839743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.841995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.843460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.852523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:00.854316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-04755a9b-d4b4-4cc7-94d6-68f5489c0226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:00.874737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:00.875901 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:00.876972 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:00.876972 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:00.876972 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:00.876972 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:00.882834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 333/641] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:00.882834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:00.882834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:00.882834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:00.900024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:00.901559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:00.904068 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.920625 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:00.960845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 309/642] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:00.961736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:00.989332 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 334/643] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:00.990267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.089476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7769c-2601-45c7-9d11-ccb1b7f2e6aa None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.116438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ce17f-c75f-40dc-8ae8-1c385d35b5e3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.138278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.139399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.139825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.140242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.153202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:01.158707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.159384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.159668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.159945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.160686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.160998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.162437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:01.162965 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.164115 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.165040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:01.167146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 310/644] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.168114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.178753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 335/645] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.180461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.190684 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.197576 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.294934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56093a88-2e49-4e0c-9a0a-5b78abd36cd7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.297324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c82b7-741f-427b-bef4-b14b037fa91d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.333759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.335074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.335407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.335894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.345138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.346409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.346909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.347317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.347662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.349153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.365765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:01.368598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.369444 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.370537 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:01.370537 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:01.370537 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.370537 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:01.370537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 311/646] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.371283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:01.378842 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.380342 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:01.382137 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:01.386565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 336/647] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.389333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.446719 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.473506 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.487625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4779f-4048-4c12-86d7-3d9602f59c5e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.511731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29142680-441d-49d5-b3b5-270737d3b719 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.526451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.527242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.527527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.527805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.528566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.528874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.530319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.544390 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 312/648] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.544390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.560896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.561618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.561924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.562197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.569204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.571015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:01.586150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.587221 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:01.588060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 337/649] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.588526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.655908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68750e7-8c69-4be3-85a4-1a82051c5294 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.684548 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.695070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.695819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.696178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.696534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.697397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.697811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.699252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.699358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08791388-c69f-48ee-a5db-e217151c3548 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.717442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 313/650] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.717442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.743573 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:01.751732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.752714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.753126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.753652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.754980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.755488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.757216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.767413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 338/651] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.768238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.840342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7de9a-c25a-4ffe-9e42-c57fb773ae26 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.881660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.882823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.883220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.883616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.893155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8dcb4-e01f-4a97-83bb-31fa08414cc4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:01.896158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.898874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:01.919095 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:01.920219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 314/652] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:01.921107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.937400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:01.938388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:01.938679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:01.939008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:01.939813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:01.940122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:01.941568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:01.955351 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 339/653] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:01.956198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:01.972683 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.018947 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.042790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c50c07-dc3a-41f8-95c6-7d78842f0fd8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.074674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf80292-8f74-47d7-bea1-b6d6e8d731ff None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.079779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.080590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.080872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.081155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.089089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.090659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:02.105897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.106998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:02.108037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 315/654] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.108564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.124079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.125258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.125743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.126189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.139808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.141297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:02.162872 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.163935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.164824 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:02.164824 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:02.164824 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:02.164824 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:02.164824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 340/655] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.166181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.241362 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.247082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812f99-6550-4716-ae95-55a8b8c1fdaf None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.285434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4b18-7e7a-43b7-81d0-89c35a6ad027 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.289358 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.295007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.295681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.295958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.296236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.296975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.297276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.298728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.314759 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 316/656] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.316017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.332681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.333456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.333790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.334041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.335534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=1d7eafaa369f49bb9ea2c818d977d3a0) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.335534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.336700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.353871 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 341/657] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/role_assignments?user.id=1d7eafaa369f49bb9ea2c818d977d3a0&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.353871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.450638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeabdd-9321-4677-98ea-cc3c76020c40 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.501191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.502011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.502359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.502703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.503650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.504277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.505799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.512569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03351-79de-4fb2-8285-de7e4c8f26f1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.520815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 317/658] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.521971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.543043 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.578467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.579392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.580278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.580278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.580686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.580964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.582816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.595999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 342/659] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.596933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.638685 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.658943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192deee-75ce-42a5-92d3-ee7c4fb75ad4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.703619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.705251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.705251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.705488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.714391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.715884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:02.731383 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.732343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:02.733264 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:02.733835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0dba4-f08e-4624-b1e2-5dc879b832a5 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.733922 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 318/660] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.733922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.775287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.776055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.776412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.776769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.777607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.777982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.779423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ffb35-8556-40e0-beba-3cbb85b18235 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.790529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 343/661] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:02.790529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba3bd-9f39-4ad2-a66b-35c64a4ee322 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.790529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba3bd-9f39-4ad2-a66b-35c64a4ee322 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.790529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba3bd-9f39-4ad2-a66b-35c64a4ee322 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.794808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 344/662] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:02.794808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba3bd-9f39-4ad2-a66b-35c64a4ee322 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:02.886058 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.916333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed04dd8-aa9c-43eb-b38c-85af2c336643 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.918302 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:02.933568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba3bd-9f39-4ad2-a66b-35c64a4ee322 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:02.961860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.962688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.962971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.963247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.974565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.976102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.990682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:02.991363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.991645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.991919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:02.992845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:02.993156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b36ade87-a181-4c75-b8c0-f6239fc8db86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:02.993995 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:02.994935 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:53:02.995876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:02.996399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:02.996469 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 319/663] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:02.996469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:02.997397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:02.997397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.015914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:03.017071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:03.024567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 345/664] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Jul 24 00:53:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.025417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.120118 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 320/665] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:03.121036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.158465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5806-dd9e-4f9b-ac9a-539d50f7a57e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.208369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.209061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.209376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.210161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.211398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.211706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.213566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.224313 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.245829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 346/666] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.247917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.267456 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.271701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd017fb-24dc-42b4-b3ac-2001ef6df66f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.310261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.311140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.311523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.311897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.388732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339afb03-d783-46a0-bb4e-6819728216d3 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.392824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.394482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.425569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.426525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.426814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.427090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.439275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:03.447794 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:03.448908 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:03.449995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 347/667] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:03.450840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.469093 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.507034 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 321/668] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:03.507983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.538352 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.566314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1f86-a6f0-486e-9b4a-179547cb7ca0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.604288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.605048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.605389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.605800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.622385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a25bd-5833-432e-8c24-db6eb969bd61 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.654489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.655268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.655621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.655963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.656948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:03.657334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.659019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.669286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 322/669] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:03.670266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.683024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.684759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.703276 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.770223 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.781688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00808d6e-5710-4eaf-89da-b86c486a6188 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.802833 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 348/670] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:03.804451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.819970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.820967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.821325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.821721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.833047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.834778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:03.853553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:03.854669 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:03.855745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:03.855745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:03.855745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:03.855745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:03.857078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 323/671] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:03.858228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:03.922319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9337d1-8a16-4aa2-b990-141d61a46848 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.948919 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:03.962285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:03.963447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:03.963870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:03.964366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:03.970584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ccfde-4aa8-4d06-a9d8-ee82a5301097 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:03.976412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:03.978186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:03.997976 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:03.999069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.000123 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:04.000123 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:04.000123 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:04.000123 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:04.002335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 349/672] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.003473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.010400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.011833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.012209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.012580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.024942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.026705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.028934 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:04.046134 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.047071 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.047932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:04.047932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:04.047932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:04.047932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:04.050199 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 324/673] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.051256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.120471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16545-f71e-42a0-869f-974dbcdf5b91 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.167132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676cc4-aafe-4245-85d6-4dd6d22c650f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.168386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.169075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.169352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.169627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.170548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.170852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.172584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.191478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 350/674] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.192396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.208951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.210775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.211288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.211833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.212836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.213444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.215235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.217906 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.231660 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 325/675] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.232653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.288460 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.311221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd627-9ac1-463c-b7b0-b4d8151264c6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.345101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb404ae-7e65-4849-9dee-480575d0759f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.350046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.351410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.351907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.352338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.353263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.353727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.355354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.369285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 351/676] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.370520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.388834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.389925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.390246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.390624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.400996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.403029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:04.418556 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.419607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.420492 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:04.425320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 326/677] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.426374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.485049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033158b2-4ab4-4ac0-ac19-6d1221ae4879 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.487127 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.524927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.526062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.526598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.527146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.535451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.536981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350aef0-78dd-43bb-862d-e76e4a766c38 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.538382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:04.555591 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.556526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:04.557410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:04.560348 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 352/678] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.564787 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.566004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.575818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.576555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.576893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.577114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.589325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.591830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:04.612598 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:04.613739 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:04.614851 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:04.621711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 327/679] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:04.621711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.702144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7f75-c131-4e15-9206-30342c615b7b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.743575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.744238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.744529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.744787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.745576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.745918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.747358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.750596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94302d3-dd0f-4bcc-bdf7-a3a356e88dd6 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.763236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 353/680] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.764991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.773997 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.796488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.797229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.797516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.797815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.798668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.798969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.800406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d495a-cdf0-4de6-9981-0978e34423a7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.821711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 328/681] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.822833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831deda-e052-498a-b6ae-140c331cfd2a None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.823126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831deda-e052-498a-b6ae-140c331cfd2a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.823404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831deda-e052-498a-b6ae-140c331cfd2a None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.828682 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 329/682] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:04.828682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831deda-e052-498a-b6ae-140c331cfd2a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.839824 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:04.887118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ce7-6421-4be0-8ac0-dc9bf306cae7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.924558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.925320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.925600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.925913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.926739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.927042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.928590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:04.942786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 354/683] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:04.943929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:04.954184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831deda-e052-498a-b6ae-140c331cfd2a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:04.995616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:04.996388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:04.996668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:04.996943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:04.997813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=5a901a3ca2b749adb54c7b99a7ff1e04) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:04.998120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:04.999770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3ac33-6336-40b0-88c7-2c65a0823190 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.007194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 330/684] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/role_assignments?user.id=5a901a3ca2b749adb54c7b99a7ff1e04&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.019302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.019624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.019858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.043066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:05.044697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:05.066486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cd6ab-ead1-488a-a7b4-a7d2b03843e2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.083143 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.092209 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.111109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.111726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.112111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.112501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.139459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 331/685] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:05.140659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.214763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.216245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f80d9-84d0-4e06-889b-03dd976cd4fd None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.256788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a9f5c-8f94-4219-97b6-36142f9e66a4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.295144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.295804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.296085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.296355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.297194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=c3abde5d3aa4477c972e6be521345741) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:05.297499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.299417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d748-6769-4aae-bccf-f4c6a3dd6391 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 332/686] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/role_assignments?user.id=c3abde5d3aa4477c972e6be521345741&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330e7c-99a0-4df1-ac9c-f47db621e858 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330e7c-99a0-4df1-ac9c-f47db621e858 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a330e7c-99a0-4df1-ac9c-f47db621e858 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 333/687] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:05.315161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330e7c-99a0-4df1-ac9c-f47db621e858 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.336556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 355/688] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:05.338137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.338492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.338825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.358089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:05.359298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:05.369616 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.378101 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.445102 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 356/689] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:05.446033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.499750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a330e7c-99a0-4df1-ac9c-f47db621e858 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.547885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.548837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.549129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.549402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.562185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.563658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:05.586692 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.587605 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.589189 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:05.589189 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:05.589189 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.589189 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:05.589423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0481c-fd1c-49d1-bf9c-bea760935b7b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.589885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 334/690] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:05.589885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.638756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.640026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.640500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.640951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.659472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.662057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:05.694208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.695351 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.696208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:05.696208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:05.696208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:05.696208 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:05.696954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 357/691] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:05.705469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.710929 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.753099 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:05.791506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5a7ba-4969-47a4-8de7-2147d8f07530 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.833247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.834748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.835256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.835853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.847712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:05.856780 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:05.857988 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:05.859004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:05.860173 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 335/692] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:05.861098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.871424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893cd2-0aba-43f4-b444-4aaaf2265963 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:05.917756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:05.918623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:05.919033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:05.919402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:05.920243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:05.920641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:05.922179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:05.941447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 358/693] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:05.941447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:05.994658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e862d82-20de-4772-a52b-0c5f6fa05e99 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.020031 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.046047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.047031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.047522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.048004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.049562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.050047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.052115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.062764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ef029-3972-4e71-ab17-cb0c85dd52e4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.071697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 336/694] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:06.072744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.079201 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.109603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.110567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.111112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.111533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.112531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.112992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.114569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.125530 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 359/695] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:06.126714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.187851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ae2b-ea0a-4b97-b9d5-777db655894a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.226867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.227604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.227884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.228155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.228926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.230840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.261714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 337/696] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:53:06 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:06.261714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.263385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d2b4-42a7-4a14-b507-eb08763dcbe8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.305697 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.330165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.330972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.331252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.331526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.351979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.353481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.354050 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:06.398346 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:06.399243 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:06.400109 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:06.402724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 360/697] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:06.409540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.444888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89c296-fe60-4900-ba01-5422147885e3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.498411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.499522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.500066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.500721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.513938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.515912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.534604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1b2bf-7fbe-4cf9-b836-0185efd631cb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:06.536985 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:06.538238 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:06.539102 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:06.539102 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:06.539102 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:06.539102 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:06.541090 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 338/698] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:06.546623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.572986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.573665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.573964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.574241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.575043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.575353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.576809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.590416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 361/699] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:06.603434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.671750 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.698219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55f1c-c3ad-41e4-9b8a-70d199187424 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.714325 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:06.748467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.749322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.749609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.749914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.751179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.751497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.753258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.759753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260318c5-aaee-40b4-b293-b10ea6c9bfab None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.771167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 339/700] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:06.776952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:06.824480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.825517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.826059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.826556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.827591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=fdc4ad8dc59b4974a08e687a78764471) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:06.828101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.830023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:06.842026 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 362/701] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/role_assignments?user.id=fdc4ad8dc59b4974a08e687a78764471&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:06.929622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3036-4a05-4cee-a7a5-d08fd39e7ea4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:06.981455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:06.982413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:06.982693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:06.982966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:06.992572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:06.994096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:07.018067 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:07.019040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:07.019936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:07.024462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 340/702] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:07.027896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.167507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0aa4-cdfb-4087-a66a-53dce52bcfbb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.179480 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.211610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.212273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.212559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.212838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.213776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:07.214093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.215604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342977c-52fb-4417-bb5d-6b3003816586 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.237432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 363/703] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:07.244468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.289534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612195-7859-40a4-9671-c2fdee46c247 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.289534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612195-7859-40a4-9671-c2fdee46c247 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.289534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1612195-7859-40a4-9671-c2fdee46c247 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.289987 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.291652 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 364/704] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:07.301006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.301355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.301558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.325450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:07.326761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:07.416807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a3871-ffda-4c4e-b3af-65da0fdfa811 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.441243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 365/705] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:53:07.466005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.500324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.501594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.501902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.502179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.624660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.626184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308320-c48d-4efb-b024-747d50caf67c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.633981 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.641929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96063b-a9c7-460b-914b-2fd363ba622f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.660756 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.710844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.711720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.712001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.712276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.713059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.714618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-62bdb726-1c37-447b-a702-6df59e85ec1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:07.738430 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:07.739393 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:07.740199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 366/706] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:07.742274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6dc5-8fe7-4106-9972-c8bd54919cea None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.742895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6dc5-8fe7-4106-9972-c8bd54919cea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.742895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6dc5-8fe7-4106-9972-c8bd54919cea None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.746568 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 341/708] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:53:07.748407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 367/708] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:07.750536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.751031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.751317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.752472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc6dc5-8fe7-4106-9972-c8bd54919cea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.779177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:07.780399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:07.863587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 342/709] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:53:07.870638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:07.889802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc6dc5-8fe7-4106-9972-c8bd54919cea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:07.935813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:07.937856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:07.938306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:07.938768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:07.961164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:07.964519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:07.985414 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:07.998149 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:07.999058 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:07.999918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:07.999918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:07.999918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:07.999918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:08.000720 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 368/710] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:08.002330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.029125 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.041051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82314e32-2320-4cfa-8dc4-6564cba85e7b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.083128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.084749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.085470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.086209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.087150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.087767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.089377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.095464 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 343/711] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.096524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.182626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1846-023a-4bc8-898a-9feb51bf5aee None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.216006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0a2b-ae81-4b93-8c9c-37674de67617 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.243606 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.243798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.245074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.245584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.246150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] PATH_INFO: `/v3/services/network` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.250012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.250124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.259064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.260010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.260504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.261000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.261990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.262498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.264061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:08.274718 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:08.275747 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:08.276601 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:08.280972 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 344/713] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.281093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 369/713] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:08.289706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.289867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.404666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983463bd-2c7c-4d5e-b4f5-21f4880a234e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.432533 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.448058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.449631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.450336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.451044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.462011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.463743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8043f7d-3c4c-4746-a0ee-89a632a2700c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.463989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:08.485322 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:08.486520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:08.487626 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:08.494864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 345/714] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:08.496225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.501342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.501983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.502269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.502548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.503279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.503586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.504982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.517703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 370/715] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.517703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.593606 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.696216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdecbb4-f6d0-4442-ad82-c8bf288df1a9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.706299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bce94-917a-4706-9722-c84b82144856 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.739100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.739926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.740794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.741164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.742469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] RBAC: Adding query filter params (name=network) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.742860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.744380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.749923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 346/716] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.759545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.786760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.788458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.788907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.789187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.790134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.790440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.792162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.802015 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.805419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 371/717] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:08.811446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:08.927792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4bc7-ebbc-4ed7-b407-38336d0134b4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.946922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec2b2f-6bfb-4c67-a888-be83f2618c8c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:08.966188 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:08.988440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:08.989110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:08.989416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:08.989706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:08.990692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:08.990998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:08.992427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74493bf-302e-4f8a-b570-4a72196d96cc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:08.999348 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 372/718] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.021587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.022289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.022568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.022842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.023568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] RBAC: Adding query filter params (type=network) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.023871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.025404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9ea7c-f276-4b40-a1e5-1c2d365fd00c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.038011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 347/719] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.254297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f090-3ea1-4a68-80d2-aa54c06a4d74 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.254635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f090-3ea1-4a68-80d2-aa54c06a4d74 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.254841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855f090-3ea1-4a68-80d2-aa54c06a4d74 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.256468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 373/720] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:09.262640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.262927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.263197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.285202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:09.286439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:09.373448 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 348/721] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:09.398096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855f090-3ea1-4a68-80d2-aa54c06a4d74 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.479183 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.529990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855f090-3ea1-4a68-80d2-aa54c06a4d74 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.591950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.593404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.593986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.594493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.622216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:09.641920 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:09.642957 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:09.643790 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:09.644432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 374/722] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:09.651952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:09.858683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08933c-bf3e-493b-813f-abe522e3a25b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:09.861473 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:09.925900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:09.927025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:09.927457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:09.928088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:09.929303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:09.929850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:09.932413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30056b2-5e44-4833-bc44-1dcf8663e11b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:09.949120 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 349/723] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:09.960547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.102167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758783-4bf4-48e7-a9c6-fa89c68d1c0c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.102842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758783-4bf4-48e7-a9c6-fa89c68d1c0c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.103337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758783-4bf4-48e7-a9c6-fa89c68d1c0c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.104945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 350/724] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:10.121856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.122145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.122421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.160084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:10.161343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:10.180702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8886651-a7da-46dd-af67-d094eeca253e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.235890 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.262356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.263193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.263474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.263750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.296855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.298390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:10.342371 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.343378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.344246 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:10.344246 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:10.344246 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:10.344246 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:10.344246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 375/725] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:10.346274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 351/726] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:53:10.351169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.390826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.488879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2f0f7-b479-4926-9816-17f8515aa6ff None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.537787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.538961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.539409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.540001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.541037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:10.541507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.543093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.560343 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 376/727] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:10.571268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.620221 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.674276 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:10.690810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3f23c-ad9c-48d7-9a25-2bab77e535dd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.748344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec769-9ac4-45d3-aca7-e92cc1c3010d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:10.764208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.765444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.767010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.767010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.792317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:10.800457 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.801648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:10.803219 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:10.815499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 352/728] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:10.823445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:10.837708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:10.837708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:10.837708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:10.837708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:10.847675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:10.849141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:10.879650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:10.882742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:10.884565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 377/729] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:10.889096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.003455 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.006773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9470e-4957-4ddb-a6fb-3546059f2448 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.047565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.048506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.048963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.049382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.050417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.050867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.052493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.073423 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 378/730] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:11.078889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.126609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76e6a-7745-43bb-98ca-3d1cada5664e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.197705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0155e8-91e0-46e8-89e3-5cfb1d48942b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.208552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.209801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.210419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.210843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.211807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.212277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.213877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54a60-0dd2-4a4a-8b82-67661843e068 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.240333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 353/731] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:11.242241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4462-8c9d-4ef1-aebd-e2304c83fb85 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.242737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4462-8c9d-4ef1-aebd-e2304c83fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.243194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4462-8c9d-4ef1-aebd-e2304c83fb85 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.249145 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 354/732] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:11.250444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca4462-8c9d-4ef1-aebd-e2304c83fb85 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.256374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.256931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.257207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.257479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.273122 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.287868 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.340121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.342013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe221-505d-4b65-9cd9-78fa10ae9661 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.381508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca4462-8c9d-4ef1-aebd-e2304c83fb85 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.422268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.423427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.423894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.424342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.438050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.440067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:11.460834 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.462037 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.463052 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:11.463052 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:11.463052 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.463052 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:11.463275 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 379/733] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:53:11.463436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.463731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.464003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.465402 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 355/734] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.472359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.483072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:11.484411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:11.542917 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.562667 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.564987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 380/735] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:11.566328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.608093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42e63-87e2-4646-a335-f08b148310d9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.655436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.656507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.657026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.657524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.673103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.674975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.687470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91e3c-b467-4d79-b7a2-f247bba64493 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:11.696929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:11.697920 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:11.698818 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:11.698818 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:11.698818 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:11.698818 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:11.705916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 356/736] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:11.707334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.738098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.738778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.739089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.739330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.740086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.741400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.743000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.760581 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 381/737] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:11.760581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.811686 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.836575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e5b17-a6e9-492a-9ba0-3506c5a78001 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.861641 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:11.877430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f3f5-04b5-4d39-8d2a-f117c08bccea None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:11.878657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.879346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.879655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.879892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.881370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.883009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5040d2-42b4-4db9-b35d-fe46c4d9dea7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.899958 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 357/738] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:11 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:11.901730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd37ff-9fdf-4537-b30a-f5242ac33224 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.902034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd37ff-9fdf-4537-b30a-f5242ac33224 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.902290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd37ff-9fdf-4537-b30a-f5242ac33224 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.903706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 358/739] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:11.909256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd37ff-9fdf-4537-b30a-f5242ac33224 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:11.952419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:11.953461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.954330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.955875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:11.958319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:11.958893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:11.963662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df519a7-3860-466a-89b1-a6e09ec5a166 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:11.985719 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 382/740] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:11.985719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:11.985719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:11.985719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.008959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:12.010409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:12.064668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd37ff-9fdf-4537-b30a-f5242ac33224 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.110189 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 383/741] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:12.111549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.131868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.132704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.132974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.133248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.146167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.148728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.159460 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-ce891ab4-45ee-4b4b-be08-431b68961fa0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:12.167007 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:12.168746 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 359/742] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9df618-aac6-42da-9927-f59a45e0be44 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.170998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9df618-aac6-42da-9927-f59a45e0be44 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.175169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9df618-aac6-42da-9927-f59a45e0be44 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.175169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 360/743] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:12.175169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9df618-aac6-42da-9927-f59a45e0be44 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.229211 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.268624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187f25-8c51-4f64-a354-213fbf7ba2b5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.307870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.308674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.308957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.309233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.317363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.319639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:12.335417 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:12.337274 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:12.339230 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:12.341812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 384/744] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:12.342832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.344123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9df618-aac6-42da-9927-f59a45e0be44 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.394369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.395180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.395559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.395788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.409875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8c3af63c-b6ba-46fe-a409-2c64fc91a276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:12.418982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:12.420734 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 361/745] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:12.422329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.423650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.423650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.440980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:12.442238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:12.471122 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.486571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409960aa-ff12-47d9-87f4-f04bd70fba59 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.530078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 362/746] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:53:12.530953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.539235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.539919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.540192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.540463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.541314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.541623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.544200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.575228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 385/747] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.575990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.596449 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.701628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d63b5a-f262-414a-8301-789ec020f6c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.720509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c70b-e812-4f4e-9b10-8767ca562416 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.748575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.749364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.749733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.750067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.751117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.751478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.753217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.767262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.768300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.768760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.769209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.770074 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 363/748] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.770432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:12.770914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.772052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.773409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.791721 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 386/749] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:12.792705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:12.807380 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.900907 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:12.912288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5529-564b-40bf-bed7-e92dd55474b2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.948135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f095d-71b9-428f-b0a5-a30d0ecd052f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:12.951459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:12.952445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:12.952720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:12.952992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:12.953758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:12.955316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:12.981709 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 364/750] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:12 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:12.981709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.032390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.033293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.033771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.034253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.165587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.168274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.183813 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.201572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba9ce9-c408-4f4e-a75e-e03344992c94 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.265089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.266274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.266883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.267228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.269049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=588446ab55aa4942b399ca411380e13a) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.269560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.273001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.283692 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 365/751] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/role_assignments?user.id=588446ab55aa4942b399ca411380e13a&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:13.284562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.305533 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.343988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 387/752] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:13.351550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.425883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d789-c81b-4ce2-9bea-9066482ea2c0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.469832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.471068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.471595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.472071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.477352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf669a4-c525-490d-b1b5-f034b30469fe None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.485302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.487187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.494205 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:13.508437 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.509360 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.510255 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:13.510255 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:13.510255 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.510255 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:13.512859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 366/753] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.523242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.542087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.542900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.543183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.543465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.556625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.558168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:13.579169 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.580092 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.580958 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:13.580958 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:13.580958 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:13.580958 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:13.580958 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 388/754] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.587351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.676647 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.712619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d45f0-6cf0-43cf-8afc-5f69e1aa3292 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.720859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbf76a-7d9b-44cf-a3f1-bb7ae8a273c7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.752681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.753317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.753601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.753923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.754642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.754946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.757575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.762102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.763059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.763534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.764054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.765007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:13.765510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.767118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.770299 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 389/755] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:13.777088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.783124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 367/756] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:13.792075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:13.804976 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:13.899167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffe6f0-6e38-4329-8e3e-49ff3f7068a0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:13.937099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:13.937861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:13.938151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:13.938432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:13.947213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:13.948694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:13.965646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:13.968069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:13.970036 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 390/757] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:13.977700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.066986 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.072054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82f4d2-7641-4757-818f-2e70bbc37058 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.101714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873f521-7f63-4eab-942f-29f13cc040cb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.150675 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.161535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.163774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.164073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.164363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.165199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.165507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.167032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.172231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.173073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.173353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.173637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.192931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.195694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.206937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 391/758] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.214394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:14.235634 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:14.239639 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:14.246803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:14.248400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 368/759] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:14.256388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.447613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b356-0c97-481c-832e-b4302b6a2525 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.487539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165263d2-6a84-421d-ae72-644a0a3537da None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.502464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.503152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.503436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.503715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.504568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=fdc4ad8dc59b4974a08e687a78764471) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.504874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.507214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.513736 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 392/760] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/role_assignments?user.id=fdc4ad8dc59b4974a08e687a78764471&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:14.547376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.548101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.548364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.548640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.549533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.549871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.551380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472aba9-4b41-4840-8b84-faabad1d43b0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.588324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 369/761] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:14.594350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.601400 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.653819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783da1-a52b-4ce9-8ca8-379c5319830d None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.654856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783da1-a52b-4ce9-8ca8-379c5319830d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.655566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783da1-a52b-4ce9-8ca8-379c5319830d None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.659183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 370/762] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:14.668163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.668982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.669897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.727701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:14.730533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:14.738753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a968e-87be-4788-a284-0c05beabf7c9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.779736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.780649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.781006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.781356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.794411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.796064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:14.815997 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:14.818928 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:14.820686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:14.820686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:14.820686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:14.820686 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:14.820686 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 393/763] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:14.826436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.843180 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.898246 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:14.932745 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 371/764] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:14.945477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d90ad-452b-4dad-8fb0-8182a18e2129 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:14.967721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:14.984498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:14.985055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:14.985338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:14.989503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:14.989503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:14.989503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:14.989503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.006268 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 394/765] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.018751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.120489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7be9-7cd0-4294-97e5-ee40d0efa94a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.161016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.162407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.162680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.162950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.163640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.165694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.181438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.183318 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:15.185008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 372/766] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.190550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.274808 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.357831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e469-6369-4cf1-bcb2-888d4ac880df None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.387806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f62e0-f297-4fe8-97d6-c1377040dc6f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.412684 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.422384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.424041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.424794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.425509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.427015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.428424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.437218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.445713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.445713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.445713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.445713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.450467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.452129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.455958 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 373/767] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:15.464615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:15.474501 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:15.476228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:15.477960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 395/768] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:15.485708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.650008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622d9f-e999-47a6-9099-e85e6a47c3f2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.718684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.719763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.720221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.720684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.722142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.722662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.725908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.738162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a86fb-5567-4bc3-aa20-036d11254f12 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.743798 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.783771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 396/769] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:15.790371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.847161 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:15.851100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.852259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.852745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.853224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.854561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:15.855102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.857741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.879313 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 374/770] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:15.881828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:15.929786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaefac-4eb4-46d9-8193-c209fdded7c4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:15.968804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:15.969792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.970074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.970348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:15.972355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=301e817770344ea89321aa8d85756547, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:15.973867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0642d9-abc1-4356-baf2-e2a6364da23e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:15.990870 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 397/771] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:15 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:15.998919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7848-a7fd-4146-934d-23d6b76ab988 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:15.999415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7848-a7fd-4146-934d-23d6b76ab988 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:15.999902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a7848-a7fd-4146-934d-23d6b76ab988 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.002717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 398/772] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:16.019327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.019778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.020206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.078958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:16.080647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:16.132494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f164-acee-4ef0-9574-adec4808fc9e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.217461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.218150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.218433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.218704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.219649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] RBAC: Adding query filter params (interface=public, service_id=2343d94a124346dfbf008fb819c4d944, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:16.220022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.221005 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 399/773] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:16.222654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.242812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 375/774] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:15 2022] GET /identity/v3/endpoints?service_id=2343d94a124346dfbf008fb819c4d944&interface=public®ion_id=RegionOne => generated 194 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.252193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.266182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.302183 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.334663 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.468538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1851c2-8c8d-4fb2-a42a-3695e360b2fe None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.506560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbc39d-bde6-41c0-9de8-c33fe9d43c3c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.551817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.552625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.552902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.553175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.553905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.554242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.555285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdb01b-fba1-4700-abc9-336ac21844ae None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.556225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.558071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.558865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] PATH_INFO: `/v3/services/network` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.560711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.562271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 400/775] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/services => generated 772 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.569709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8ca1-8ea3-456d-b096-8b4e107911f0 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.569709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8ca1-8ea3-456d-b096-8b4e107911f0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.569709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c8ca1-8ea3-456d-b096-8b4e107911f0 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.570235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 401/776] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:16.571042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.573136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.573423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.573853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.594003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:16.595431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:16.603464 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:16.605449 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:16.607160 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:16.610887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 376/777] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:16.617186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.821754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 402/778] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:16.848464 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.857780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0592-656a-42bd-9e4b-295f3d6e857e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:16.861272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:16.901477 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:16.907262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:16.908291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:16.909603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:16.910230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:16.911358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:16.911917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:16.914015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:16.921013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 377/779] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:16.930206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.077442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81233567-ca12-43c7-ae78-31ca95b7ba00 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.155546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647699-6053-4876-aa54-34758babef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.156898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647699-6053-4876-aa54-34758babef43 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.157380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647699-6053-4876-aa54-34758babef43 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.157904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92647699-6053-4876-aa54-34758babef43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.201610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92647699-6053-4876-aa54-34758babef43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-92647699-6053-4876-aa54-34758babef43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:17.210108 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:17.211119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:17.211930 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:17.231724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ebd3e-e9a9-4b13-b2e8-be1f16debff9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.234686 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 403/780] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:17.236308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647699-6053-4876-aa54-34758babef43 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.322300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.323380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.323903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.324382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.325323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.325931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.327601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.341694 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 378/781] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.368550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.422076 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.428081 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.470439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92647699-6053-4876-aa54-34758babef43 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.545763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.548462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.551657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.552988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.556666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.558704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.561439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.601286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 404/782] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:17.622997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.650972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827bc9-d01a-48ae-987c-18d5c68694c1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.727455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.728944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.729757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.730530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.732391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] RBAC: Adding query filter params (interface=public, service_id=9fa6633423c74bca82a7271dd042f145, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:17.733311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.741701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.761710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 379/783] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/endpoints?service_id=9fa6633423c74bca82a7271dd042f145&interface=public®ion_id=RegionOne => generated 194 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:17.764228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:17.781332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f87b39-2e63-45e9-8180-b0b48bca8855 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:17.857999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:17.858720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.859027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.859299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.875799 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.879902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:17.883231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-01785025-af43-4c4b-baba-bee61e4fb801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:17.909226 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:17.911420 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 405/784] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcd4f-66d7-41ca-a560-1eef6d92ccf1 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcd4f-66d7-41ca-a560-1eef6d92ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.913826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcd4f-66d7-41ca-a560-1eef6d92ccf1 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.915303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 406/785] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:17.924655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:17.925526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:17.926309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:17.957432 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:17.963290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:17.965797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:17.986937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83184e8a-f474-4747-ba69-5e446ca4fa1b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.049751 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 407/786] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:18.050101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.050984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.051217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.051651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.052105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.062215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.064876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.086090 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 380/787] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:17 2022] GET /identity/v3/services => generated 772 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.109327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.170730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc67c97-04ef-468e-9739-90b013816a8a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.201320 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.229884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.230733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.231022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.231297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.232064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.232372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.237951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.260169 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 408/788] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.268166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.337585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e0e85-6404-4cdf-a8e9-1693aac0c93f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.399106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.399838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.400114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.400386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.413167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:18.421059 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.422104 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:18.422923 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:18.424061 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 381/789] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:18.434480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.460476 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.484961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e873e-cb22-4210-9162-e8baaeb5e2cb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.524922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.526258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.526783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.527374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.536175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.538739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e2949c4b-2397-4acc-bb20-51b77535c98e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:18.559008 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:18.560537 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:18.561457 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:18.565501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 409/790] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:18.567288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257458f-bb27-46c4-8e78-b2389c0fe177 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.568645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257458f-bb27-46c4-8e78-b2389c0fe177 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.569449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257458f-bb27-46c4-8e78-b2389c0fe177 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.572182 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 410/791] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:18.578709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257458f-bb27-46c4-8e78-b2389c0fe177 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.634576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f84d-6382-4613-8657-4dd0f3d2a49f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.644261 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.688565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.689841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.693380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.694275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.695361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.695882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.697706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e654024-7ff5-4935-9209-1ea3b2aa6329 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.709724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 382/792] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.711496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.712000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.712501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.740725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:18.742505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:18.780493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257458f-bb27-46c4-8e78-b2389c0fe177 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:18.826151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:18.826892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:18.827187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:18.827465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:18.828401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:18.828707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:18.830253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:18.851188 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 411/793] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:18.852114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.860786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 383/794] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:18.862500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:18.870053 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.963178 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:18.966516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dcda8-6f80-4a96-b051-5d43b0ed7592 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.005746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.006939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.007227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.007509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.019694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.021934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:19.042097 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.043049 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.043925 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:19.043925 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:19.043925 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.043925 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:19.043925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 412/795] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.044661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.068177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616666a-68cb-4e63-9949-898c9774fec4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.135729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.145703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.145703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.145703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.158524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.161414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.167585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612e792-64a6-4eb4-92b8-3785aba0ae37 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:19.196407 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.197357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.198271 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:19.198271 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:19.198271 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.198271 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:19.198931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 384/796] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.200342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.207441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.208318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.209159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.209603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.222082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:19.230543 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.233037 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 413/797] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.235069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.250870 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.306880 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.349941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265093ed-0ebb-4ef6-bd2e-e8bf6a5621d0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.388461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.389389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.389534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4640e-4180-41f6-95b2-efaa3d731697 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.389982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.390407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.391304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:19.391767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.393614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.407852 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 414/798] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:19.409048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.455045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.456121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.456623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.457118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.458792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:19.459319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.462176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.493002 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 385/799] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:19.494592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.496507 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.526060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2940a8-b10a-4753-864d-ab4666831816 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.565751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.566550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.566746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.566985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.568301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:19.568778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.570409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.582183 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 415/800] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:19.582183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.679109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179686f-5219-41bb-99be-7355ad6186cb None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.694458 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.709785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ed4ee-bae7-4779-8cd2-fce9595871cc None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.718245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.719058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.719343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.719619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.728375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.729891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8f680bb7-ec98-483a-850b-0dc16d32a189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:19.745975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.747612 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 386/801] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf9d8-71db-4aeb-a607-ef8c507293c0 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.749232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf9d8-71db-4aeb-a607-ef8c507293c0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.750456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbf9d8-71db-4aeb-a607-ef8c507293c0 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.751350 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 387/802] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:19.751618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbf9d8-71db-4aeb-a607-ef8c507293c0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.772434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.773209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.773567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.773881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.776359 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:19.785022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.786653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:19.802032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.811276 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 416/803] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.812204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:19.886410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbf9d8-71db-4aeb-a607-ef8c507293c0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.925312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:19.926180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.926466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.926759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.939718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:19.941409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d4d9576e-7f03-4191-b29f-43e3a86f5f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:19.963487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:19.964441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:19.965296 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:19.965296 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:19.965296 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:19.965296 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:19.967152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1f96a-9fa9-4513-86ac-cfd845da7ae3 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:19.969871 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 388/804] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:19.971552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:19.972828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:19.972828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:19.992520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:19.993985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:20.019392 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.035903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.036877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.037326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.037782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.038852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.039312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.041185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.066367 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 417/805] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.066367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.093765 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 389/806] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:20.094636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.165983 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.220843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2b10-dbe7-42c6-b85c-991c1f560ad1 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.259989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.260667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.260945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.261214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.262088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.262388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.263818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.268294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77375e0-76e0-4cfd-84e0-dde0b94e13ce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.282719 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 418/807] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.283766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.322313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.323299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.323565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.323842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.324589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.324893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.326378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.350344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 390/808] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:20.351510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.385915 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.447895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e3e14-97ca-400f-ae51-e5bb9d46ba46 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.471799 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.509382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.511072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.511718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.512365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/588446ab55aa4942b399ca411380e13a/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.524828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfefdf-7d55-49f6-bbef-2954b3b06da0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.536996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=588446ab55aa4942b399ca411380e13a, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.540087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.555931 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 419/809] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:20 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/588446ab55aa4942b399ca411380e13a/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:20.559816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.578382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.580354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.581020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.581765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.583258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.586251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.607687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.608816 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:20.609648 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 391/810] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.611677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.694199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91daa6-60df-49ee-b987-2d139e886de4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.732447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.733261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.733560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.733860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.747536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.749252 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.749637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b237e0fc-8d1f-4f9e-9d2e-1b1e39ccc07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:20.771719 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.772721 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.773605 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:20.773605 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:20.773605 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:20.773605 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:20.773605 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 420/811] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.774527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787dd1-ce3b-4cb0-93c9-b82e4ee02cb0 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.774831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787dd1-ce3b-4cb0-93c9-b82e4ee02cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.775117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787dd1-ce3b-4cb0-93c9-b82e4ee02cb0 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.780925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 421/812] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:20.780925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4787dd1-ce3b-4cb0-93c9-b82e4ee02cb0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.786555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac45ac0-9595-49f7-b813-8c533b761182 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.811206 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:20.842927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.843766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.844050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.844326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.854878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.856699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:20.871936 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:20.873718 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:20.875487 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 392/813] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:20.877574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:20.936478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4787dd1-ce3b-4cb0-93c9-b82e4ee02cb0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:20.987417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:20.988401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:20.988881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:20.989368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:20.991315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:20.991842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:20.994421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693d4c8-7fe1-464c-95b0-0f9b9aeb0ade None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.001410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963226c-39cf-4f6e-8574-eb3cf148eb89 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.007840 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 422/814] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.007840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678037-f76a-4800-a509-143a2c005576 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.007840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678037-f76a-4800-a509-143a2c005576 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.007840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678037-f76a-4800-a509-143a2c005576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.035048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-18678037-f76a-4800-a509-143a2c005576 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:21.037711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-18678037-f76a-4800-a509-143a2c005576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:21.044597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.045262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.045549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.045860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.046596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.046901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.048273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.060487 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.064785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 393/815] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.065840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.134995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 423/816] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:21.136315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678037-f76a-4800-a509-143a2c005576 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.157588 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.230365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dea33e-fa3f-449a-8b14-1e287c1b38ab None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.287651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.288723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.289185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.289653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.291184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.291731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.294256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.321888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678037-f76a-4800-a509-143a2c005576 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.324512 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 394/817] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.325574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.382237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.382890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.383170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.383439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.384157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.384480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.385886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.391087 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 424/818] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.391902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.435451 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.471195 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.505921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459a3b3-ac0d-4bdd-89c9-b35593d2b47b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.506860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d0ce6-e48c-41c8-a2cb-0fd2d8cee4ac None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.544923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.545752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.546033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.546306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.548030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.548953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.549302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.549619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] PATH_INFO: `/v3/services/network` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.550493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.552748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.554645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.556377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:21.569074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:21.570341 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:53:21.571268 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:21.572047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:21.572812 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:21.574438 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:21.575668 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 425/819] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:21.576610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.577141 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 395/820] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:21.577816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.687798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ccbf-4828-414f-a205-b4d40fa7e00a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.691621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280338dc-3d85-45c2-b360-566875dc8316 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.712081 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.726666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.727666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.727666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.727879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.732769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:21.734001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.734572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.734892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.735258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.736078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.737515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.769707 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 396/821] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:21.769707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.843026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.844446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.908895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a754-dd34-4173-bfa0-1599ae4efece None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:21.959832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:21.960773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:21.961056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:21.961324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:21.962108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] RBAC: Adding query filter params (name=network) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:21.962414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:21.963835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:21.968748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 426/822] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:21.968748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:21.970254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 397/823] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:21.971300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.012035 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.015241 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.100377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998fe3f-b371-4504-b9ad-c0d3b84e8e36 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.106803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe177c7-3f47-4828-a509-36385c1ee650 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.151755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.152823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.153084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.153447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.153907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.154207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.154607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.154980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.155384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.155975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.158047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.169358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.171035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.190332 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 427/824] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:22.191376 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:22.193371 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 398/825] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:22.203343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.204926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.328620 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.330030 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.340815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0b89-3e97-4730-aaef-7d3b03c5177d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.349397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e515c5-be53-4638-be2c-27a6d5ff3533 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.388534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.389569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.389899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.390182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/fdc4ad8dc59b4974a08e687a78764471/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.392815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=fdc4ad8dc59b4974a08e687a78764471, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.393247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.394201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.394425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.394899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.395392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.396925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.397908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.400723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.407673 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 428/826] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:22.408712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.411549 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 399/827] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:22 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/fdc4ad8dc59b4974a08e687a78764471/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:22.414041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.558458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9934-86d3-442c-899a-2c3463e4e1e3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.603270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.604398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.604896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.605390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.606418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.608369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.610297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a1c4-e6ac-4ab7-ac37-6a2e7bac47e2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:22.638007 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 400/828] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:22.686193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:22.687245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.687706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.688138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.689087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:22.689639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:22.691350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e863-3ef7-40f0-a2fe-87d040c9e3ca None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:22.711117 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 429/829] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:22.714874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:22.718845 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.898057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bd445-5776-4f1b-b9a8-5141467fef69 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.898819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bd445-5776-4f1b-b9a8-5141467fef69 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.898819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bd445-5776-4f1b-b9a8-5141467fef69 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.900269 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 430/830] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:22.906151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:22.906459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:22.906702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:22.926765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:22.928570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:22.944613 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:22.986522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aee12e-8247-4a9d-928e-93f7cb72a3f2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.015875 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 431/831] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:23.031642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.032462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.032746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.033017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.041644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.042221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.043164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:23.070956 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:23.071882 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:23.072745 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:23.077029 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 401/832] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:23.079497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.171778 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.212974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b0e29-a573-485e-82cb-c6af4de9b3c5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.226273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068c23d-efc9-4bef-a9a3-6af383d919fe None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.265826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.266591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.266715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.266954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.267179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.268207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.268687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.269158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.270269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:23.270874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.272942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.279474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:23.287755 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 402/833] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:23.292378 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:23.293556 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:23.294631 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 432/834] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:23.296943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.297062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.310047 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.404644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d8b00-677c-4307-add7-7fdb0e19d708 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.439406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae178d-b2e2-4447-b702-a49bd23bb23b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.441934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.444024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.444309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.444580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.445357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:23.445661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.447089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.458814 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 433/835] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:23.464111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:23.475897 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.536319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.536319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.536319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.536319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.536806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:23.536806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.536806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.544791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 403/836] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:23.581632 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:23.808876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b56d-6e72-4215-901c-37ee6e6183e6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:23.848148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:23.849054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:23.849383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:23.850701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:23.864095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:23.866198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1a9b11b5-8d66-4bc9-8dbb-1143e1e41563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:23.888376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:23.889415 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:23.890965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:23.890965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:23.890965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:23.890965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:23.890965 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 434/837] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:23.895503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.084604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c016f-5671-48fc-aa0a-c925b293e6d9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.122547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.123322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.123635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.123942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.124699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:24.125030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.126527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.127403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e681-19e0-495c-82b6-c8d936e0a711 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.128212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e681-19e0-495c-82b6-c8d936e0a711 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.128690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e681-19e0-495c-82b6-c8d936e0a711 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.135097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 435/838] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:24.137275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.137803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.138284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.141123 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 404/839] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:24.146622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.156574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:24.158138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:24.201893 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.250438 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 436/840] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:24.272253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c5336-fb82-4bae-bac9-96110a21408f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.273304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.321343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.322284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.322566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.322877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.331379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.332862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.349872 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:24.352108 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:24.353041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:24.355010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 405/841] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:24.359426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.432645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf71b09-95cb-43af-b7a3-12b76baa6a0f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.469368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.470197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.470477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.470750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.471412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.472949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:24.485497 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:24.486645 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:24.487480 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:24.492329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 437/842] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:24.493583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.493847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8047e-7163-43d0-a9f7-f548903739f9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.503981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.534854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.535549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.535826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.536095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.537600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:24.537871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.539499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.565213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 406/843] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:24.566207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.639615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4a1ad-69dd-4173-8078-2b1c0de4f7eb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.659123 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.681529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.682243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.682524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.682799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.683512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:24.683805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.685240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.695463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 438/844] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:24.696414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.703870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f34ca-1396-4111-a827-3e0341bcdc60 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.744849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.746027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.746520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.747041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.785175 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:24.803297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9a13-f5ab-4224-aae1-012b28e3bccb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:24.833903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.835903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.842835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:24.843501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.843780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.844052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.844768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:24.845069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:24.846834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dea165-2864-46e0-9eca-647065c93028 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:24.855796 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 439/845] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:24.878085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895396-a02f-4ad0-839b-a8aba9602fce None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.878404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895396-a02f-4ad0-839b-a8aba9602fce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.878649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895396-a02f-4ad0-839b-a8aba9602fce None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.885077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 440/846] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:24.886640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:24.886864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:24.887128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:24.905040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:24.906231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:24.966020 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 407/847] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:24.971486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:24.974690 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.015478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 441/848] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:25.040752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.066105 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.113320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bed3-3f4b-4302-81db-e7f095a4695b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.162918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.163841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.164145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.164515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.176672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.178967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.199419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f81d28-5350-43a0-87fe-f5f88f695754 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:25.199950 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.200863 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.201753 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:25.201753 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:25.201753 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:25.201753 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:25.206249 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 408/849] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:25.207439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.254837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.256446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.256916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.257371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.273810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:25.285487 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.287076 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:25.287973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:25.291137 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 442/850] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:25.296229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.337818 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.346283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3ca04-5579-4142-aab4-46e7a1a41f2a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.372855 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.398106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.398785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.399067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.399343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.400083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.400385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.401815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.417946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0a09-7c39-4c65-ae9d-09831c73023c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.420439 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 409/851] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.421459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.466989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.467685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.467972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.468248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.469401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.469740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.471750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.483933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 443/852] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.489601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.542350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b323-b260-449c-aa6a-bd14a6ac2b46 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.579629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.580429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.580706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.580975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.589099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.590639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:25.606906 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.608540 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:25.610212 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 410/853] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:25.614014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.631540 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.645841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3867bf4-e86f-40c9-8e0c-03550896360f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.655504 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:25.705604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.707151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.707602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.708068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.727791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.729264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:25.752658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:25.753631 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:25.754623 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:25.754623 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:25.754623 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:25.754623 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:25.757461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 444/854] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:25.766457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.779224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a153-afde-4bdc-91ec-878d434fb34f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.841969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.843099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.843614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.844207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.845836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.846390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.849821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.882443 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 411/855] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:25.887315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9390d-e17c-4c11-a093-61cb4b7af489 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:25.887605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.921533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:25.922650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:25.923199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:25.923700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:25.924633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:25.925142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:25.927383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:25.941124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 445/856] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:25.949634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:25.959994 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.048041 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.056997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52afa8d-7c15-4389-a702-c9165dbef342 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.094759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.095508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.095866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.096209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.097123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=588446ab55aa4942b399ca411380e13a) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.097504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.099312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2870ba-50b4-4d7c-b7ed-8dec738a17e5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.113260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 412/857] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/role_assignments?user.id=588446ab55aa4942b399ca411380e13a&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.113260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6fecd-c791-45e6-9778-115277254dc4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.113260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6fecd-c791-45e6-9778-115277254dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.113260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6fecd-c791-45e6-9778-115277254dc4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.113260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 413/858] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:26.116876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.117357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.117902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.129121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e6d4-ea27-43d4-af9f-605c24790305 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.153274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:26.155900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:26.171973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.173111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.173611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.174240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.183198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.184707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:26.201702 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:26.204340 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:26.208410 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 446/859] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:26.211112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.315469 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 414/860] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:26.321018 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.351331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.376105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd2703-75f5-4d45-8d2c-5fd7e7a54f72 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.438608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.439857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.440143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.440729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.441859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.442180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.445473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.471869 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 447/861] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.477469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.483906 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.496373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28c3f-d519-4910-89cf-0a852aac275a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.536718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.537203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.537362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.537644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.538390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.539768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:26.553414 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:26.555939 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:26.557878 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 415/862] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:26.560541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.670374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68d72-539e-483c-83f5-f91b29424e06 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.697960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc4e75-3a7d-4b8e-9af0-bfd8111de477 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.707699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.709056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.709319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.709745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.710549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.710917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.712426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.718430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 416/863] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:26.724220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:26.747061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.763654 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:26.766389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.767801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.769495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.771867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.881037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.883180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ba519-138c-4a6f-8825-bcf83163ee2f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.894799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7d258-c8de-4c83-a341-4e9782cae894 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:26.970584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:26.971257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:26.971536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:26.971809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:26.972533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:26.972834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:26.975137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:26.982426 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 417/864] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:27.012048 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 448/865] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:27.021376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.055024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e551-691d-4283-8c97-2e89998ae031 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.055668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e551-691d-4283-8c97-2e89998ae031 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.056164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e551-691d-4283-8c97-2e89998ae031 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.058187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 449/866] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:27.064404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.064962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.065426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.096595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:27.099704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:27.138607 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.173989 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.198357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c298-d2a6-4eaf-bfa6-736e1a069977 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.235887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 450/867] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:27.257036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.257890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.259156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.261233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.261592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.275872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.278855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:27.314949 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:27.315907 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:27.316774 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:27.316774 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:27.316774 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:27.316774 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:27.318268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 418/868] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:27.323781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.395761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e893044-6ed3-4784-9819-f2d6a722f136 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.444309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.444564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85c4ab-67a3-40dd-bf5c-bdab95fb2349 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.445413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.445872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.446321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.447557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.450292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.470878 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 451/869] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:27 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:27.523538 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.540662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.541947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.542535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.543098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.544687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:27.545238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.548344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.575940 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 419/870] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:27.586035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:27.618719 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:27.795222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce473d22-7c71-4902-a2c3-1d3ac0ccef5d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:27.850813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:27.852045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:27.852583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:27.853058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:27.861384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:27.863218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:27.880332 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:27.881807 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:27.882672 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:27.885285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 452/871] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:27.895158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.103232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfce9a2-b176-4dd1-9cfa-c2fce66ebe80 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.162757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.163447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.163756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.164004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.164817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:28.165124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.166648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6fd4e-0cc3-43ab-81c1-8bdf3152c594 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.180745 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 420/872] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:28.191937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.345052 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.396066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161562-81ae-4680-bea7-82fc542979bc None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.461019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.462869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.463749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.464544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.466927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=fdc4ad8dc59b4974a08e687a78764471) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:28.467862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:28.471127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004b99-023d-49b9-9f30-8136bbfb31a1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:28.485182 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 453/873] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/role_assignments?user.id=fdc4ad8dc59b4974a08e687a78764471&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:28.503319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d4ec5-95b3-4bc4-8ae5-a521d5461ec7 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.503634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d4ec5-95b3-4bc4-8ae5-a521d5461ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.503973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d4ec5-95b3-4bc4-8ae5-a521d5461ec7 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.506325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 421/874] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:28.512514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.512784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.513111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.532309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:28.533595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:28.615739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 454/875] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:28.640450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d4ec5-95b3-4bc4-8ae5-a521d5461ec7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:28.744639 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:28.850624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d4ec5-95b3-4bc4-8ae5-a521d5461ec7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:28.916060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:28.917505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:28.918053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:28.918566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:28.939200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:28.956621 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:28.957595 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:28.959000 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:28.960194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 422/876] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:28.965608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.038934 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.109944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff9f1-5869-4699-b2fa-3c75f6e4effc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.169006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.169700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.169994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.170447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.171235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.171543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.172930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a822-d27f-4647-97c5-39b0027826b8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.183691 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 455/877] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:29.189037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.302724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d154883-bd99-4c62-a11e-74eb99a6df88 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.303966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730fd5-6278-400c-8412-33929ad78915 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.304262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730fd5-6278-400c-8412-33929ad78915 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.304546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab730fd5-6278-400c-8412-33929ad78915 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.306291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 456/878] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:29.311893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.312501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.313008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.314941 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.333843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:29.336173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:29.340585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.341722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.342007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.342281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.361699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.361699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:29.384006 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.385008 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.386408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:29.386408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:29.386408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:29.386408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:29.386408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 423/879] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:29.391121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.427400 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 457/880] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:29.450882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.511257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd975bc-99a4-43d6-b533-63c894952464 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.517527 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.547293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.548001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.548281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.548556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.549293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:29.549597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.551006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.564274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b635d6b-ced6-49ac-8ff0-14db8043fcac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.569341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 424/881] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:29.570337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.597101 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.606019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.607156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.607608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.608099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.609037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.610960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.636873 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 458/882] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:29.691178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5e76-b884-47a2-a761-a30eda977c75 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.742134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:29.742959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.743235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.743505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.751965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:29.753454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1aba65a4-d424-43be-a400-85f842fb0909 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:29.770841 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:29.772105 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:29.773321 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 425/883] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:29.778461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:29.877548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e720b-de0b-4fe7-8b61-3018c45e7075 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.877851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e720b-de0b-4fe7-8b61-3018c45e7075 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.878073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e720b-de0b-4fe7-8b61-3018c45e7075 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.880234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 426/884] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:29.885628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:29.885967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:29.886208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:29.904982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:29.906212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:29.925238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591592-1afe-4b75-b86b-25d727902850 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:29.979958 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:29.985297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 427/885] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:30.002191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.003313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.003780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.004245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.006598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.007132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.009149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.009979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.046059 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.058210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 459/886] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.065267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.147423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b8af-40e2-498e-8249-7a481465195c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.194828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.196990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.197457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.198210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.199067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.201467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.207462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d69807-e3b6-4ee6-924f-d42b865e3c6f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:30.216356 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:30.217653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:30.218503 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:30.221962 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 428/887] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:30.229436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.256962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.257733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.258021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.258296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.314350 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.342497 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.349512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.351700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.402117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767599-80d4-4d52-bfbd-a620cadf0257 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.440705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.441381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.441664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.441987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.442797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.443272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.444795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.456441 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 429/888] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.459245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.496634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 460/889] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:30.497868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.575255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138da800-83d8-42ff-8181-056356c637f0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.585060 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.610498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff617-0590-46a2-8660-c75c0f39893b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.614785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.615725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.616221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.616719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.617650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.618198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.619973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.622556 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.633490 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 430/890] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.634773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.650008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.650886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.651084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.651362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.663602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.665003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:30.684778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:30.685782 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:30.686649 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:30.686649 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:30.686649 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:30.686649 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:30.691039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 461/891] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:30.691970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.752040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70506fe-2467-47d7-a81e-86761320285c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.789305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.790420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.790924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.791473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.792609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] RBAC: Adding query filter params (interface=public, service_id=9e2dd96a60384008ae356e235b33bfbd, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.793175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.794816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.800749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 431/892] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/endpoints?service_id=9e2dd96a60384008ae356e235b33bfbd&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.802697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c64-4250-496d-9248-116a3223ae0b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.807564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.857325 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.870536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.872232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.873057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.873917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.875815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:30.876730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.880500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.886836 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:30.913814 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 462/893] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:30.919240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:30.931358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf366-1225-4d82-90ee-0467e15874a3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:30.968804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:30.969514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:30.969831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:30.970068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:30.970755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:30.972169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:30.989716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 432/894] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:31.087415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dfb39-c488-4471-9a47-9a9a823051f2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:31.137450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:31.138417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.138688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.138955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.149719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:31.152365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:31.181549 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:31.183369 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:31.185124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 463/895] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:31.198336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:31.317330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f15b-efae-4666-8233-1062cd14f08e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:31.347285 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:31.357019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:31.358230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.359185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.359464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.360222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:31.360526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:31.362013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480a9b2-f39f-4b05-963f-f55204e87e47 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:31.375419 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 433/896] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:31.386577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:31.488598 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:31.587910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074b35-ca3f-4c1e-aca4-f7b8d8bc0094 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:31.601038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9f88-95ff-4779-85a9-3038bb8b35fa None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.601718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9f88-95ff-4779-85a9-3038bb8b35fa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.602525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9f88-95ff-4779-85a9-3038bb8b35fa None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.604771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 434/897] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:31.611277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dde30-d28d-4da9-b4df-e7054e0c38e4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.611559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dde30-d28d-4da9-b4df-e7054e0c38e4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.611829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dde30-d28d-4da9-b4df-e7054e0c38e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.631036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-104dde30-d28d-4da9-b4df-e7054e0c38e4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:31.631778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:31.632279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-104dde30-d28d-4da9-b4df-e7054e0c38e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:31.632917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.633405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.633898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.634946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] RBAC: Adding query filter params (role.id=f4ea7057d09d48fa8ff338205f6ad138, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=588446ab55aa4942b399ca411380e13a) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:31.635459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:31.637092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:31.643637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 464/898] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:31 2022] GET /identity/v3/role_assignments?user.id=588446ab55aa4942b399ca411380e13a&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=f4ea7057d09d48fa8ff338205f6ad138 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:31.715865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 435/899] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:31.740403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:31.834994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83084d7d-8f55-47b2-a807-f4b904dac855 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.835452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83084d7d-8f55-47b2-a807-f4b904dac855 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.835811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83084d7d-8f55-47b2-a807-f4b904dac855 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.837437 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 436/900] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:31.843462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.843753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.844031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.861461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd47e9-ff3e-487a-9804-7a9a28f02563 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:31.867067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:31.868281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:31.878578 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:31.904449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:31.905385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:31.905665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:31.905975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:31.906637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:31.908020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:31.921714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:31.922846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:31.923689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 465/901] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:31.929574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:31.969386 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 437/902] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:31.992347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.040351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c956c-63a8-435a-ab95-dd12b8a10408 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.066290 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.076408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.077073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.077362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.077632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.078418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.078721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.080089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.091263 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 466/903] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:32.092797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.127060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff128e-a692-427d-a053-4c7df4474787 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.151313 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.180090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.181248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.181756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.182208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.183045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.184727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:32.198458 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:32.199849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:32.200663 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:32.203650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 438/904] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:32.212310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.223954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e001a4b-85a6-4d64-8318-0c90a027493d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.263453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.264518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.265003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.265518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.266480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.266988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.268567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.274806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 467/905] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.342470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3307746-dc40-477d-b812-25f96c0092da None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.362076 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.384069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.384757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.385041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.385317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.386216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.386525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.387941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.393925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 439/906] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.400132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.523498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692dc9-0042-4c1b-a8b5-b5bb278d2315 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.531711 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:32.560713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.561388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.561687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.561964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.562680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.562986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.564355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.570640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 468/907] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.576531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.688844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd9a8c-3a9f-47e0-89e1-54178a173754 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.725456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.726163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.726444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.726722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.727536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] RBAC: Adding query filter params (interface=public, service_id=138deb7ed5f84c31940bd26c9668c242, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:32.727848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.729225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55e29-4dc0-4dfc-a66c-d2a071e63a6b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.735134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 440/908] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/endpoints?service_id=138deb7ed5f84c31940bd26c9668c242&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:32.741361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:32.851090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd3bb-7a36-4acc-a8a6-118344bebf32 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:32.893882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:32.894559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:32.894841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:32.895121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:32.896399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:32.897932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62a4aa-d45e-492a-bea5-d57e83045609 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:32.905434 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 469/909] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:32 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:33.350459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458b2f-4cf2-479a-ad90-40d45916006a None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.351007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458b2f-4cf2-479a-ad90-40d45916006a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.351007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458b2f-4cf2-479a-ad90-40d45916006a None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.352681 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 441/910] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:33.358326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.358613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.358894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.377318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:33.378467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:33.408682 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.452997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 470/911] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:33.477633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458b2f-4cf2-479a-ad90-40d45916006a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.525738 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.590444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458b2f-4cf2-479a-ad90-40d45916006a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.627590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.628499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.628785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.629056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.629794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.631359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:33.643741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:33.644731 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:33.646040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 442/912] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:33.651588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.760493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e115-7eeb-4589-9246-479a8e6cc697 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.795719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.796389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.796670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.796945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.797657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.797988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.799371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065cb6c-5253-4c0c-9c73-53d1f9958a91 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.804600 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 471/913] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:33.810101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:33.879373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89239-79a2-4d9a-b393-71ab4d0ce020 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.880235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89239-79a2-4d9a-b393-71ab4d0ce020 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.880710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89239-79a2-4d9a-b393-71ab4d0ce020 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.882425 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 472/914] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:33.887670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.887959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.888239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.905810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:33.907002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:33.922694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9582f-75ba-4dd4-86bc-253843e414ef None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:33.932365 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.936727 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:33.964649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:33.965379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:33.965687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:33.966224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:33.966960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:33.967268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:33.969316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:33.980721 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 443/915] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Jul 24 00:53:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:33.982714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.005838 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 473/916] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:34.027631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.107058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25dd34-1b5e-4ce6-b680-b527064c500c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.138724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338c8f-49a0-4218-8315-a6a5d48dd020 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.152871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.153645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.153952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.154323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.155079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.156457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.175650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.177109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.177391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.177663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.185772 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 444/917] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:34.191437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:34.200723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:34.201742 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:34.202565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 474/918] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:34.209315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.267067 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.349344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2af2b-ab7f-4731-ae2f-e4929895a2a1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.388099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.388927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.389151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.389423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.390213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:34.390516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.391949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666195bf-f06e-4dcb-a729-4fe4e05ec8c0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.402015 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 445/919] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:34.407661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.429431 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.476685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934266-c322-42cb-a76a-cd7470530084 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.477037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934266-c322-42cb-a76a-cd7470530084 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.477285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934266-c322-42cb-a76a-cd7470530084 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.478778 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 446/920] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:34.486557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.487209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.487936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.510102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:34.512242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:34.527007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120c7c4-7598-4195-8935-edf08219df5e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.574553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.575790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.576087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.576367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.593552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.595497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.611696 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 447/921] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:34.630539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:34.631576 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:34.632536 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:34.632536 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:34.632536 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:34.632536 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:34.632536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 475/922] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:34.634436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.638692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.652630 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.730616 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:34.769707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596849f-8ed2-4c7f-9821-1c8ef39db010 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.771331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d250e3-892e-42f5-b78f-a323f96d8e94 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:34.808191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.808867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.809147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.809252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:34.809546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.809897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:34.810176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:34.810288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.810439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:34.811174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:34.811474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:34.811575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.812848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:34.828538 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 476/923] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:34.837795 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 448/924] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:34 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:34.839080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:34.965233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5557972-8256-45df-8217-58f7222dcfe7 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.000792 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.012001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.012823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.013104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.013374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.026184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.027665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b731edad-766c-4f06-ae0f-0e2a08f84397 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:35.054132 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:35.055083 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:35.056003 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 477/925] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:35.062636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.102752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c19-6535-4837-a20c-e60d9f9df230 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.103196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c19-6535-4837-a20c-e60d9f9df230 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.103572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c19-6535-4837-a20c-e60d9f9df230 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.105611 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 478/926] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:35.110889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.111177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.111455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.135593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:35.137032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:35.147475 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.191036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8be47-b97b-442a-93b2-e462a0e51c5a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.237928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.239348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.239820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.240299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.241311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:35.241812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.243415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.268300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 449/927] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:35.277273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.277457 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 479/928] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:35.299608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.389098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978e76-918b-4cf5-84fa-e456555bf6a5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.428919 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.435891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b832-d121-46ba-aa96-40a2b0538685 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.436088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.436809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.437495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.437904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.450062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.451797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.458835 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:35.477141 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:35.478342 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:35.479441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:35.479441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:35.479441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:35.479441 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:35.485415 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 450/929] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:35.486134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.486916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.487026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.487231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.487507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.488290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.490522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.503507 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:35.505113 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:53:35.505979 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:35.509962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 480/930] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:35.511992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.617525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaec32-fa03-4770-bc45-c7a1670508a1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.657691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46addb6f-c63f-4f54-851d-c7ba6c09f9b4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.658714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.659915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.661479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.661977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.662911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:35.663401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.665009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.683301 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 451/931] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:35.689949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.700066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.700735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.701064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.701344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.702121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:35.702577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.704101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.714067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 481/932] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:35.715166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.759650 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.774553 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:35.833723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01802-54cd-4903-be58-3dae48a2973a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.848834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade310-842e-48f7-beb6-a045c573e7d9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:35.884841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.886190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.886660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.887134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.888125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:35.888924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:35.889282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:35.889627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:35.890465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:35.890831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.892330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.898382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:35.903763 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 482/933] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:35.903892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:35.905288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:35.920860 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:35.921849 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:35.922730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:35.926877 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 452/934] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:35.928077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.037975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c60f5-25e2-4537-9cba-0002a4679036 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.048579 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.056298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e0ef5-b7c2-49e7-8612-5aa4a4befd87 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.059116 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.080116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.081108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.081490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.081903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.082786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.084264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.117260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.118116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.118533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.118925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.126800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:36.126800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.126800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d0aa-dc16-45f2-87f6-750456d05388 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.137715 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 483/935] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:36.141342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 453/936] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:36.148431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.276872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935db8e-6c45-4e54-bc72-44ef46a2acc8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.315932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.317023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.317448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.317765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/588446ab55aa4942b399ca411380e13a/roles/f4ea7057d09d48fa8ff338205f6ad138` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.320128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=588446ab55aa4942b399ca411380e13a, role_id=f4ea7057d09d48fa8ff338205f6ad138)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.321726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e02c80-c7a4-4ab1-b76c-7e54e69eed8f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.339984 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 484/937] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:36 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/588446ab55aa4942b399ca411380e13a/roles/f4ea7057d09d48fa8ff338205f6ad138 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:36.458900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ddfc-c7b4-43fa-bcbf-65eee144c7fa None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.459580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ddfc-c7b4-43fa-bcbf-65eee144c7fa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.459580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778ddfc-c7b4-43fa-bcbf-65eee144c7fa None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.461316 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 454/938] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:36.467475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.468123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.468620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.488661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:36.491224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:36.512649 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:36.586566 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 485/939] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:36.610207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ddfc-c7b4-43fa-bcbf-65eee144c7fa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.732777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778ddfc-c7b4-43fa-bcbf-65eee144c7fa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.769499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.770672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.771168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.771641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.772557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.774243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:36.775820 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.server.flask.common [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 24 00:53:36.796471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.sql.core [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:36.796471 n-d-master-1 devstack@keystone.service[80591]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:53:36.796471 n-d-master-1 devstack@keystone.service[80591]: [parameters: {'id': '0d0800676ac94906bbc0d5c4d27f5aed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:53:36.796471 n-d-master-1 devstack@keystone.service[80591]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80591) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d0800676ac94906bbc0d5c4d27f5aed.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d0800676ac94906bbc0d5c4d27f5aed. Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:36.805187 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 24 00:53:36.806031 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application yield resource Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise self.value Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application session.commit() Jul 24 00:53:36.806975 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:53:36.807820 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:53:36.809340 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:36.810954 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [parameters: {'id': '0d0800676ac94906bbc0d5c4d27f5aed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.813036 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:36.814880 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d0800676ac94906bbc0d5c4d27f5aed. Jul 24 00:53:36.817827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:36.821101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 455/940] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Jul 24 00:53:36 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:36.828025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:36.939400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeed7f-ef94-4af9-b68d-c4f5bc272e19 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:36.977632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:36.978789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:36.979247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:36.979711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:36.987354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:36.989688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6211c9f2-8557-4f61-9e77-43a09cfff101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:37.004784 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:37.005755 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:37.006612 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:37.008799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 486/941] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:37.019083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.041011 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.126878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242dd4a-50ce-4ce1-820e-92a940d30f69 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.148033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ece4b-d827-4114-95a4-95151f7bdc50 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.148652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ece4b-d827-4114-95a4-95151f7bdc50 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.149144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ece4b-d827-4114-95a4-95151f7bdc50 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.151038 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 487/942] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:37.156335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.156610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.156891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.165167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.165871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.166153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.166427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.167196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:37.167499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.169145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.175489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:37.177294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:37.181443 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.198630 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 456/943] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:37.269611 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 488/944] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:37.286667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.376978 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:37.402250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c512a5-b82a-4a5a-a130-0a70d30d5f3c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.439180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.439999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.440277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.440549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.441228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.442705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:37.455655 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:37.456640 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:37.457584 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 457/945] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:37.463326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.576011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a3835-0e6c-46fa-bbb7-232b7ade45dd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.616671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.617379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.617664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.617970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.618706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:37.619014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.620445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.631999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 489/946] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:37.633470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.799941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c8e0-db6b-4111-96ae-7349a712124a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:37.838396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:37.839303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:37.839757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:37.840185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:37.841305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:37.841779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:37.843289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:37.849338 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 458/947] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:37.859471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:37.866871 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.060554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b9bff-5c38-4baa-b97a-fa38c2f1cfeb None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.128933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.130654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.131168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.131665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.133153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] RBAC: Adding query filter params (interface=public, service_id=868d9588bdbf4013ba30109a4b97a704, region_id=RegionOne) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:38.133749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.136387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d23293-4a6b-492c-88e3-15ce51c72ce8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.157825 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 490/948] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:37 2022] GET /identity/v3/endpoints?service_id=868d9588bdbf4013ba30109a4b97a704&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:38.163233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.180583 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.282108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e4f81-a9a0-427d-8591-469d33253da5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.319699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.320771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.321250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.321762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.322652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.324280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2d018-61b5-4bc9-bfda-da636544d8e8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.331485 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 459/949] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:53:38.334392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf438e-d7cf-41f1-8c88-84721fb09c4b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.334920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf438e-d7cf-41f1-8c88-84721fb09c4b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.335427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf438e-d7cf-41f1-8c88-84721fb09c4b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.337410 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 491/950] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:38.343249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83160-5212-4925-a098-245a27b06770 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.343559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83160-5212-4925-a098-245a27b06770 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.343806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e83160-5212-4925-a098-245a27b06770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.363185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-85e83160-5212-4925-a098-245a27b06770 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:38.364856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-85e83160-5212-4925-a098-245a27b06770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:38.445144 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.452038 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 460/951] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:38.474516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf438e-d7cf-41f1-8c88-84721fb09c4b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.552266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b573-b7f7-475e-b6aa-289523b56592 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.553125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b573-b7f7-475e-b6aa-289523b56592 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.553723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b573-b7f7-475e-b6aa-289523b56592 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.555715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 461/952] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:38.561179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.561481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.561750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.568235 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.586607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:38.588364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:38.622389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf438e-d7cf-41f1-8c88-84721fb09c4b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.674808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.675608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.675876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.676810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.677662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.679064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:38.694655 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:38.697176 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:38.699289 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 492/953] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:38.702325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.716927 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 462/954] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:38.744562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.824909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afef83-37f5-40e1-98ba-1e74028db64f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.862257 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.870633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.871738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.872394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.873224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.874523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:38.875432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:38.877504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:38.881747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb66ef-f0f3-46ed-9709-bfed8ce5fc48 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:38.886061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 493/955] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:38.891775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:38.921064 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:38.928816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:38.929964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:38.930460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:38.930962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:38.943020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:38.952173 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:38.953234 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:38.954114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:38.962383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 463/956] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:38.963591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.027280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e618ea-ff13-4d75-9847-44de514414f4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.072677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.073258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfe352-a7e4-4dd3-b10b-77fc6b65a077 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.073372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.073619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.073944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.074667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.074975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.076525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.087207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 494/957] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:39.127276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.128438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.129049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.130294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.131389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.132005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.133776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.144549 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 464/958] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:39.154835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.228410 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.276827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806f4b4-090d-4ed0-a4da-3fa04067f9c6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.312719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.313722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.314102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.314479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.326406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.328084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:39.346954 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:39.348651 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:39.349752 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:39.349752 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:39.349752 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:39.349752 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.351428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 495/959] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:39.356947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.414895 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.466878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599af3-7115-4e7d-b486-15bc632244db None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.503531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.505285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.505933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.506245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.507008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.507319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.508709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23cee-853c-4904-b790-b8bbbe83d936 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.521634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 465/960] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:39.527284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.582948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe369-401f-46e8-8718-e0d86fdfa152 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.583308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe369-401f-46e8-8718-e0d86fdfa152 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.583535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fe369-401f-46e8-8718-e0d86fdfa152 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.585180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 466/961] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:39.590657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.591210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.591488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.614204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:39.614204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:39.646469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516aaa9-b968-4c0f-b5d1-4949906504ff None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.665398 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.693818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.694853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.695141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.695418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.706069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.708220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.709533 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 467/962] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:39.727218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:39.728166 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.729071 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 496/963] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:39.734173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.738415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.802026 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:39.853708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074f51-4ae2-42c3-a1ce-4b185c4d0844 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.872055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674578c-419b-4e25-ae98-b1f3dbb9de0e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:39.902414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.903875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.904263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.904646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.905911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.907774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.909207 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.server.flask.common [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 24 00:53:39.910620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:39.911379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:39.911754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:39.912100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:39.913030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:39.913408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:39.914978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:39.926037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.sql.core [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:39.926037 n-d-master-1 devstack@keystone.service[80590]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:53:39.926037 n-d-master-1 devstack@keystone.service[80590]: [parameters: {'user_id': '9bb2d884404642b3b1f2437d5f87e846', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:53:39.926037 n-d-master-1 devstack@keystone.service[80590]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80590) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:53:39.939695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 468/964] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:39.940621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:39.951529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:39.952439 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application yield resource Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise self.value Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application session.commit() Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:53:39.953376 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:53:39.954293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:53:39.955355 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result.read() Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:53:39.956523 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [parameters: {'user_id': '9bb2d884404642b3b1f2437d5f87e846', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:39.958236 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 24 00:53:39.970016 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 497/965] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Jul 24 00:53:39 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:39.970965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.019539 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.061889 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.069595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff33a76-4103-475d-8a44-6f16ce167085 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.104989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d003d8-e060-4771-a5fc-b3b931c742a9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.124497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.125166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.125449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.125749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.152126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.152998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.153284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.153556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.163834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.165859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:40.182897 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:40.183915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:53:40.184821 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:40.188963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 498/966] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:40.189881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.233047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.235500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.293658 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.302265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b002c-7c21-49e7-a805-eaa974976d8f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.344920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.345592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.345897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.346169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.346990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:40.347287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.349384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cba1a-70ec-4645-b7cf-7ce185b1ed34 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.378244 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.388705 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 469/967] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:40.390391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.399950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 499/968] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:40.519992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755af2d4-a394-4d1e-b97e-bf9aa291f047 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.564608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.565820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.566314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.566846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.580625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.582630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.596226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4bff-3399-4f45-8120-fbdf5e9fa4de None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.596544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4bff-3399-4f45-8120-fbdf5e9fa4de None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.596783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b4bff-3399-4f45-8120-fbdf5e9fa4de None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.599233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 500/969] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:40.604966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.605819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.606317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:40.616912 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:40.617963 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:40.618859 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:40.618859 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:40.618859 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:40.618859 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:40.621767 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 470/970] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:40.624856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.632507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:40.634144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:40.691264 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.737898 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 501/971] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:40.762261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.767587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03da6a7-3d72-4f30-97c5-29fe1881e2a4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.807903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.808556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.808836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.809109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.809876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:40.810180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.811592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.828273 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 471/972] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:40.839601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.881578 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:40.903641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e887cec-1949-4bbb-8b0c-e3dffdae5c17 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.941367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:40.942873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:40.943181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:40.943434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:40.944089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:40.945472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:40.954774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20954d4-a879-4ea8-a16d-3ef87a7513bd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:40.959032 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:40.960041 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:40.966163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 502/973] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:40.966945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:40.975034 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.000041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.000836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.001120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.001399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.009347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.010909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:41.025653 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:41.026862 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:41.027958 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:41.032006 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 472/974] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:41.032986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.077934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685aca6-6030-48f9-918c-f2edc4885979 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.123960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.124633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.124907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.125181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.125925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.126694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.128378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.137835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 503/975] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:41.141916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.143501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a39b6-709e-4e40-a269-82fdf9ee5d79 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.155228 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.182839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.183826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.184300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.184748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.185745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.186289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.188038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.201869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 473/976] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:41.207534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.242795 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.255823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04aacb-e42f-4c78-a50f-a7113aeaa407 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.290605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.291272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.291554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.291830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.292573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.292879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.294291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521cf58-57ee-47a0-bbf7-fa8f291cc291 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.299256 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 504/977] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:41.300478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808baa4-233c-4e1a-91d7-adebb0dd13e4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.300760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808baa4-233c-4e1a-91d7-adebb0dd13e4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.301893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808baa4-233c-4e1a-91d7-adebb0dd13e4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.303274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 505/978] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:41.305397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808baa4-233c-4e1a-91d7-adebb0dd13e4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.320861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f6219-da76-4158-b8d0-a10fed04840e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.363136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.364356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.364635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.364904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.365759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] RBAC: Adding query filter params (role.id=f4ea7057d09d48fa8ff338205f6ad138, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=588446ab55aa4942b399ca411380e13a) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:41.366067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.367497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0de47-39fc-4f05-a2de-61aefcc8b762 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.373298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 474/979] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:41 2022] GET /identity/v3/role_assignments?user.id=588446ab55aa4942b399ca411380e13a&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=f4ea7057d09d48fa8ff338205f6ad138 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:41.374512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.374793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.375064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.393971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:41.394372 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.395408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:41.434594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808baa4-233c-4e1a-91d7-adebb0dd13e4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.475315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 475/980] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:41.484748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.485422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.485743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.486027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.486786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.488181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4259e-d30e-4598-add4-fa36abaf59e0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.498214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:41.511997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 506/981] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:41.532508 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:41.637348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298d87-1fba-4f46-a750-1fe2279e56c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:41.685446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:41.686147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:41.686428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:41.686698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:41.687416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:41.688778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af45551-8a16-42fb-9567-d5ae38ca733d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:41.702539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 476/982] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:41 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:43.535809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e26eb-0b68-43a6-8e07-c033c1f43746 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.536344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e26eb-0b68-43a6-8e07-c033c1f43746 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.536802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e26eb-0b68-43a6-8e07-c033c1f43746 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.538669 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 507/983] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:43.544870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.545391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.545391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.563238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:43.564465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:43.637235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f7dd-c69e-4054-a89f-3042a91a9ef9 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.637567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f7dd-c69e-4054-a89f-3042a91a9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.637895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f7dd-c69e-4054-a89f-3042a91a9ef9 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.640488 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 508/984] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:43.646731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.647256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.647687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.666401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:43.667902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:43.676954 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 477/985] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:43.700385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:43.711589 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:43.766365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 509/986] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:43.790445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:43.845640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3af5f-4a7d-404b-aa74-245b1ae595e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:43.870786 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:43.883638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:43.884437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.884718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.884987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] PATH_INFO: `/v3/services/image` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.885644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:43.887050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4078c90d-adf1-4720-b53d-547217635d1b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:43.898855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:43.900092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:43.901363 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 478/987] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:43 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:43.902413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d81c-8e7c-4486-894e-517af224881a None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.902413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d81c-8e7c-4486-894e-517af224881a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.902413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468d81c-8e7c-4486-894e-517af224881a None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.907212 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 479/988] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:43.908078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468d81c-8e7c-4486-894e-517af224881a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:43.918913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329aa66-cbe6-48a3-b44e-0dcf4f6bddd7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:43.955105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:43.955915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.956198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.956476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.957186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:43.958594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-41f056e2-8fd3-49aa-a43b-2afa7aecf390 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:43.971258 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:43.972309 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:43.973388 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 510/989] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:43.974241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:43.974241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:43.974362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:43.982743 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:43.991575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:43.992861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:44.018368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468d81c-8e7c-4486-894e-517af224881a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.054656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.055234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.055511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.055782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.056497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.056798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.058204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.063195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 480/990] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:44.063979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.064416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 511/991] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:44.069618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.132659 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.183787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea98d5-4b9a-4b74-8ce8-5d51044fbc88 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.189825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e33ac-d0d8-4063-b1ed-2eb33645f6f0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.224054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.224730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.225007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.225276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.226031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.226333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.227711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.245707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 512/992] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.245707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.245983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.245983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.245983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.245983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.246301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.246301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.246301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.246301 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.250040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 481/993] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:44.256244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.351884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f66b90-ad62-42a2-8676-193b042bfcd2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.371833 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.377143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932bafc-0fca-4251-9d17-c501397ccd88 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.393399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.394204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.394543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.395569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.395569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.396971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:44.413621 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:44.414658 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:44.415465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 513/994] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:44.417239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.417456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.417795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.418018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.418744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.419045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.420435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.421013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.427548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 482/995] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.432314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.502442 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.549181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286409-c10b-4298-881b-772c88404d20 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.557291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988764-3452-4880-b194-6afdfec50921 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.603723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.604524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.604879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.605227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.606289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] RBAC: Adding query filter params (interface=admin, service_id=868d9588bdbf4013ba30109a4b97a704, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.606688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.608317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.612020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.612989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.614434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.615374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.616377 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 483/996] 10.222.0.27 () {56 vars in 1249 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/endpoints?service_id=868d9588bdbf4013ba30109a4b97a704&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.617093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.617394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.619545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.622462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.628787 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 514/997] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.633491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:44.708641 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.776984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200ef1-e5a2-48d1-938f-1d75b412b9c3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.794975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c04b6-3a6c-4126-9de0-61b9968ebf85 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:44.824440 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:44.837142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.837871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.838156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.838433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.839152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.840602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.853826 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 484/998] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:53:44.858048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:44.858754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:44.859035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:44.859309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:44.860061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:44.860368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:44.861837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:44.868356 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 515/999] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:44.875108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.028030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7997b5-9c13-4621-95e4-73cc427ea854 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.075828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.076774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.077233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.077706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.078753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] RBAC: Adding query filter params (interface=public, service_id=b29c982489de409a8291c7387cdca1c8, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:45.079270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.081344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969b34f-2ebb-41b5-b4e1-93f2a7318a5a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.090484 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 485/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:44 2022] GET /identity/v3/endpoints?service_id=b29c982489de409a8291c7387cdca1c8&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:45.096886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:45.252890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7c84-5a4c-4c7e-a1c0-77ec296df341 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:45.268507 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:45.304438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:45.305462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:45.305962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:45.306381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:45.307219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:45.308923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324de6-169a-43b5-93e0-19af07424ccd None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:45.316193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 516/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:45 2022] GET /identity/v3/services => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:53:46.367754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75bd2-76d4-4c6a-bb30-cc053b3a3d7f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.368271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75bd2-76d4-4c6a-bb30-cc053b3a3d7f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.368349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e75bd2-76d4-4c6a-bb30-cc053b3a3d7f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.370195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 486/1002] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:46.375576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb09c28-ff71-4889-bc63-0517c37f6751 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.376017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb09c28-ff71-4889-bc63-0517c37f6751 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.376123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb09c28-ff71-4889-bc63-0517c37f6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.393872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1fb09c28-ff71-4889-bc63-0517c37f6751 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:46.395180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1fb09c28-ff71-4889-bc63-0517c37f6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:46.470253 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 517/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:46.494004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e75bd2-76d4-4c6a-bb30-cc053b3a3d7f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:46.561266 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:46.625622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e75bd2-76d4-4c6a-bb30-cc053b3a3d7f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:46.663965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:46.664636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.664912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.665182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.665956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:46.668179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cc866-81ca-4411-ba89-f479d6d19315 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:46.694523 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 487/1004] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:46 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:46.962651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e36a-b4da-4e36-b6b0-ee592b2935ca None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.962842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e36a-b4da-4e36-b6b0-ee592b2935ca None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.963115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e36a-b4da-4e36-b6b0-ee592b2935ca None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.964551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 518/1005] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:46.970446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:46.970730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:46.971005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:46.989411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:46.990633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:47.087531 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 488/1006] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:46 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:47.110480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42e36a-b4da-4e36-b6b0-ee592b2935ca None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.223172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42e36a-b4da-4e36-b6b0-ee592b2935ca None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.225704 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.260806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.261610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.261911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.262185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.262837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.264202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ff1cdfdc-006d-46af-9ead-2997fbc61208 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:47.276575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:47.277637 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:53:47.278828 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:47.280034 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 519/1007] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:47.283840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.332750 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.396202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2323ee-da40-45b5-ab9a-65a27a5f033c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.431760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.432441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.432724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.432998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.433746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:47.434059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.435440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ca4e-4ef4-4304-9ac7-348a4d9c06fe None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.439305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b04-b074-4389-b8a9-d31b0f7b0416 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.439772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b04-b074-4389-b8a9-d31b0f7b0416 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.439872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b04-b074-4389-b8a9-d31b0f7b0416 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.446090 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 489/1008] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:47.446258 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 520/1009] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:47.447156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b04-b074-4389-b8a9-d31b0f7b0416 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.447619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.447912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.448193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.468721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:47.469955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:47.543747 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 490/1010] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:47 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:47.555106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b04-b074-4389-b8a9-d31b0f7b0416 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.566967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.589537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.590344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.590630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.591156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.591863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:47.592166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.593595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.603422 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 521/1011] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:47.604797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.610215 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.640486 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.682531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb7064-7661-4e3d-b3c5-db506a953af3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.717973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d639157-e4b9-4ee1-8731-363fc77272c0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.721353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.722188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.722630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.722913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.723588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.724978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:47.737421 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:47.739056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:47.739916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 491/1012] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:47.745591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:47.761758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.762521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.762829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.763123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.763856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.765226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.782580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 522/1013] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:53:47.872514 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:47.875946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e6012-c781-406e-8985-314644a1b985 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:47.923426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:47.924212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:47.924754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:47.925247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:47.926858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:47.927428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:47.928885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:47.934961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 492/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:47.940798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.044452 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.055833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5d1c-9889-424f-9069-5457bc030384 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.098046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.098902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.099188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.099463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.100382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:48.104116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.104116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1a874-0ef7-42be-80f8-ed26db68b240 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.109214 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 523/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Jul 24 00:53:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:48.118153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:48.242074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ea5-64b3-431b-90bb-d8ffa2a5b215 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:48.277603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:48.278305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.278584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.278856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.279599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:48.280983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d9b05-bce7-4787-a57b-d44ea606286a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:48.321702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 493/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:48.820321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37e79-3fc4-44bb-875d-ea9ea063d4d9 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.820869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37e79-3fc4-44bb-875d-ea9ea063d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.820951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37e79-3fc4-44bb-875d-ea9ea063d4d9 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.822739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 524/1017] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:48.828420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:48.828921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:48.829109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:48.847297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:48.849165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:48.864648 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:48.946159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 494/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:48.969761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37e79-3fc4-44bb-875d-ea9ea063d4d9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.144035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37e79-3fc4-44bb-875d-ea9ea063d4d9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.204180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.205499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.206022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.206492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.207749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.210269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:49.230625 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:49.231660 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:49.232583 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:49.234028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 525/1019] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:48 2022] GET /identity/v3/services/image => generated 86 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:49.243190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.380012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0051-6ad9-4e0c-9795-3749af8ef3ff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.416168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.416840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.417118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.417394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.418201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] RBAC: Adding query filter params (name=image) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.418535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.419926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.430093 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 495/1020] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.431216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.454777 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.542999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0249b-ec45-419a-9e13-608956970cd8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.588199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.589022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.589399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.589798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.590617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] RBAC: Adding query filter params (type=image) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.591270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.592728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.604239 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 526/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.605651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.617513 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.734219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dbde8-65e5-4f0e-bfd4-602582c34946 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.770638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.771471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.771861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.772237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.773151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] RBAC: Adding query filter params (interface=public, service_id=99db80f6598c4a07a23733dc32b9bafa, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:49.773568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.775106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3a83c-e49d-4276-b665-3183d03190cb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.785806 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 496/1022] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/endpoints?service_id=99db80f6598c4a07a23733dc32b9bafa&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:49.787135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:49.884087 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:49.903107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88986-f694-4bed-bf45-fac70bc1bf76 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:49.916563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a01c3-ed1b-4879-ab02-8d30016d461e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.917124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a01c3-ed1b-4879-ab02-8d30016d461e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.917124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a01c3-ed1b-4879-ab02-8d30016d461e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.918963 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 497/1023] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:49.924155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.924438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.924715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.943589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:49.944791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:49.955305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:49.955983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:49.956263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:49.956535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:49.957709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:49.959992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:49.973547 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 527/1024] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:53:49 2022] GET /identity/v3/services => generated 1957 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:53:50.029821 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.038467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 498/1025] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:50.081229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.214176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5afdd-09e5-4003-8331-cf4849d7515c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.248880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.250127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.250630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.251074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.252525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.254744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d70566-2261-48b8-a5d4-f9aaa52a44f5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.257121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 528/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:50.262756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.367681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9d7ac-4bca-49ba-8193-fd47aad80d43 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.403180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.403854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.404136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.404411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.405147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:50.406631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf551b-930b-4cc5-b931-aad451e8ea8d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:50.441715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 499/1027] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:53:50 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:50.524958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4146-99b9-459f-bfa3-befb31232178 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.525234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4146-99b9-459f-bfa3-befb31232178 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.525519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f4146-99b9-459f-bfa3-befb31232178 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.527020 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 529/1028] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:50.532890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.533182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.533461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.552441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:50.554119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:50.617128 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.640736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 500/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:50.665393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f4146-99b9-459f-bfa3-befb31232178 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.685582 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:50.783418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f4146-99b9-459f-bfa3-befb31232178 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:50.842557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:50.843981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:50.844555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:50.845059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:50.860369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:50.869603 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:50.871473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:50.873150 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:50.875948 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 530/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:50.877131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:50.982563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651f02-c2d4-40ed-96a0-d9f18155ce6e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.018869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.019593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.019877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.020153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.020918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:51.021229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.022653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.037713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 501/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:51.037896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.131061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:51.157282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf11a1-53e7-4dbb-9e69-a667e89ae8d8 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.197975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.198776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.199052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.199320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.210465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.211918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:51.230228 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:51.231153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:51.232030 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:51.232030 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:51.232030 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:51.232030 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:51.232030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 531/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:51.237221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.286989 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:51.350618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561307b-44fc-4b31-82ba-d2a1b009a75a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.388683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.389342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.389619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.389918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.390645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:51.390944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.392303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.405303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 502/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:51.410797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.516775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be322aa-a94e-4a33-9c9c-338feeaaf459 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.543971 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:51.554116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.554918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.555199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.555470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.564032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.565484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:51.582207 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:51.583883 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:51.584801 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:51.586268 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 532/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:51.589403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.707310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00797b39-c5c8-4fb3-9d63-28e8263c9d1b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.710032 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:51.756674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.757361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.757646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.757967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:51.758840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:51.759150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:51.760600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:51.781496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 503/1035] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:51.787768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:51.917049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5603-12e6-4b3a-bc9a-264ce728cec0 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:51.956853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:51.958119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:51.958399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:51.958682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.026148 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.043505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.044122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbe324-eecd-49c1-8a23-8da7d461e015 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.180886 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 533/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:52.186749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.195018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd640-1980-4de5-83ef-ab106d840072 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.195351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd640-1980-4de5-83ef-ab106d840072 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.195584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dd640-1980-4de5-83ef-ab106d840072 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.197166 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 534/1037] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:52.203116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.203407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.203692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.225903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:52.227717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:52.321726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 535/1038] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:52.330474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9822-ab44-4445-a26c-a1797f42fc7c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.350543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.373581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.380047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.381409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.382229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.382822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.397183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.399062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:52.421908 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:52.422869 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:52.423749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:52.423749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:52.423749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:52.423749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:52.425457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 504/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:52.435535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.453207 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.496078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f11b21-9865-4ca4-87ff-aeccb08f917e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.540207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.541006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.541287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.541556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] PATH_INFO: `/v3/services/image` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.543739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.545119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:52.560111 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:52.561182 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:53:52.562072 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:52.562799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 536/1040] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:52.567397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6c5b-cb33-4ae8-9778-db48507b5d12 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.570283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.617878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.618715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.619003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.619287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.620038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:52.620348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.621770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.634405 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 505/1041] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:52.640138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.673341 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.698291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0e5c-7fb4-45df-8214-4fe37b62ff17 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.735130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.735806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.736085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.736572 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.736857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.737637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] RBAC: Adding query filter params (name=image) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:52.738140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.739676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.752964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 537/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:52.754582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.764843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753551-23ab-4cbd-8189-7d61d69a7416 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.803240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.804361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.804638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.804910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.812120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.813575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d0cb093a-06f6-484e-bf4c-61cf5ad46425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:52.829047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:52.830081 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:52.830959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 506/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:52.831635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa157ea-d5e4-47b1-a95f-0693216164c4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.831867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa157ea-d5e4-47b1-a95f-0693216164c4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.832157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa157ea-d5e4-47b1-a95f-0693216164c4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.833742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 507/1044] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:52.836252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa157ea-d5e4-47b1-a95f-0693216164c4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:52.871514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01232491-a546-4445-9855-6b55c7e21e71 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.905978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.906648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.906930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.907207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.907919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] RBAC: Adding query filter params (type=image) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:52.908232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.909621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5170e-23d1-4949-a9b6-004271964c64 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.914834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 538/1045] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:52.916086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.916374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.916653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.934216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:52.935435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:52.938343 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:52.946281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa157ea-d5e4-47b1-a95f-0693216164c4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:52.983074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:52.983973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:52.984256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:52.984617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:52.985426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:52.985838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:52.987305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:52.989711 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.001346 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 508/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:53.002279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.007374 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 539/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:53.008217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.112146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b0c9f-d942-45bf-a0e2-41df36aec835 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.119992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03af80-4318-4497-834d-152d4c15a525 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.159946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.160459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.160755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.161109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.161275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.161428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.161592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.161769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.162492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] RBAC: Adding query filter params (role.id=f4ea7057d09d48fa8ff338205f6ad138, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:53.162653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.162799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.164153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.164293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.170035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 540/1048] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=f4ea7057d09d48fa8ff338205f6ad138 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:53.170886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.174659 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.196963 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 509/1049] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:53:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:53.297196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4f6a-b868-4437-b854-4765987c64ec None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.348977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.349832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.350106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.350378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.352784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.354306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878272c-585a-421d-9a0c-3a2cf1ba7d04 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.356027 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 541/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:53.362299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:53.418268 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:53.476224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5f30-286e-457e-9ce3-effdee868c26 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:53.511510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:53.512553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:53.513034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:53.513550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:53.514490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:53.516111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a5e00-e8e1-48bd-8c7c-279826df678c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:53.539844 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 510/1051] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:53:53 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:53:55.299851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005afd-5d50-44d9-af89-866ba19f8ca0 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.301154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005afd-5d50-44d9-af89-866ba19f8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.301640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005afd-5d50-44d9-af89-866ba19f8ca0 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.303601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 542/1052] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:55.309507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.310060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.310398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.330850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:55.332782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:55.352361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cd3e-686c-4345-88fe-5fae1165b422 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.352670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cd3e-686c-4345-88fe-5fae1165b422 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.353220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78cd3e-686c-4345-88fe-5fae1165b422 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.354636 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 543/1053] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:55.361527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.361869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.361991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.381763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:55.383050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:55.437078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 511/1054] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:55.462414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:55.473947 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:55.485236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 544/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:53:55.501423 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:55.524514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:55.592272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e212-fdec-4a58-8ecb-27ddaf041af1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:55.633819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:55.634825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.635314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.635803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.649769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:55.660261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:55.661555 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:53:55.667210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:55.668402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b97b11-1e66-4cf4-9484-5b4be4464ea2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:55.668501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 512/1056] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:53:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:55.670023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:55.712040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:55.712915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.712915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.713294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.787384 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:55.792466 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:55.793000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:55.794782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95420-f0a1-4919-8c93-4da925d89234 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:55.801205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d90ac-9953-4bdc-83d3-1c6df2e8af75 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:55.847806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:55.849059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.849376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.849816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.850793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:55.851233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:55.852694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfee15-0439-4b2b-852c-6cf3c728d3cb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:55.862768 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 513/1057] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:53:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:55.864240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d789b-0a94-44a9-a7c9-a1b5f0b9799e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.864557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d789b-0a94-44a9-a7c9-a1b5f0b9799e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.864975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d789b-0a94-44a9-a7c9-a1b5f0b9799e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.867254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 514/1058] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:55.871335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d789b-0a94-44a9-a7c9-a1b5f0b9799e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:55.932716 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 545/1059] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:53:55.934249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:55.934529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:55.934835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:55.953664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:55.954897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:55.991133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d789b-0a94-44a9-a7c9-a1b5f0b9799e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.031805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.032826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.033150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.033451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.046204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.047837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.050315 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 546/1060] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:56.051604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:56.067429 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:56.069594 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:56.072572 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:56.072572 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:56.072572 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:56.072572 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:56.072572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 515/1061] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:56.074889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.089924 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.096797 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.187413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e782ceb-0b4c-4eae-9ecf-f8bbe65149a5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.217810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d1f6-f5dd-4a7b-a5c2-3f244b3d42a0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.226168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.226978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.227286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.227562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.240453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.241961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:56.262247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:56.263412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:56.264444 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:56.264444 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:56.264444 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:56.264444 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:56.264444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 547/1062] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:56.264799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.264799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.265051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.265129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.265750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.266117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:56.266421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.267797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.281087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 516/1063] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:56.282050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.365610 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.375395 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.399585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680757e-f5a0-4eab-ab4c-353290d4c3ae None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.405656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399d4c-7887-41ed-b595-dcee7b77d7bf None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.439249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.440332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.441336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.442828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.445095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.445889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.446165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.446439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.447172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:56.447470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.448876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.457356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:53:56.463599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 517/1064] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:53:56.464439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:53:56.466737 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:56.467650 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:53:56.468481 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 548/1065] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:56.483225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.629655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbedf-4fee-45ea-845f-48ecbf91ecb3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.670706 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.675740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e092-aa3c-4555-bbd2-3cc0e84d4a8a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.679341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.680432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.680707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.680977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.690161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.692907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:53:56.711195 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:56.712550 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:56.713897 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 518/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:53:56.720873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.740023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.740869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.741353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.741771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.742604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:56.742921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.744787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.755161 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 549/1067] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:56.761066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.765496 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:56.865723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a63122-d0fb-4e4e-b4ae-4383f39fcdce None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.899886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbd071-eadc-487f-abd3-1a99d0c5b511 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:56.907949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.908642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.908924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.909210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.910209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:56.910511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.911999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.932122 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 519/1068] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:56.937993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.942232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:56.943067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:56.943350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:56.943624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] PATH_INFO: `/v3/users/84c21d7ba42943d5894d2bcd3143dd06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:56.961050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] RBAC: Authorizing `identity:get_user(user_id=84c21d7ba42943d5894d2bcd3143dd06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:56.962563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:56.964516 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 550/1069] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/users/84c21d7ba42943d5894d2bcd3143dd06 => generated 285 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:56.971349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:56.996614 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.042144 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.056557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666df06-041d-4f0a-b41c-39644dbe7d39 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.096364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.098172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.098536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.098885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.103148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df281a4-c70f-4c06-85f3-3ce4fdc257c2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.110884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.112446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:53:57.141273 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:57.142310 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:57.143180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:53:57.143180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:53:57.143180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:53:57.143180 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:57.147210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 520/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:57.147347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.147347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.147347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.147347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.149636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.225618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.227320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.265405 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.269368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d455d-41b3-43c9-b471-39a9d795bf7e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.296401 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.316021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.317170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.317611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.318231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.319514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:57.320009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.322445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.339925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 521/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:57.349024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.359470 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 551/1072] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:53:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:53:57.366057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.458677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf357b-5bf5-4474-9b76-37bceb07507d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.485853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6459865-f7a7-45dc-875c-7887ab26c9ac None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.495684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.496527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.496810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.497082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.504817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.506313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:53:57.521330 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:53:57.522329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:53:57.523435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 522/1073] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:53:57.526816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.527693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.527969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.528241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.528463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.529499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.531022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.532844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 552/1074] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:53:57 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:57.540150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.552701 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.574113 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.639235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65152ab-e83b-40fc-b686-41118d62307a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.656796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add5618-1559-4f3c-9457-9b7f2692a249 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.677127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.677822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.678101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.678375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.679169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:57.679472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.680910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.693035 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 523/1075] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:57.696736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.697475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.697785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.698070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.698926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=e0cbaa376039493fb210072cb2ecbdc1, user.id=84c21d7ba42943d5894d2bcd3143dd06) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:53:57.699231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.699538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:57.700745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9194-8b1c-4ba6-bc24-15ad97d7a8a0 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.707538 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 553/1076] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:53:57 2022] GET /identity/v3/role_assignments?user.id=84c21d7ba42943d5894d2bcd3143dd06&scope.project.id=e0cbaa376039493fb210072cb2ecbdc1&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:53:57.796699 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:57.820927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6594b0-de9a-41b6-89fa-b0dfd165fe1f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:53:57.868522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:53:57.869110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:57.869405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:57.869708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/f4ea7057d09d48fa8ff338205f6ad138` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:57.872198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=301e817770344ea89321aa8d85756547, role_id=f4ea7057d09d48fa8ff338205f6ad138)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:53:57.873648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd052a-df0c-4974-b540-fb32928ff5f2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:53:57.889460 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 524/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:53:57 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/301e817770344ea89321aa8d85756547/roles/f4ea7057d09d48fa8ff338205f6ad138 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:53:59.741911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104385-f1a1-466d-af6e-a8254a124844 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.742476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104385-f1a1-466d-af6e-a8254a124844 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.742476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104385-f1a1-466d-af6e-a8254a124844 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.743817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 554/1078] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:53:59.748989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4dea-ee5d-4193-9b09-d2ffd00cd6e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.749421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4dea-ee5d-4193-9b09-d2ffd00cd6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.749534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4dea-ee5d-4193-9b09-d2ffd00cd6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.766050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-652f4dea-ee5d-4193-9b09-d2ffd00cd6e5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:59.767232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-652f4dea-ee5d-4193-9b09-d2ffd00cd6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:59.835309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 525/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:53:59.858554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104385-f1a1-466d-af6e-a8254a124844 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:53:59.949987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee322-f873-4a14-9c33-ed23a8a59fd5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.950276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee322-f873-4a14-9c33-ed23a8a59fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.950556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee322-f873-4a14-9c33-ed23a8a59fd5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.951955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 526/1080] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:53:59.959712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:53:59.959989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:53:59.960264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:53:59.977661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:53:59.978890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:53:59.980879 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:53:59.991676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104385-f1a1-466d-af6e-a8254a124844 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.029816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.030607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.030932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.031388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.042512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:00.048412 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:00.051185 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:00.052279 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:00.053175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 555/1081] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:00.054717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 527/1082] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:54:00.059071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.078003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.165866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b839-9e10-4d28-9889-93820399801c None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.180480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75921fcc-8df3-4ce1-8062-71736aaba5cd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.201030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.201723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.202011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.202290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.203050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:00.203351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.204741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.213830 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 556/1083] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:00.219480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.219650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.220455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.220806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.221146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.233197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:00.235805 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:00.242320 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:00.243368 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:00.244188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 528/1084] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:54:00.249612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.313854 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.329958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12df43-df82-4830-862a-0659d82f60ee None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.359085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab449-2d6d-4514-8c1a-bcb696847469 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.364454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.365332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.365611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.365913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] PATH_INFO: `/v3/users/84c21d7ba42943d5894d2bcd3143dd06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.367127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] RBAC: Authorizing `identity:get_user(user_id=84c21d7ba42943d5894d2bcd3143dd06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.368554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.370234 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 557/1085] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/users/84c21d7ba42943d5894d2bcd3143dd06 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:00.376081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.395465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.396125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.396403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.396673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.397426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:00.397753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.399130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.407399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 529/1086] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:00.413215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.469635 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.492559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787c1b-62ef-4334-9736-e9e8e0311d47 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.528701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.529561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.529871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.530153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.530543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e527-acce-4578-ad9c-ef62097eae30 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.531369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.532847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.534706 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 558/1087] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:00.541083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.554395 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.568033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.568767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.569048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.569324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.582107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.583587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:54:00.602490 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:00.603501 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:00.604855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:54:00.604855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:54:00.604855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:54:00.604855 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:00.604855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 530/1088] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:54:00.609645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.646055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31365d9-d63e-4ee5-b13c-3632eed57ac4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.680029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.680918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.681199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.681466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1/users/84c21d7ba42943d5894d2bcd3143dd06/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.683475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=e0cbaa376039493fb210072cb2ecbdc1, user_id=84c21d7ba42943d5894d2bcd3143dd06, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.684908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.698810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 559/1089] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:00 2022] PUT /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1/users/84c21d7ba42943d5894d2bcd3143dd06/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:54:00.714998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d336a-57df-4d5c-8448-69c3de9e30f3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.755430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.756190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.756432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.756665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.757435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:00.757784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.759236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.772986 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 531/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:00.778896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.793239 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:00.892427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaded6b-a77c-481f-ad35-2f577dbf1b1d None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:00.926252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:00.927053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:00.927339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:00.927615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:00.935439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:00.936886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:54:00.951572 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:00.952567 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:00.953575 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 560/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:54:00.959140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:00.996833 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:01.064295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013d19e-3e06-492c-bc29-979cafdbc487 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:01.099361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:01.100037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:01.100321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:01.100591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:01.101455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:01.101782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:01.103230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:01.126656 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 532/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Jul 24 00:54:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:01.127855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:01.199322 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:01.232998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dda25-8735-4e4f-b837-3997ffcd273b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:01.269135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:01.269850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:01.270165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:01.270399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:01.343662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:01.345129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:01.413536 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:01.469002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 561/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:01.470314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:01.568842 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:01.578225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d214f3-262f-4f86-83d0-5ba2df663426 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:01.613848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:01.614635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:01.614919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:01.615196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:01.625065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:01.626540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:54:01.644853 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:01.645915 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:01.646967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:54:01.646967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:54:01.646967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:54:01.646967 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:01.646967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 533/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:01.651773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:01.752909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91153a-54fc-4c85-9628-4d1638ff29df None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:01.787925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:01.788599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:01.788856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:01.789129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:01.789891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:01.790198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:01.791562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:01.803509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 562/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:01.809069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:01.917104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28396a-8577-4ece-a9e7-38a2034096f5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:01.954126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:01.954935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:01.955216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:01.955493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:01.963407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:01.964855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:54:01.979265 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:01.980346 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:01.981224 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 534/1096] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:01.986347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.016386 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.089513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c744-9e51-4c27-aad8-332304fbbd48 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:02.127607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:02.128810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.129087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.129361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.130188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:02.130496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:02.131937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072b9fe-eeb2-4711-bb9d-0f75d47702fc None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:02.144850 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 563/1097] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:02.150872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:02.155351 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.250162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504fdd3-5a41-4abe-9f75-a05f67ae4f39 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:02.283828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:02.284532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.284809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.285076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.285936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] RBAC: Adding query filter params (role.id=f4ea7057d09d48fa8ff338205f6ad138, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=301e817770344ea89321aa8d85756547) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:02.286240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:02.287674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a265e-050a-49ec-a304-9f1ca2d7b9f3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:02.293645 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 535/1098] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:02 2022] GET /identity/v3/role_assignments?user.id=301e817770344ea89321aa8d85756547&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=f4ea7057d09d48fa8ff338205f6ad138 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:02.844741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017478-a2e8-49e2-8796-d7877ecd19a5 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.845279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017478-a2e8-49e2-8796-d7877ecd19a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.845279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017478-a2e8-49e2-8796-d7877ecd19a5 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.847331 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 564/1099] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:02.853017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:02.853513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:02.853618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:02.871480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:02.872670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:02.938930 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:02.947160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 536/1100] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:02.970452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017478-a2e8-49e2-8796-d7877ecd19a5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:03.068800 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:03.080402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017478-a2e8-49e2-8796-d7877ecd19a5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.119763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.120573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.120851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.121124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.136011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:03.144475 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:03.145729 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:03.146694 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 565/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:03.151857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:03.282382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abf77e-9581-4f44-8e9a-f7940fa35ab9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.319657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.320238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.320518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.320790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.321551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:03.321883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:03.323278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:03.333168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 537/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:03.339226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:03.453503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0daa1a-2480-4308-a6db-1da9fc6cc4db None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.501278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.502292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.502622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.502970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] PATH_INFO: `/v3/users/84c21d7ba42943d5894d2bcd3143dd06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.504778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] RBAC: Authorizing `identity:get_user(user_id=84c21d7ba42943d5894d2bcd3143dd06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:03.506333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:03.508153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 566/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:03 2022] GET /identity/v3/users/84c21d7ba42943d5894d2bcd3143dd06 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:03.514345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:03.582202 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:03.625178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb61cc-bb88-48b4-a78e-5f9969609ba9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.659196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.659904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.660182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.660452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.729545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:03.730947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:03.788437 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:03.831649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 538/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:03.838150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:03.857864 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:03.939035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ba53-a018-4b6b-b27f-613e8b7f795f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:03.973947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:03.974813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:03.975096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:03.975369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:03.976564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:03.978037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e4ddc-82bb-427e-b03f-245e99e800b1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:03.979824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 567/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:03 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:03.985966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:04.087327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4462c8a-12b6-41bb-be66-91b6226696e2 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:04.122151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:04.122815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:04.123096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:04.123369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:04.124225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=e0cbaa376039493fb210072cb2ecbdc1, user.id=84c21d7ba42943d5894d2bcd3143dd06) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:04.124534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:04.126011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea27cf7-0954-4a03-adfb-25521373d8ae None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:04.132932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 539/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:03 2022] GET /identity/v3/role_assignments?user.id=84c21d7ba42943d5894d2bcd3143dd06&scope.project.id=e0cbaa376039493fb210072cb2ecbdc1&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:06.224994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae806-a430-46c5-85f5-63cc7dacc4d6 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:06.225512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae806-a430-46c5-85f5-63cc7dacc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:06.225627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae806-a430-46c5-85f5-63cc7dacc4d6 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:06.226948 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 568/1107] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:06.232168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:06.232561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:06.232716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:06.249621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:06.250815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:06.268743 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:06.317939 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 540/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:06.342978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae806-a430-46c5-85f5-63cc7dacc4d6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:06.428127 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:06.444205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae806-a430-46c5-85f5-63cc7dacc4d6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:06.477013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:06.477862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:06.478140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:06.478408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:06.479664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:06.481123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f5d5e-9436-4dfc-9a3f-a3e3f993fe9a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:06.482853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 569/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:06.489657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:06.599655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bb984-7217-4ae3-bef8-8c96ebdc5376 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:06.635325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:06.636000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:06.636281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:06.636554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:06.637262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:06.638734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f5ea9-a82d-47e4-9041-83c6bf9bcf98 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:06.659991 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 541/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:54:06 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:08.758062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df434e39-921f-4498-ac4b-f6a9f53d6642 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.758593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df434e39-921f-4498-ac4b-f6a9f53d6642 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.758593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df434e39-921f-4498-ac4b-f6a9f53d6642 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.759977 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 570/1111] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:08.766490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:08.766955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:08.767053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:08.785157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:08.786410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:08.789339 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:08.868891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 542/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:08.894982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df434e39-921f-4498-ac4b-f6a9f53d6642 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:08.999239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df434e39-921f-4498-ac4b-f6a9f53d6642 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:09.033807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:09.034696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:09.034976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:09.035252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] PATH_INFO: `/v3/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:09.036752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] RBAC: Authorizing `identity:get_role(role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:09.038158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:09.039531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 571/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:08 2022] GET /identity/v3/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:09.045489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:09.149074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997e5b-57d6-415b-8e88-b1ad916fff43 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:09.182325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:09.183180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:09.183455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:09.183725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] PATH_INFO: `/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:09.194392 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:09.198139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] RBAC: Authorizing `identity:get_user(user_id=4f0ee7a2f77b4f5897d7589f87ff63fc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:09.199569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:09.201212 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 543/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:09 2022] GET /identity/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:09.207163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:09.231509 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:09.306647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639d70-faa4-4347-8e3a-7365850322de None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:09.344530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:09.345228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:09.346056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:09.346056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:09.421206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:09.422776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:09.448372 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:09.523559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 572/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:54:09.529487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:09.625146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfeb9b-8f44-4c0e-b804-6d4cdebf1846 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:09.658933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:09.659813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:09.660089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:09.660360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:09.661526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:09.662982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5df43c-78f0-46a0-8fa3-6a6aa03b4074 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:09.664656 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 544/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:09 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:09.670874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:09.774871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e44ce-8a81-4018-90d4-40d0c7a2b874 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:09.798095 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:09.810509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:09.811159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:09.811437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:09.811710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:09.812544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=e0cbaa376039493fb210072cb2ecbdc1, user.id=4f0ee7a2f77b4f5897d7589f87ff63fc) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:09.812851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:09.814309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ecfa-8c97-4cd5-83d0-3a8c458ccadb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:09.820854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 573/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:09 2022] GET /identity/v3/role_assignments?user.id=4f0ee7a2f77b4f5897d7589f87ff63fc&scope.project.id=e0cbaa376039493fb210072cb2ecbdc1&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:11.857139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9680d83-ec08-4ae0-861f-b1ed37f98f80 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:11.857708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9680d83-ec08-4ae0-861f-b1ed37f98f80 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:11.857708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9680d83-ec08-4ae0-861f-b1ed37f98f80 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:11.859115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 545/1118] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:11.864671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:11.865092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:11.865230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:11.882264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:11.883464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:11.950164 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 574/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:11.974756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9680d83-ec08-4ae0-861f-b1ed37f98f80 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:12.043044 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:12.079560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9680d83-ec08-4ae0-861f-b1ed37f98f80 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:12.116896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:12.117699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:12.117988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:12.118262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] PATH_INFO: `/v3/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:12.119751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] RBAC: Authorizing `identity:get_role(role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:12.121145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:12.122584 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 546/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:11 2022] GET /identity/v3/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:12.129087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:12.225462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1b7c5-1f43-4d4a-a738-3500c82d92dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:12.241861 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:12.259182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:12.260036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:12.260312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:12.260582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] PATH_INFO: `/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:12.261780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] RBAC: Authorizing `identity:get_user(user_id=4f0ee7a2f77b4f5897d7589f87ff63fc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:12.263204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:12.264808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 575/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:12 2022] GET /identity/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:12.271258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:12.369825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5dd4c-252d-4ec3-b967-9dae9d7d21c4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:12.403234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:12.404094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:12.404378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:12.404656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:12.405879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:12.407317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452f7b-1f29-4848-b46e-10b178070740 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:12.409098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 547/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:12 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:12.415405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:12.516310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a753c6-78cc-4728-b10a-2229c9c1c284 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:12.551676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:12.552555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:12.552836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:12.553109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1/users/4f0ee7a2f77b4f5897d7589f87ff63fc/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:12.555338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] RBAC: Authorizing `identity:create_grant(project_id=e0cbaa376039493fb210072cb2ecbdc1, user_id=4f0ee7a2f77b4f5897d7589f87ff63fc, role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:12.556766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f89f1-6f60-4d68-8103-e919e4bb481a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:12.571271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 576/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:12 2022] PUT /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1/users/4f0ee7a2f77b4f5897d7589f87ff63fc/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:14.640217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6a3f-ea00-40ed-81bb-2fb5970fb221 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:14.640749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6a3f-ea00-40ed-81bb-2fb5970fb221 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:14.640749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6a3f-ea00-40ed-81bb-2fb5970fb221 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.642166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 548/1124] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:14.648354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:14.648761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:14.648910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.666057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:14.667237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:14.705255 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:14.733965 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 577/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:14.757828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6a3f-ea00-40ed-81bb-2fb5970fb221 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:14.760683 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:14.859555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6a3f-ea00-40ed-81bb-2fb5970fb221 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:14.893859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:14.894631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:14.894906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:14.895194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] PATH_INFO: `/v3/roles/d04ca0be67dd4272bdd0487db7c776b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:14.896646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] RBAC: Authorizing `identity:get_role(role_id=d04ca0be67dd4272bdd0487db7c776b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:14.898042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:14.899411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 549/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:14 2022] GET /identity/v3/roles/d04ca0be67dd4272bdd0487db7c776b9 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:14.905299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:15.004473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4ce7c-8465-42ca-a08c-fdb2f10b2b29 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:15.040720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:15.041599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:15.041904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:15.042177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] PATH_INFO: `/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:15.043372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] RBAC: Authorizing `identity:get_user(user_id=4f0ee7a2f77b4f5897d7589f87ff63fc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:15.044809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:15.046498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 578/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:14 2022] GET /identity/v3/users/4f0ee7a2f77b4f5897d7589f87ff63fc => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:15.052465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:15.127944 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:15.165547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213c9c4-a6a9-4277-a5f0-3f08bdcf7df8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:15.200550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:15.201198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:15.201480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:15.201784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:15.269966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:15.271427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:15.338129 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:15.371322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 550/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:15.377457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:15.423464 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:15.485424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9fd6d-d250-4e46-8c9c-429421dd18fe None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:15.520414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:15.521272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:15.521551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:15.521852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] PATH_INFO: `/v3/projects/e0cbaa376039493fb210072cb2ecbdc1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:15.523035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=e0cbaa376039493fb210072cb2ecbdc1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:15.524466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035efcdd-24fc-4b7f-a0ea-17fb26fdd1f6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:15.526365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 579/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:15 2022] GET /identity/v3/projects/e0cbaa376039493fb210072cb2ecbdc1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:15.534041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:15.649500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7890-516e-4dcf-be8a-fa18c4dfc12d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:15.686080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:15.686651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:15.686931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:15.687211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:15.688043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] RBAC: Adding query filter params (role.id=d04ca0be67dd4272bdd0487db7c776b9, scope.project.id=e0cbaa376039493fb210072cb2ecbdc1, user.id=4f0ee7a2f77b4f5897d7589f87ff63fc) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:15.688351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:15.690916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd9888-809a-4661-9a75-0756bb778a19 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:15.696719 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 551/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:15 2022] GET /identity/v3/role_assignments?user.id=4f0ee7a2f77b4f5897d7589f87ff63fc&scope.project.id=e0cbaa376039493fb210072cb2ecbdc1&role.id=d04ca0be67dd4272bdd0487db7c776b9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:17.778027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18feae-fc92-4a6c-a637-9d96f08bdd79 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:17.778557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18feae-fc92-4a6c-a637-9d96f08bdd79 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:17.778557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18feae-fc92-4a6c-a637-9d96f08bdd79 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:17.779925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 580/1131] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:17.785502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:17.785947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:17.786095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:17.803728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:17.804921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:17.832515 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:17.874251 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 552/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:17.897932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18feae-fc92-4a6c-a637-9d96f08bdd79 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:17.997800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18feae-fc92-4a6c-a637-9d96f08bdd79 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:18.008143 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:18.031094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:18.031840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:18.032123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:18.032399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:18.034134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:18.035564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707263-5c51-4dcf-905b-7398ad26daab None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:18.037174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 581/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:18.043170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:18.141398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27984d3-7d03-4062-90dd-9c92e470953f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:18.174776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:18.175455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:18.175735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:18.176003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:18.176738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:18.178193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009057b2-5d36-4a9c-a618-d147292105fb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:18.204127 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 553/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:54:18 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:20.296129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cf81-21e4-40be-b0a6-44f7c3617921 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.296644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cf81-21e4-40be-b0a6-44f7c3617921 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.296762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cf81-21e4-40be-b0a6-44f7c3617921 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.298071 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 582/1135] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:20.303615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.303996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.304172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.321292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:20.322513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:20.333623 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:20.389073 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 554/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:20.413471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003cf81-21e4-40be-b0a6-44f7c3617921 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.511513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003cf81-21e4-40be-b0a6-44f7c3617921 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.543832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.544617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.544896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.545168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.546335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.547750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef5423-2c89-499a-9727-e32b2c7a1b46 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.550142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 583/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:20.555886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:20.656024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5dad-2eb1-492d-a896-a08cf9d1fac2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:20.691545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:20.692205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:20.692485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:20.692760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:20.693482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:20.694974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5ff5-5c5d-4d51-9bea-13f65f018555 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:20.714110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 555/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:54:20 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:22.878646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c72a-8fd5-456a-88bd-b2e3a7936ee4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:22.879178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c72a-8fd5-456a-88bd-b2e3a7936ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:22.879178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c72a-8fd5-456a-88bd-b2e3a7936ee4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:22.880569 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 584/1139] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:22.886109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:22.886517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:22.886657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:22.891622 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:22.904699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:22.905910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:22.972208 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 556/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:22.997808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c72a-8fd5-456a-88bd-b2e3a7936ee4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.045181 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.099884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c72a-8fd5-456a-88bd-b2e3a7936ee4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.134837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.135552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.135836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.136112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.146165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:23.153830 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:23.154924 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:23.156114 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 585/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:23.161592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.258254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53dd3a-3bec-46e8-ae5d-1f7fa86d90d9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.287555 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.292691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.293641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.294034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.294306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.295052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:23.295350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.296720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.305433 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 557/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:23.311638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.410055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4792a0-1a76-4055-8e91-b1948391f7aa None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.416660 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.443871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.444737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.445017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.445291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] PATH_INFO: `/v3/users/bd8fb2fe95f64da193bdc71a72159771` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.458887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] RBAC: Authorizing `identity:get_user(user_id=bd8fb2fe95f64da193bdc71a72159771)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.460320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.462029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 586/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/users/bd8fb2fe95f64da193bdc71a72159771 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:23.468077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.565981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe9eb9-868d-4536-8090-e22deabde8f4 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.601024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.601665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.601970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.602242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.660710 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:23.668534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.670014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.765244 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 558/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:23.772000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:23.870047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a7488-69db-4b98-a27c-8726ef7b2357 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:23.919557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:23.920334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:23.920615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:23.920888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] PATH_INFO: `/v3/projects/f1173b0c1f244cb6942725bfa2d66d60` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:23.922106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] RBAC: Authorizing `identity:get_project(project_id=f1173b0c1f244cb6942725bfa2d66d60)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:23.923538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275704-2379-4df8-b712-5b95fd3c10d9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:23.925302 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 587/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/projects/f1173b0c1f244cb6942725bfa2d66d60 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:23.931499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:24.029982 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:24.037564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30dce-000c-46cb-8535-39f91e399873 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:24.072394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:24.073048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:24.073331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:24.073607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:24.074473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=f1173b0c1f244cb6942725bfa2d66d60, user.id=bd8fb2fe95f64da193bdc71a72159771) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:24.074785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:24.076228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497879d-f8d8-4daf-97c8-f49b1f3af7b6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:24.081929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 559/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:23 2022] GET /identity/v3/role_assignments?user.id=bd8fb2fe95f64da193bdc71a72159771&scope.project.id=f1173b0c1f244cb6942725bfa2d66d60&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:26.103578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e848-85fe-4072-8f51-f0f8a2dbe489 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.104106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e848-85fe-4072-8f51-f0f8a2dbe489 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.104106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e848-85fe-4072-8f51-f0f8a2dbe489 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.105480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 588/1147] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:26.110697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.111215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.111320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.129619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:26.130851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:26.195925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 560/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:26.218764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e848-85fe-4072-8f51-f0f8a2dbe489 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:26.249905 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:26.319471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e848-85fe-4072-8f51-f0f8a2dbe489 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:26.353061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:26.353920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.354151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.354423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.364997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:26.372646 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:26.373723 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:26.375061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 589/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:26.380654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:26.465376 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:26.478114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f134f-04d4-4ac8-84da-21ccfa7e22b7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:26.510674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:26.511334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.511611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.511881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.512632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:26.512931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:26.514325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:26.522976 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 561/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:26.528969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:26.620489 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:26.629889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f246-e4e8-4ec7-bd29-b27989299389 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:26.664345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:26.665221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.665501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.665810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] PATH_INFO: `/v3/users/bd8fb2fe95f64da193bdc71a72159771` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.666996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] RBAC: Authorizing `identity:get_user(user_id=bd8fb2fe95f64da193bdc71a72159771)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:26.668431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:26.670092 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 590/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:26 2022] GET /identity/v3/users/bd8fb2fe95f64da193bdc71a72159771 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:26.676115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:26.777365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e5398-ec4c-4d59-897a-c5d57ba48e52 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:26.811067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:26.811927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.812207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.812479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] PATH_INFO: `/v3/projects/f1173b0c1f244cb6942725bfa2d66d60` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.813680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] RBAC: Authorizing `identity:get_project(project_id=f1173b0c1f244cb6942725bfa2d66d60)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:26.815183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eed4f-ec0c-424b-8450-bee8d7fc5bde None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:26.816888 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 562/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:26 2022] GET /identity/v3/projects/f1173b0c1f244cb6942725bfa2d66d60 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:26.822862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:26.921721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fce4c-b0b9-4aaf-af81-bf79c988f237 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:26.956391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:26.957282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:26.957568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:26.957872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] PATH_INFO: `/v3/projects/f1173b0c1f244cb6942725bfa2d66d60/users/bd8fb2fe95f64da193bdc71a72159771/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:26.960343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1173b0c1f244cb6942725bfa2d66d60, user_id=bd8fb2fe95f64da193bdc71a72159771, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:26.961822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600978-f186-4785-bb9b-66c1f2126024 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:26.975943 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 591/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:26 2022] PUT /identity/v3/projects/f1173b0c1f244cb6942725bfa2d66d60/users/bd8fb2fe95f64da193bdc71a72159771/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:29.000781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78c1f-4561-49c3-b267-6c8d42389028 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.001385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78c1f-4561-49c3-b267-6c8d42389028 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.001385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78c1f-4561-49c3-b267-6c8d42389028 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.002768 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 563/1154] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:29.008215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.008626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.008777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.025747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:29.026944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:29.041529 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:29.106680 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 592/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:29.131286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78c1f-4561-49c3-b267-6c8d42389028 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:29.151513 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:29.235588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78c1f-4561-49c3-b267-6c8d42389028 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:29.292118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:29.292970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.293261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.293596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.305308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:29.313005 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:29.315258 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:29.316303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 564/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:29.321008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:29.425061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd1fd5-9673-46b7-ad6b-aa9a8fc6aae9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:29.460383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:29.461052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.461337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.461616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.462407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:29.462717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:29.464091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:29.472955 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 593/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:29.479675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:29.577192 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:29.603095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6081a5-0843-4aa6-b9fd-da2fab777025 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:29.640389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:29.641268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.641546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.641853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] PATH_INFO: `/v3/users/bd8fb2fe95f64da193bdc71a72159771` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.643736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] RBAC: Authorizing `identity:get_user(user_id=bd8fb2fe95f64da193bdc71a72159771)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:29.645184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:29.646889 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 565/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:29 2022] GET /identity/v3/users/bd8fb2fe95f64da193bdc71a72159771 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:29.655253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:29.676493 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:29.822963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd4ae-67c0-40a4-ac42-d53c761dadba None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:29.863607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:29.864153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:29.864437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:29.864715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:29.942591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:29.944053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:29.962472 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:30.060523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 594/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:30.066920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:30.181137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317c35b-f9b4-450d-937a-8d3f1cb968be None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:30.223167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:30.224060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.224341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.224613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] PATH_INFO: `/v3/projects/f1173b0c1f244cb6942725bfa2d66d60` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.225927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] RBAC: Authorizing `identity:get_project(project_id=f1173b0c1f244cb6942725bfa2d66d60)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:30.227383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966e63-0d42-4b85-b56d-2718ef890b3f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:30.229278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 566/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:30 2022] GET /identity/v3/projects/f1173b0c1f244cb6942725bfa2d66d60 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:30.236547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:30.347084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb0a6-3326-4d00-b5e5-a2305f3bf305 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:30.363572 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:30.393749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:30.394344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:30.394626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:30.394900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:30.395758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=f1173b0c1f244cb6942725bfa2d66d60, user.id=bd8fb2fe95f64da193bdc71a72159771) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:30.396069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:30.397553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911b3ca-c9fd-4cc4-bf2f-ca3d08679eb6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:30.404497 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 595/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:30 2022] GET /identity/v3/role_assignments?user.id=bd8fb2fe95f64da193bdc71a72159771&scope.project.id=f1173b0c1f244cb6942725bfa2d66d60&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:32.543096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d6f-df06-4417-b4c1-9bc1b168f1af None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:32.543724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d6f-df06-4417-b4c1-9bc1b168f1af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:32.543724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97d6f-df06-4417-b4c1-9bc1b168f1af None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:32.545034 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 567/1162] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:32.551471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:32.552019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:32.552019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:32.569512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:32.570805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:32.642606 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 596/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:54:32.665988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97d6f-df06-4417-b4c1-9bc1b168f1af None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:32.683575 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:32.779382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97d6f-df06-4417-b4c1-9bc1b168f1af None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:32.817769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:32.818358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:32.818642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:32.818919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:32.893261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:32.895061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:32.911139 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.004520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 568/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:54:33.010697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.125972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a9f2-c4a5-47a6-a75f-405e0efde155 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.135207 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.165546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.166560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.166835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.167106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.175027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:33.176476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-563ad5aa-adf8-4296-9553-0598b9137c23 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:33.192096 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:33.193614 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:33.195732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 597/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:33.201268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:33.307492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e17-b8a0-4949-881c-e718c409d1f0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:33.324029 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:33.348217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:33.348889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:33.349167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:33.349435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:33.350386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:33.350727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:33.352167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadce1b-768b-4cd1-b4da-55b6cbad12d7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:33.360146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 569/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Jul 24 00:54:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:35.569034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea108835-604c-4b88-9d76-606a402c7978 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:35.569580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea108835-604c-4b88-9d76-606a402c7978 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:35.569580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea108835-604c-4b88-9d76-606a402c7978 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:35.571017 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 598/1167] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:35.576394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398a21-b4c1-4dee-bea8-78c70435cecd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:35.576803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398a21-b4c1-4dee-bea8-78c70435cecd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:35.576959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398a21-b4c1-4dee-bea8-78c70435cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:35.593686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e7398a21-b4c1-4dee-bea8-78c70435cecd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:35.594894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e7398a21-b4c1-4dee-bea8-78c70435cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:35.661571 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 570/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:35.684968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea108835-604c-4b88-9d76-606a402c7978 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:35.788587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea108835-604c-4b88-9d76-606a402c7978 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:35.822179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:35.822770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:35.823056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:35.823334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:35.824085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:35.825483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b83b4-202c-4309-b2ba-b5ae7fce5672 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:35.840946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 599/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sun Jul 24 00:54:35 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:37.977222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb691ecc-3d18-42fc-910a-41813352f9e0 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:37.977817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb691ecc-3d18-42fc-910a-41813352f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:37.977817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb691ecc-3d18-42fc-910a-41813352f9e0 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:37.979221 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 571/1170] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:37.985938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:37.986568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:37.986568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:38.006229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:38.007497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:38.030304 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:38.083010 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 600/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:38.108177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb691ecc-3d18-42fc-910a-41813352f9e0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:38.216250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb691ecc-3d18-42fc-910a-41813352f9e0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:38.227079 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:38.252505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:38.253291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:38.253571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:38.253878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] PATH_INFO: `/v3/domains/ecb5df7b7a544661ac5d961609dfe6b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:38.267312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ecb5df7b7a544661ac5d961609dfe6b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:38.268760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d01dc-8711-4203-812c-8718ec3cb754 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:38.271347 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 572/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Jul 24 00:54:38 2022] GET /identity/v3/domains/ecb5df7b7a544661ac5d961609dfe6b5 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:38.277389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:38.378405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02d4e-ce76-4624-a322-9ec701f12a45 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:38.414015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:38.414893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:38.415263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:38.415630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:38.416616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:38.418624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edfd4-4d22-4439-934c-7ad54c4fbcd6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:38.449702 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 601/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:54:38 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:40.548981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253105a6-a36b-4acb-a0cf-aac2dd8f7fff None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.549542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253105a6-a36b-4acb-a0cf-aac2dd8f7fff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.549542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253105a6-a36b-4acb-a0cf-aac2dd8f7fff None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.550978 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 573/1174] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:40.556474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.556937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.557050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.574323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:40.575521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:40.577871 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:40.654724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 602/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:40.678818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253105a6-a36b-4acb-a0cf-aac2dd8f7fff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:40.781573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253105a6-a36b-4acb-a0cf-aac2dd8f7fff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:40.816100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:40.816894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.817174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.817463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] PATH_INFO: `/v3/domains/ecb5df7b7a544661ac5d961609dfe6b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.818697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ecb5df7b7a544661ac5d961609dfe6b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:40.820140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec292e8a-fc99-46ff-bffd-1f3fa0be3372 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:40.821791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 574/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Jul 24 00:54:40 2022] GET /identity/v3/domains/ecb5df7b7a544661ac5d961609dfe6b5 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:40.828739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:40.930427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9dec9-c0a1-4988-9715-10b223e4de20 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:40.966050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:40.966719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:40.966997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:40.967273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:40.967998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:40.969464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cf65-6f01-48cb-8dee-494cf2fa607b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:40.978634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:40.992190 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 603/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:54:40 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:54:43.130766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a24eef-3d9e-4945-ae26-7c0d3575dfb1 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.131319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a24eef-3d9e-4945-ae26-7c0d3575dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.131451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a24eef-3d9e-4945-ae26-7c0d3575dfb1 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:43.132809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 575/1178] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:54:43.138708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.139192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.139337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:43.156197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:43.157490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:43.229786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 604/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:54:43.254166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a24eef-3d9e-4945-ae26-7c0d3575dfb1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:43.292912 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:43.363795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a24eef-3d9e-4945-ae26-7c0d3575dfb1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:43.403719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:43.404506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.404889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.405209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:43.417206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:43.425806 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:43.426872 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:43.428069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 576/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:43.434054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:43.538949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709a77-3560-4f52-bafc-1a0a6208f081 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:43.566061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:43.584709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:43.585908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.586407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.586901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:43.588309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:43.588876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:43.591838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:43.609528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 605/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:43.616052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:43.721142 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:43.728030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62dcb-ded4-4ea0-929a-1f4cd0173a83 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:43.766074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:43.768043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.768370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.768689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] PATH_INFO: `/v3/users/47f8d435a55747eb81bc5e8e571aa088` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:43.783796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=47f8d435a55747eb81bc5e8e571aa088)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:43.785338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:43.787229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 577/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:43 2022] GET /identity/v3/users/47f8d435a55747eb81bc5e8e571aa088 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:43.793500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:43.905582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04325b78-b137-4dd6-802e-f085e8344021 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:43.941827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:43.942485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:43.942760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:43.943025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:44.002556 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:44.016849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:44.018791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:44.124905 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 606/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:44.131748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:44.246402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80ce57-8978-4ded-8961-6673ab92b4d9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:44.280392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:44.281254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:44.281529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:44.282360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] PATH_INFO: `/v3/projects/e1822300093b40c08a849469f4fb81eb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:44.283566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] RBAC: Authorizing `identity:get_project(project_id=e1822300093b40c08a849469f4fb81eb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:44.285006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a21a8-ba14-43b4-a358-dc9d5190aa87 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:44.286741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 578/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:44 2022] GET /identity/v3/projects/e1822300093b40c08a849469f4fb81eb => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:44.292966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:44.384649 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:44.400589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f0cfc-107b-415c-8276-4e634d671e5a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:44.436992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:44.437648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:44.437960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:44.439030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:44.440280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=e1822300093b40c08a849469f4fb81eb, user.id=47f8d435a55747eb81bc5e8e571aa088) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:44.440594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:44.442071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f345f83-3ecc-4c93-b0eb-e6f3df446e0f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:44.447939 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 607/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:44 2022] GET /identity/v3/role_assignments?user.id=47f8d435a55747eb81bc5e8e571aa088&scope.project.id=e1822300093b40c08a849469f4fb81eb&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:46.555813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05873-d791-4646-b3a1-53aeeb87f35b None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:46.556379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05873-d791-4646-b3a1-53aeeb87f35b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:46.556379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05873-d791-4646-b3a1-53aeeb87f35b None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:46.557926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 579/1186] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:54:46.565568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5349-8080-41c1-8789-c252f9391360 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:46.566151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5349-8080-41c1-8789-c252f9391360 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:46.566544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df5349-8080-41c1-8789-c252f9391360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:46.594574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02df5349-8080-41c1-8789-c252f9391360 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:46.596612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02df5349-8080-41c1-8789-c252f9391360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:46.691630 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 608/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:46.715696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c05873-d791-4646-b3a1-53aeeb87f35b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:46.746310 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:46.835241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c05873-d791-4646-b3a1-53aeeb87f35b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:46.874308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:46.875206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:46.876206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:46.876653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:46.889141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:46.898845 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:46.900685 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:54:46.902686 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 580/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:46.908026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5349-8080-41c1-8789-c252f9391360 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:46.996048 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:47.017926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df5349-8080-41c1-8789-c252f9391360 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:47.057141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:47.057840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:47.058122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:47.058395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:47.059156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:47.059462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:47.060840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:47.070328 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 609/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:47.080780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:47.187667 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:47.208707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9eeab-5a35-430c-938c-acd11510c9a7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:47.248217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:47.249090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:47.249372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:47.249647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] PATH_INFO: `/v3/users/47f8d435a55747eb81bc5e8e571aa088` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:47.250936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] RBAC: Authorizing `identity:get_user(user_id=47f8d435a55747eb81bc5e8e571aa088)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:47.252381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:47.254064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 581/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:47 2022] GET /identity/v3/users/47f8d435a55747eb81bc5e8e571aa088 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:47.263128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:47.370195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69856ce-0959-4b2a-9bce-adec2b63e03b None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:47.406185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:47.407518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:47.407518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:47.407846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] PATH_INFO: `/v3/projects/e1822300093b40c08a849469f4fb81eb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:47.409899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] RBAC: Authorizing `identity:get_project(project_id=e1822300093b40c08a849469f4fb81eb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:47.411348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bf4fc-d5f6-4d3a-9109-dfef65c9025e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:47.413094 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 610/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:47 2022] GET /identity/v3/projects/e1822300093b40c08a849469f4fb81eb => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:47.423179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:47.534936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c353c2-92e3-48df-9290-ba7a942cd14b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:47.569946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:47.570891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:47.571220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:47.571544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] PATH_INFO: `/v3/projects/e1822300093b40c08a849469f4fb81eb/users/47f8d435a55747eb81bc5e8e571aa088/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:47.573609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] RBAC: Authorizing `identity:create_grant(project_id=e1822300093b40c08a849469f4fb81eb, user_id=47f8d435a55747eb81bc5e8e571aa088, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:47.575196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd94fc-646e-4666-938a-75989a29201e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:47.591357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 582/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:54:47 2022] PUT /identity/v3/projects/e1822300093b40c08a849469f4fb81eb/users/47f8d435a55747eb81bc5e8e571aa088/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:54:49.672489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17710a5f-4a46-49a8-9f25-fa84a04400b7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:49.673047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17710a5f-4a46-49a8-9f25-fa84a04400b7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:49.673047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17710a5f-4a46-49a8-9f25-fa84a04400b7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:49.674495 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 611/1193] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:54:49.680841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:49.681563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:49.681563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:49.699054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:54:49.700276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:54:49.703877 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:49.778581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 583/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:54:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:54:49.819657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17710a5f-4a46-49a8-9f25-fa84a04400b7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:49.835169 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:49.938677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17710a5f-4a46-49a8-9f25-fa84a04400b7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:49.975927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:49.976733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:49.977016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:49.977291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:49.990049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:54:49.997766 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:54:49.999632 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:54:50.001425 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 612/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:54:50.007175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:50.118155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c0695-574b-41ee-b430-4e9efad965a3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:50.185217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:50.186446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:50.186952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:50.187447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:50.189123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:50.189603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:50.192324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:50.209403 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 584/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:50.216004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:50.297921 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:50.332510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f293669-7b53-41c5-ba56-4c7baa6dca92 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:50.370541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:50.371419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:50.371700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:50.371972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] PATH_INFO: `/v3/users/47f8d435a55747eb81bc5e8e571aa088` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:50.373189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] RBAC: Authorizing `identity:get_user(user_id=47f8d435a55747eb81bc5e8e571aa088)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:50.374674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:50.377240 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 613/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Jul 24 00:54:50 2022] GET /identity/v3/users/47f8d435a55747eb81bc5e8e571aa088 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:54:50.383352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:50.386335 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:50.497985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd75c-033c-42fa-a6c8-cfb98804612e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:50.534635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:50.535311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:50.535595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:50.535873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:50.617736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:50.619268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:50.621562 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:50.748864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 585/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:54:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:54:50.756129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:50.908488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ca87-d0da-4e34-be4b-91e1c9dfc232 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:50.946740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:50.947605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:50.947884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:50.948156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] PATH_INFO: `/v3/projects/e1822300093b40c08a849469f4fb81eb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:50.949351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] RBAC: Authorizing `identity:get_project(project_id=e1822300093b40c08a849469f4fb81eb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:50.950900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaeb933-960e-4b88-b671-ec21c00ddca3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:50.952618 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 614/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Jul 24 00:54:50 2022] GET /identity/v3/projects/e1822300093b40c08a849469f4fb81eb => generated 361 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:54:50.959696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:54:51.110764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2641b-fcbc-4e0c-b0c6-5d75d13af32c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:54:51.113499 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:54:51.172947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:54:51.174074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:54:51.174559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:54:51.175018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:54:51.176575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=e1822300093b40c08a849469f4fb81eb, user.id=47f8d435a55747eb81bc5e8e571aa088) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:54:51.177117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:54:51.179748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531de44c-2093-4fec-8f3f-8e9d1750288b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:54:51.191431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 586/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:54:50 2022] GET /identity/v3/role_assignments?user.id=47f8d435a55747eb81bc5e8e571aa088&scope.project.id=e1822300093b40c08a849469f4fb81eb&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:00.942411 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:01.185943 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=17 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:52.772935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375704c-7232-406f-aa77-ecbe53898602 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.773837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375704c-7232-406f-aa77-ecbe53898602 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.773837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375704c-7232-406f-aa77-ecbe53898602 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.774977 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 615/1201] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:52.782575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:52.783346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:52.783545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:52.812819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:52.814864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:52.961387 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 587/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:55:52.987927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375704c-7232-406f-aa77-ecbe53898602 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.208638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375704c-7232-406f-aa77-ecbe53898602 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.273196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887501-efab-4789-a996-c5564d08b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.274537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887501-efab-4789-a996-c5564d08b088 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.274935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887501-efab-4789-a996-c5564d08b088 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.275184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887501-efab-4789-a996-c5564d08b088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.293413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887501-efab-4789-a996-c5564d08b088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.295681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887501-efab-4789-a996-c5564d08b088 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-44887501-efab-4789-a996-c5564d08b088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:53.330599 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:53.332926 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:53.334816 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:53.334816 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:53.334816 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:53.334816 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:55:53.334816 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 616/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:53.343033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.539490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cf48b-ad4f-484a-bf93-0a2ec0aaf7a7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.602935 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.614258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.615000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.615328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.615838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.616751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:53.617057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.618536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54bc4-249e-4856-84a4-5a23b3e19d8a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.640385 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 588/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:53.647145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887501-efab-4789-a996-c5564d08b088 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:53.755739 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:53.828008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887501-efab-4789-a996-c5564d08b088 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:53.893343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:53.894295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:53.894796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:53.895182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:53.896235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:53.897914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5cf5-8bd6-4a41-8e5f-f5307aa8b33d None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:53.936840 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 617/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Jul 24 00:55:53 2022] POST /identity/v3/users => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:55:56.533823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa2a4-d04e-4f06-8a69-0b9a2ad37ce6 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.533823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa2a4-d04e-4f06-8a69-0b9a2ad37ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.533823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fa2a4-d04e-4f06-8a69-0b9a2ad37ce6 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.535229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 589/1206] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:55:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:55:56.542804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.543692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.543840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.571319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:55:56.573139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:55:56.729968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 618/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:55:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:55:56.743956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fa2a4-d04e-4f06-8a69-0b9a2ad37ce6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:56.905142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fa2a4-d04e-4f06-8a69-0b9a2ad37ce6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:56.950910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:56.951936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:56.952246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:56.952506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:56.967175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:55:56.975366 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:56.977070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:55:56.979024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 590/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:56.983207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.067070 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.197909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b571f2-bb64-4988-b4e2-495d97c17bf0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.264684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.268160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.268160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.268160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.268160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:57.268160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.270370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.281585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 619/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:55:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:55:57.292162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.385050 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.495432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3659e1-556f-4a4d-885f-3b35a343568a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.563560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.564982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.565477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.565995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.588269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.591592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:57.625326 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:57.626316 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:57.627177 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:57.627177 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:57.627177 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:57.627177 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:55:57.629573 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 591/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:55:57.639530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:57.880073 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:57.892589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5703c-2ef5-4de7-8118-a12c13d8ba27 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:57.967579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:57.968572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:57.968977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:57.969345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:57.970122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:57.970432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:57.971954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:57.987357 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 620/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:57.998277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.150601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55faf86-f9e9-4e0c-8f24-00127db814db None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.153733 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:58.244507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.246267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.246835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.247540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.265010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.268451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:55:58.300203 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:58.301311 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:55:58.302619 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:55:58.303183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 592/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:58.316264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.541971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2082-b097-4e3b-b756-e97fd1b9f14e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.618587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.619632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.620121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.620508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.622578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:58.623087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:58.625646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:58.656212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 621/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:55:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:58.664611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:58.852740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d524a-cd39-4c98-a8f3-f7778e6d6fb1 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:58.914256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:58.915258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:58.915706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:58.916958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:58.975353 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:59.050478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:59.053352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:59.242427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 593/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:55:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:55:59.250680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:59.285223 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:59.430120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72360a-2e51-4690-9510-bc7e6129a0fd None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:59.482753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:59.483667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:59.483947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:59.484217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:59.496005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:59.498358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:55:59.519316 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:59.520476 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:59.521860 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:55:59.521860 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:55:59.521860 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:55:59.521860 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:55:59.521860 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 622/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:59.531375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:59.623915 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:59.666629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287b7f-4218-4206-8799-49c8f6e7257e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:59.710971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:59.711568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:59.711848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:59.712124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:59.712872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:55:59.713179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:59.714875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:59.735754 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 594/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:55:59.737786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:55:59.842911 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:55:59.892116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127011-fd9d-4020-b2c6-ba1fdf959f76 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:55:59.938912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:55:59.940283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:55:59.940783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:55:59.941209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:55:59.952587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:55:59.954383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:55:59.974977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:55:59.976587 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:55:59.978053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 623/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:55:59.984566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:00.131053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb34d4-c898-4663-a007-7927a019e564 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:00.158395 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:00.171813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:00.172489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:00.172770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:00.173045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:00.173880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:00.174186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:00.175635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca935f25-a7d6-4e81-88ef-0e60d13fd608 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:00.191690 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 595/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:00.199629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:00.363850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ed1e6-a51e-4ae0-bc37-5cba39919c7f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:00.407115 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:00.413948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:00.414613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:00.414889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:00.415159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:00.416004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=b53dad04ecf24d408a3551814785a20c) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:00.416313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:00.417870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87b99a-895a-4f3c-b25c-2aa2fe4305d3 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:00.425706 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 624/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:56:00 2022] GET /identity/v3/role_assignments?user.id=b53dad04ecf24d408a3551814785a20c&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:02.594466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63eaf-f415-4f70-9866-64ca31f278bc None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.594999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63eaf-f415-4f70-9866-64ca31f278bc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.595122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e63eaf-f415-4f70-9866-64ca31f278bc None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.597422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 596/1220] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:56:02.604282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.604789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.604877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.622998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:02.624261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:02.716910 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 625/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:02.748140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e63eaf-f415-4f70-9866-64ca31f278bc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:02.894427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e63eaf-f415-4f70-9866-64ca31f278bc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:02.949525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:02.950379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:02.950663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:02.950940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:02.964045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:02.973004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:02.974810 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:02.975957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 597/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:02.986035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:03.135501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6a0e2-78ec-47ce-abe1-20a9dfbfcd4b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:03.174463 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:03.187665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:03.188399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:03.188843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:03.189318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:03.190148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:03.190574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:03.192139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:03.202423 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 626/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:03.209559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:03.261203 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:03.333946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761d3a5-1771-4cde-b537-817592ef421d None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:03.377510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:03.378358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:03.378639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:03.378923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:03.392591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:03.394495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:03.416961 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:03.417994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:03.419496 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:03.419496 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:03.419496 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:03.419496 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:03.420268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 598/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:03.428023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:03.557369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2ba4-8308-4b25-8957-68a17a7f5f26 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:03.598426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:03.599104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:03.599442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:03.599706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:03.600601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:03.600906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:03.602516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:03.628051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 627/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:03.629707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:03.750078 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:03.758403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a19b8-d026-44eb-8a99-481ba26375fb None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:03.799578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:03.800394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:03.800664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:03.800929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:03.810383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:03.812116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:03.830483 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:03.839325 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:03.841641 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 599/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:03.842518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:03.914752 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:04.000860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe53a1-214c-446b-8445-bf7a8ff1c742 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:04.048207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:04.049545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:04.049982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:04.050288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:04.051262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:04.051616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:04.053234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:04.076746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 628/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:04.082771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:04.223719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2135c2-79b5-4646-8f8c-9ea571f5381c None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:04.268173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:04.268860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:04.269145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:04.269431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:04.290984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:04.292482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:04.311185 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:04.312345 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:04.313370 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:04.313370 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:04.313370 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:04.313370 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:04.313370 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 600/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:04.318457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:04.440384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60badc8-739a-43e7-863e-0805d9ddb26f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:04.443300 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:04.483729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:04.484409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:04.484690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:04.485043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:04.485758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:04.486066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:04.487480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:04.501288 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 629/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:04.507659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:04.519445 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:04.652523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef92b4-6454-4dd1-88be-874de3fa001f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:04.701891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:04.702777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:04.703105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:04.703542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:04.712150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:04.714166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:04.730068 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:04.734419 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:04.735520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 601/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:04.740401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:04.868815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466385f1-2875-4c4c-8a68-b0e63cdf639f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:04.914070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:04.914767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:04.915046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:04.915311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:04.916207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:04.916501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:04.918616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd517a2-daca-4a8f-8393-21011feffbb6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:04.934340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 630/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:04.941363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:05.040367 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:05.100296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a1111-9189-4457-99a9-4d6f93a358b9 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:05.154766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:05.155677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:05.156668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:05.156668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/b53dad04ecf24d408a3551814785a20c/roles/d9656bd9e781411b81450b33fbf4c7f9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:05.181682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=b53dad04ecf24d408a3551814785a20c, role_id=d9656bd9e781411b81450b33fbf4c7f9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:05.183492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776d3d-9e95-4135-b804-573031829c4b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:05.199114 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 602/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:56:04 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/b53dad04ecf24d408a3551814785a20c/roles/d9656bd9e781411b81450b33fbf4c7f9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:56:07.496967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2979c-af54-45e5-9dea-175cda25f289 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.497799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2979c-af54-45e5-9dea-175cda25f289 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.497799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2979c-af54-45e5-9dea-175cda25f289 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.498821 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 631/1233] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:56:07.505861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c147-4948-495a-a342-cb800a2573ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.506421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c147-4948-495a-a342-cb800a2573ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.506871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470c147-4948-495a-a342-cb800a2573ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.530050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1470c147-4948-495a-a342-cb800a2573ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:07.532341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1470c147-4948-495a-a342-cb800a2573ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:07.613423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 603/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:07.639108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2979c-af54-45e5-9dea-175cda25f289 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:07.674883 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:07.813430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2979c-af54-45e5-9dea-175cda25f289 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:07.883591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:07.884640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:07.885093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:07.885623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:07.906181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:07.920969 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:07.922100 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:56:07.922936 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:07.929324 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 632/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Jul 24 00:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:07.930177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c147-4948-495a-a342-cb800a2573ce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:07.992568 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:08.077965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470c147-4948-495a-a342-cb800a2573ce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:08.136351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:08.137257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:08.137628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:08.138076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:08.138958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] RBAC: Adding query filter params (name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:08.139358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:08.140891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:08.150938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 604/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Jul 24 00:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:08.167442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:08.274863 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:08.294281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4b433-8e18-4ad2-bca7-52d95e6a7c88 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:08.347029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:08.348003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:08.348557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:08.349875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:08.371931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:08.373624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:08.393827 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:08.395539 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:08.396449 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:08.396449 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:08.396449 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:08.396449 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:08.396449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 633/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:08.401537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:08.538775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ac8b-bf71-495b-9c10-e985857a7948 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:08.551762 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:08.581412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:08.582125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:08.582407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:08.582681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:08.583424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:08.583728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:08.585134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:08.602671 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 605/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:08.610784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:08.728135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828535-104d-41d5-af3c-7111d3f2bdd5 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:08.769457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:08.770356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:08.770715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:08.770999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:08.774371 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:08.781880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:08.784033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:08.803196 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:08.804312 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:08.805348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:08.812544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 634/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:08.814118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:08.985559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd8304-4928-4282-a34a-01ed89c33b7a None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:09.045084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:09.046520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:09.046964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:09.047413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:09.048584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:09.049188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:09.050945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:09.082246 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 606/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:09.090290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:09.234874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc06df-e9e9-4189-8002-6eff3d02dbca None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:09.303797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:09.304700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:09.305036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:09.305413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:09.400244 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:09.414886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:09.418628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:09.586115 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 635/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:56:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:56:09.595565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:09.631586 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:09.755632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814634-074d-48c0-a2e4-00a5b650bc54 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:09.823294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:09.825816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:09.826385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:09.826933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:09.847921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:09.851270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:09.885114 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:09.886982 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:09.888866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:09.888866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:09.888866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:09.888866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:09.888866 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 607/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:09.893998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.034456 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:10.043694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725838-a67f-4e2b-81b9-2cd88a04dfbf None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.111310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.112306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.112674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.113058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.114031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:10.114485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.116038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.133420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 636/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:10.141396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.252704 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:10.287085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8302a-414a-456a-a05e-010d6cbbf1c5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.348376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.349710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.350161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.350584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.364493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.367273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:10.393422 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:10.395190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:10.396628 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 608/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:10.406636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.569891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6e3b5-1947-44b1-803a-b19a300ce803 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.612932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.613807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.614196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.614669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.615548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:10.615965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.617511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e3f18-cc7c-4e1e-b9c8-5d2acc0a568a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.631798 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 637/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:10.641218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:10.781409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3533cad-e26d-4525-872c-3be3cb8ffdcd None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:10.827058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:10.827908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:10.828333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:10.828708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:10.829978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] RBAC: Adding query filter params (role.id=d9656bd9e781411b81450b33fbf4c7f9, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=b53dad04ecf24d408a3551814785a20c) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:10.830484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:10.833034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675787be-0d8b-42eb-a90b-2eae92870c0c None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:10.843869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 609/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:56:10 2022] GET /identity/v3/role_assignments?user.id=b53dad04ecf24d408a3551814785a20c&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=d9656bd9e781411b81450b33fbf4c7f9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:13.276735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba600db-19c3-461f-9f7e-22ef98525272 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.278041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba600db-19c3-461f-9f7e-22ef98525272 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.278041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba600db-19c3-461f-9f7e-22ef98525272 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.279314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 638/1247] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:13.285205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.285785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.285785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.291207 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:13.307358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:13.309179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:13.396844 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 610/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:13.423566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba600db-19c3-461f-9f7e-22ef98525272 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.448541 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:13.576717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba600db-19c3-461f-9f7e-22ef98525272 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:13.619228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:13.620035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.620312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.620584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.633755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:13.643890 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:13.645717 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:13.647771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 639/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:13.654313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.798139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751c2ec-8a4b-4089-98f9-dfc8efeef79e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:13.841820 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:13.850125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:13.851295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:13.851772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:13.852148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:13.853063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:13.853375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:13.854872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:13.867791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 611/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:13.875114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:13.998362 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:14.035096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aaf49-f443-4ff7-bb73-4add31e5c5e2 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:14.080166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:14.080917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:14.081198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:14.081475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:14.096752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:14.098547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:14.135893 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:14.137527 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:14.139021 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:14.139021 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:14.139021 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:14.139021 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:14.139021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 640/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:14.148051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:14.286137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa469c7-6bba-4dac-8a67-fd842b909b86 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:14.330437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:14.331178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:14.331523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:14.331860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:14.332757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:14.333064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:14.334956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:14.351223 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 612/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:14.357695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:14.503220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185deb-bb7e-4f6b-a312-0746cddec248 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:14.544987 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:14.554456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:14.555305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:14.555557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:14.555874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:14.565761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:14.567264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:14.584301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:14.586451 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:14.587935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 641/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:14.592428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:14.686114 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:14.753317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271478-026e-4a1a-bcc1-f88a71f70fc5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:14.817038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:14.818097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:14.818721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:14.819090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:14.820746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:14.821286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:14.824883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:14.859239 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 613/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:14.866674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:15.018492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3ee9-5034-4906-be54-a87538c37918 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:15.072790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:15.073549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:15.074373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:15.074730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:15.164342 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:15.185327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:15.187572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:15.333144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 642/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:56:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:56:15.341047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:15.501782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcff7e-c21c-4b34-aeca-3e729820cb36 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:15.523371 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:15.554506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:15.555556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:15.555931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:15.556316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:15.572355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:15.574971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:15.597825 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:15.599580 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:15.601551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:15.601551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:15.601551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:15.601551 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:15.601551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 614/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:15.609882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:15.764564 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:15.783978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bd09d-539e-41f2-884d-0e826e1e772a None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:15.843094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:15.844143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:15.844619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:15.845033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:15.846060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:15.846550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:15.848513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:15.869723 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 643/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:15.874429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:16.054333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eee48-8472-4b14-98b4-5ef57ffd4cb5 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:16.105631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:16.107012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:16.107541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:16.108024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:16.119998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:16.122662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:16.143101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:16.144938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:16.146587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 615/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:16.154721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:16.320797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2bbde-f8c3-4f96-9010-d3f297e287d4 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:16.371042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:16.372398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:16.372879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:16.373371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:16.374912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:16.375451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:16.378226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ca750-630b-4dda-b467-fb843a54986e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:16.400341 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 644/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:16.407799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:16.444468 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:16.565227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176f003-f330-44d5-90b9-5eb301c82a1e None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:16.608815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:16.609486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:16.609789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:16.610062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:16.610917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=b53dad04ecf24d408a3551814785a20c) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:16.611223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:16.612706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85ae24-f66a-40b6-bcc8-68c1dbd4df20 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:16.619595 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 616/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:56:16 2022] GET /identity/v3/role_assignments?user.id=b53dad04ecf24d408a3551814785a20c&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:18.978043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a80f-5828-494c-9c17-92ba91f9a317 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:18.978869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a80f-5828-494c-9c17-92ba91f9a317 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:18.978869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a80f-5828-494c-9c17-92ba91f9a317 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:18.981317 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 645/1261] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:18.988579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:18.989292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:18.989292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:19.013090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:19.014661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:19.105264 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 617/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:19.128829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a80f-5828-494c-9c17-92ba91f9a317 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:19.143451 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:19.270043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a80f-5828-494c-9c17-92ba91f9a317 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:19.310437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:19.311235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:19.311516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:19.311787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:19.322812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:19.331187 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:19.332935 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:19.334980 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 646/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:19.340338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:19.360936 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:19.488305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe907-1a9e-411f-be1a-fe4390df3456 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:19.547928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:19.549048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:19.549558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:19.550083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:19.551516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:19.552054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:19.554694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:19.570838 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 618/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:19.577186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:19.653628 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:19.691283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b54b8-94ab-4362-9f86-29481e9e8135 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:19.729822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:19.730587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:19.730914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:19.731233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:19.742901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:19.744448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:19.763806 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:19.765494 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:19.766663 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:19.766663 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:19.766663 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:19.766663 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:19.766663 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 647/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:19.772222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:19.862760 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:19.891616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db400fd0-dc30-4e67-bbd4-c7883d23fff8 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:19.952624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:19.953706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:19.954245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:19.954756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:19.956023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:19.956591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:19.959164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:19.982180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 619/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:19.988353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:20.118607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261a9dd-3380-4668-afa7-e1cce54d88ee None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:20.144319 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:20.162116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:20.162950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:20.163233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:20.163510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:20.173119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:20.174622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:20.191201 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:20.192849 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:20.195027 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 648/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:20.200251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:20.330783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea2a-82d6-41dd-8178-4e8b8c9034f7 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:20.367016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:20.367687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:20.367967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:20.368240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:20.369149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:20.369397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:20.371319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:20.380749 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:20.390086 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 620/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:20.398736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:20.506914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044779-a89b-48eb-8d57-41f7614aa514 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:20.545569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:20.546397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:20.546677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:20.546947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:20.559109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:20.560640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:20.580089 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:20.581219 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:20.582171 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:20.582171 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:20.582171 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:20.582171 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:20.582171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 649/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:20.587457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:20.696439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c6cd5-6c92-4514-a1ea-e345fea7a528 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:20.734405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:20.735079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:20.735359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:20.735632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:20.736373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:20.736677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:20.738094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:20.751181 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 621/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:20.758225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:20.797906 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:20.879094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c6d4-86b5-4986-9134-892ebfd11e06 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:20.918752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:20.919552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:20.919838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:20.920109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:20.927371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:20.928823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:20.944775 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:20.946531 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:20.947774 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 650/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:20.953493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:21.016145 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:21.062267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5edbf-f415-4cdf-bda0-874d8668de9f None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:21.101489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:21.102183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:21.102462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:21.102733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:21.103534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:21.103835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:21.105736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4acc64-1a37-4876-a585-85d753b3264b None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:21.119055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 622/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:21.126254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:21.223001 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:21.233310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf284f6-6a38-4ddb-bc79-17967bb229de None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:21.269749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:21.270624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:21.270902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:21.271172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] PATH_INFO: `/v3/projects/83474ff648624529bb5284cc6cfdd928/users/b53dad04ecf24d408a3551814785a20c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:21.273110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] RBAC: Authorizing `identity:create_grant(project_id=83474ff648624529bb5284cc6cfdd928, user_id=b53dad04ecf24d408a3551814785a20c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:21.274586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fe8b-633a-4302-a3db-2d58b1f8557c None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:21.289785 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 651/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Jul 24 00:56:21 2022] PUT /identity/v3/projects/83474ff648624529bb5284cc6cfdd928/users/b53dad04ecf24d408a3551814785a20c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:56:23.482662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3326e-b444-4b31-a5cf-757c2d90cd60 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:23.483253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3326e-b444-4b31-a5cf-757c2d90cd60 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:23.483253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3326e-b444-4b31-a5cf-757c2d90cd60 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:23.484827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 623/1274] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:23.490838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:23.491564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:23.491564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:23.510354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:23.512047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:23.590845 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 652/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:23.615324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3326e-b444-4b31-a5cf-757c2d90cd60 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:23.727562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3326e-b444-4b31-a5cf-757c2d90cd60 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:23.747520 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:23.766308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:23.767103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:23.767383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:23.767654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:23.778533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:56:23.786329 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:23.787398 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:23.788606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 624/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Jul 24 00:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:23.795235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:23.917717 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:23.944950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee2095-2c37-4b7d-87ad-e87637378657 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:23.982527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:23.983197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:23.983481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:23.983758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:23.984520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:23.984829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:23.986245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:23.996101 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 653/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Jul 24 00:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:24.002529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:24.113078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173101-8dad-4e6b-ae08-bbd1a5d8682b None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:24.152596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:24.153402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:24.153704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:24.153978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:24.165441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:24.167178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:24.188092 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:24.189934 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:24.191603 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:24.191603 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:24.191603 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:24.191603 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:24.191603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 625/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:24.196014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:24.356345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a3f0a-5c05-4208-b2dd-be03db6bab56 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:24.392872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:24.393534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:24.393854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:24.394130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:24.394876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:24.395179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:24.396560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:24.409421 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 654/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:24.418543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:24.453044 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:24.528619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3afba-0d45-4e19-81bb-9a7cae3d8ece None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:24.577565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:24.578416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:24.578703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:24.578978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:24.587700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:24.589598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:56:24.605994 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:24.608087 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:24.610137 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 626/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:24.614292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:24.618380 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:24.795111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c838b-a3a6-4a15-9037-2448eeb82ce6 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:24.834146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:24.834827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:24.835101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:24.835380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:24.836236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:24.836543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:24.838276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:24.860991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 655/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Jul 24 00:56:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:24.867424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:24.973910 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:24.985210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef4e93-1e45-4ac0-915a-f2b96764c8f0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:25.022094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:25.022757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:25.023042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:25.023320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:25.101290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:25.102802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:25.203290 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:25.215524 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 627/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Jul 24 00:56:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:56:25.221469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:25.295340 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:25.344203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f168ec-0a1d-4123-9051-a36180f2222f None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:25.386040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:25.386743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:25.387080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:25.387363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:25.399535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:25.401040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:56:25.423153 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:25.424918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:25.426753 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:56:25.426753 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:56:25.426753 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:56:25.426753 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:25.426753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 656/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 00:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:56:25.431826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:25.540385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e3c-0ffc-4cd0-b025-8c86bc0167a3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:25.579125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:25.579785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:25.580059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:25.580327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:25.581057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:25.581359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:25.582767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:25.595957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 628/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Jul 24 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:25.601951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:25.712869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5666c-3c29-4d28-b589-6f2f7f813ec9 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:25.729430 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:25.752478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:25.753278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:25.753558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:25.753861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:25.761541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:25.763193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:56:25.778294 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:25.785018 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 00:56:25.786179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 657/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Jul 24 00:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:25.786797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:25.851610 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:25.909987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65ae4-e8d3-424a-ab07-0caf56623d45 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:25.945865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:25.946518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:25.946798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:25.947067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:25.947871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:25.948729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:25.950428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa367c-d7a6-46d3-a6a8-80ca93ccc6b3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:25.963691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 629/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Jul 24 00:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:25.974042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:26.084592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c73f-712a-4b4a-959c-802686bc4e2e None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:26.124238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:26.124913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:26.125198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:26.125476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:26.126366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] RBAC: Adding query filter params (role.id=acd1f0a52de7401597f9dc3d88354f7e, scope.project.id=83474ff648624529bb5284cc6cfdd928, user.id=b53dad04ecf24d408a3551814785a20c) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:26.126678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:26.128139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce164fba-b5d6-40cb-b5c6-73dcd087f74e None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:26.134678 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 658/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Jul 24 00:56:25 2022] GET /identity/v3/role_assignments?user.id=b53dad04ecf24d408a3551814785a20c&scope.project.id=83474ff648624529bb5284cc6cfdd928&role.id=acd1f0a52de7401597f9dc3d88354f7e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:28.266318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324648-996b-4d3d-8256-911188b64bb2 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:28.267172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324648-996b-4d3d-8256-911188b64bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:28.267172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324648-996b-4d3d-8256-911188b64bb2 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:28.268263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 630/1288] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:28.273961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:28.274750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:28.274750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:28.293811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:28.295037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:28.327469 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:28.370444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 659/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:28.412329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324648-996b-4d3d-8256-911188b64bb2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:28.596394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324648-996b-4d3d-8256-911188b64bb2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:28.616430 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:28.658275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:28.659585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:28.660091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:28.660599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:28.661893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:28.664569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:28.688979 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:28.691017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:28.692866 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 631/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:28.701464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:28.815741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe0414-782a-46ad-ae00-b78d0d91e690 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:28.856329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:28.857061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:28.857400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:28.857747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:28.858574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:28.858934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:28.860907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca7cd3-d2ff-4b13-8517-729a56c68ca1 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:28.868035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 660/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:28.876489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:29.014274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874966a2-7b22-4995-802b-4e38b6f043d0 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:29.050873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:29.051539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:29.051823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:29.052103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:29.052824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:29.053132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:29.054547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a25f5-04c2-4bd1-b6f8-0295e74c9dd6 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:29.059569 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 632/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:31.155676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e176-fc1d-4d3a-84b7-1e5350c7f21a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:31.156260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e176-fc1d-4d3a-84b7-1e5350c7f21a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:31.156260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e176-fc1d-4d3a-84b7-1e5350c7f21a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:31.157733 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 661/1293] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:56:31.163822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffa6e-b4a0-4ab3-ae35-885bde913995 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:31.164354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffa6e-b4a0-4ab3-ae35-885bde913995 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:31.164354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffa6e-b4a0-4ab3-ae35-885bde913995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:31.184074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8edffa6e-b4a0-4ab3-ae35-885bde913995 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:31.185353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8edffa6e-b4a0-4ab3-ae35-885bde913995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:31.220850 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:31.266579 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 633/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:31.308895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1e176-fc1d-4d3a-84b7-1e5350c7f21a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:31.344111 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:31.422392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1e176-fc1d-4d3a-84b7-1e5350c7f21a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:31.458340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:31.459005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:31.459281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:31.459551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:31.460279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:31.461659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c17bf-5547-4e22-b086-aeb9a61819bb None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:31.476877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 662/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Jul 24 00:56:31 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:56:33.566581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3038-9f20-4fb3-a461-d18a38b43890 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:33.567436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3038-9f20-4fb3-a461-d18a38b43890 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:33.567605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3038-9f20-4fb3-a461-d18a38b43890 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:33.569032 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 634/1296] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:56:33.575620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:33.576192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:33.576330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:33.595176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:33.596442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:33.676580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 663/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:56:33.700044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3038-9f20-4fb3-a461-d18a38b43890 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:33.812991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3038-9f20-4fb3-a461-d18a38b43890 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:33.858468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:33.859416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:33.859812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:33.860177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:33.861297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:33.863629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:33.879620 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:33.881241 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:33.883553 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 635/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:33.890322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:33.914562 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:34.038440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d63cf-2e8b-465a-ad70-0b6a28d2f10a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:34.078487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:34.079297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:34.079664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:34.080022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:34.080826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:34.081216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:34.082794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:34.088962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 664/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:34.095310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:34.131866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:34.207273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92bb68-24c1-4393-aada-bdd7d43a11d3 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:34.259260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:34.261570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:34.262109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:34.262609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:34.264182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] RBAC: Adding query filter params (interface=public, service_id=3a72a06cdd1c4da596af53fbc311cfb5, region_id=RegionOne) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:34.264751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:34.267415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8c65-1056-46ce-bfb1-b12e2a3a5b12 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:34.278151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 636/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Jul 24 00:56:34 2022] GET /identity/v3/endpoints?service_id=3a72a06cdd1c4da596af53fbc311cfb5&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:56:34.284100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:34.374664 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:34.395378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379de0c-baa5-4d89-8517-270f3ef7f800 None admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:34.436953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:34.437633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:34.437952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:34.438226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:34.438937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:34.440368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521dbc-3696-4c32-bd53-4aed6ba8fdce None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:34.448065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 665/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Jul 24 00:56:34 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:56:36.789634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb064-6d11-47ab-bfca-109b2cac19b3 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:36.790236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb064-6d11-47ab-bfca-109b2cac19b3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:36.790554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb064-6d11-47ab-bfca-109b2cac19b3 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:36.792999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 637/1302] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:56:36.801649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:36.802205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:36.802579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:36.829742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:56:36.831739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:56:36.930790 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 666/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:56:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:56:36.955027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb064-6d11-47ab-bfca-109b2cac19b3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:37.124647 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:37.137254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb064-6d11-47ab-bfca-109b2cac19b3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:37.196325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:37.198313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:37.198821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:37.199216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:37.200455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:37.202812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:56:37.219842 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:56:37.220966 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 00:56:37.221837 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 638/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Jul 24 00:56:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:56:37.227528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:37.323403 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:37.351034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925afd7-7cd9-4ecd-b5dd-6026421bce52 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:37.391230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:37.391820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:37.392098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:37.392368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:37.393087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:56:37.393386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:37.394816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5a951-8b30-4245-8bbc-391d2388179f None admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:37.401409 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 667/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Jul 24 00:56:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:56:37.407704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:56:37.522504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c97016-db5c-4a6e-afe5-ddd7d2701453 None admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:56:37.563349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:56:37.564079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:56:37.564408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:56:37.564732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:56:37.565533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:56:37.567029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966cd8-17f1-4942-adae-9847c530bb57 None admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:56:37.589988 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 639/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Jul 24 00:56:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:56:47.397977 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=30 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:56:47.584571 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:44.495795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb877d-4df1-4f7e-8618-ccc35e98fbed None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:44.496736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb877d-4df1-4f7e-8618-ccc35e98fbed None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:44.497171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb877d-4df1-4f7e-8618-ccc35e98fbed None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:44.498792 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 668/1307] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:44.504429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e47-d17b-4504-a117-8661b1e5b35c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:44.505246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e47-d17b-4504-a117-8661b1e5b35c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:44.505712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0e47-d17b-4504-a117-8661b1e5b35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:44.585072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c53f0e47-d17b-4504-a117-8661b1e5b35c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:44.586856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c53f0e47-d17b-4504-a117-8661b1e5b35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:44.722135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 640/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:44.761069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:44.761407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:44.761633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:44.763187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 669/1309] 10.222.0.27 () {54 vars in 965 bytes} [Sun Jul 24 00:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:44.769776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2c85-9484-47f8-854d-0a5343a38d41 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:44.769975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2c85-9484-47f8-854d-0a5343a38d41 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:44.770299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c2c85-9484-47f8-854d-0a5343a38d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:44.878285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-110c2c85-9484-47f8-854d-0a5343a38d41 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:44.879517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-110c2c85-9484-47f8-854d-0a5343a38d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:44.906584 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:44.981375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 641/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Jul 24 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:57:44.991000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:44.993402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:45.129446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa5147-7338-4259-8025-3bd44382aed4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:45.210557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:45.211230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:45.211837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:45.212176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:45.214049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:45.274784 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:45.335846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:45.337685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221e2d6-88dc-4b28-a297-596160244f4d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:45.358144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 670/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:47.739695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fdb19-754a-45eb-973c-d3b180748111 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.740302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fdb19-754a-45eb-973c-d3b180748111 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.740302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fdb19-754a-45eb-973c-d3b180748111 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.746901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 642/1312] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:57:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:47.749006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e9e6-a627-483b-93e7-14da1f7f81d6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.749502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e9e6-a627-483b-93e7-14da1f7f81d6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.749807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e9e6-a627-483b-93e7-14da1f7f81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.849069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6182e9e6-a627-483b-93e7-14da1f7f81d6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:47.851298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6182e9e6-a627-483b-93e7-14da1f7f81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:47.967316 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 671/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:48.021221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.021514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.022379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.024163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 643/1314] 10.222.0.27 () {54 vars in 965 bytes} [Sun Jul 24 00:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:48.030652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594df18-5cd1-41e7-af24-7d07f71fc5e5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.030944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594df18-5cd1-41e7-af24-7d07f71fc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.031224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594df18-5cd1-41e7-af24-7d07f71fc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.047067 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.139156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5594df18-5cd1-41e7-af24-7d07f71fc5e5 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:48.141068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5594df18-5cd1-41e7-af24-7d07f71fc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.244769 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 672/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Jul 24 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:48.254627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.256948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.371272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa0b9-f6e6-460b-8157-64aea2ff7319 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.448618 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.451413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.452288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.452762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.453235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.454947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:48.566957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.568408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b5889-e6e4-48ff-a438-6358e3cc12d1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.587407 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 644/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:51.210919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.211442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.211442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.213092 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 673/1317] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:51.218514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7021e-69dc-4882-9313-4fad7ce4ac96 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.218940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7021e-69dc-4882-9313-4fad7ce4ac96 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.219095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7021e-69dc-4882-9313-4fad7ce4ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.290676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-08e7021e-69dc-4882-9313-4fad7ce4ac96 None None] MFA Rules not processed for user `79e43ff7d96f451a9c642d5fde017105`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:51.291933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08e7021e-69dc-4882-9313-4fad7ce4ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.353529 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.402818 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 645/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:51.442621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.444708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.558485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774644b6-2deb-485e-bdf2-c13e42662916 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.561330 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.646540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.647401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.647666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.647939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.649589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.764974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.766379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3de4b-8376-4e03-ade7-7252d85c8399 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.786834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 674/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:54.432538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.433067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.433067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.434462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 646/1320] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:54.440122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf34dc-bf78-4cfb-84e4-abd8d3d33d2b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.440655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf34dc-bf78-4cfb-84e4-abd8d3d33d2b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.440655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf34dc-bf78-4cfb-84e4-abd8d3d33d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.484192 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.512487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-30bf34dc-bf78-4cfb-84e4-abd8d3d33d2b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:54.513743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-30bf34dc-bf78-4cfb-84e4-abd8d3d33d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:54.626696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 675/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:54.669362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.670925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:54.792547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d07ec-8e25-4c2f-b5bd-b713d206b890 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.878908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.879636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.879921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.880200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.882006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:54.890328 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:55.001707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:55.003261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e506-c9d3-4689-b679-790b641046a1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:55.024042 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 647/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:57:58.114203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.114839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.114839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.116874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 676/1323] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:58.122911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa6e1-0154-4bd0-b3c1-e4320467216a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.123661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa6e1-0154-4bd0-b3c1-e4320467216a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.123661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa6e1-0154-4bd0-b3c1-e4320467216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.194853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-505aa6e1-0154-4bd0-b3c1-e4320467216a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:58.196053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-505aa6e1-0154-4bd0-b3c1-e4320467216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:58.258550 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.301649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 648/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:57:58.339708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.341308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:58.461879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56536ce-cf22-4404-8f18-97e3324dcb0b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.476312 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.545048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.545725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.546023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.546283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.547961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:58.658776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:58.660210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e2331-7f5a-4b2c-a81b-f742052d69a5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:58.678729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 677/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:00.857306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.857932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.858176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.860284 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 649/1326] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:00.866676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6da77-7872-454e-9fe4-dcf0f34e99ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.867201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6da77-7872-454e-9fe4-dcf0f34e99ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.867303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6da77-7872-454e-9fe4-dcf0f34e99ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.920541 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.943586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ac6da77-7872-454e-9fe4-dcf0f34e99ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:00.945922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ac6da77-7872-454e-9fe4-dcf0f34e99ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:01.076708 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 678/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:01.114250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.115907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:01.232110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62275b93-db97-4aad-bfa7-8c0ad0c448f5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.314039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.314704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.315011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.315288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.317150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:01.340932 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.472892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.475933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d3331-1c3e-4c2d-a8d6-90d12a1fd0ac service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.497047 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 650/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:03.711887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.712428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.712428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.714098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 679/1329] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:03.719906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe107-39e4-4593-955e-4508f73d3487 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.720425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe107-39e4-4593-955e-4508f73d3487 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.720551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe107-39e4-4593-955e-4508f73d3487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.786175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e60fe107-39e4-4593-955e-4508f73d3487 None None] MFA Rules not processed for user `79e43ff7d96f451a9c642d5fde017105`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:03.787442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e60fe107-39e4-4593-955e-4508f73d3487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:03.856964 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:03.892337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 651/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:03.932442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:03.934017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:04.043405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82e066-9ee4-4269-bb5c-e9a09e8a6b6a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.065128 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.125178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.125874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.126150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.126418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.128099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:04.243236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.244670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245e3c-cefe-4905-9b8c-b30568481933 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.263458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 680/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:06.806326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.806864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.806864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.808254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 652/1332] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:06.813535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba252b68-c316-45aa-b7c1-516186ac21ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.814004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba252b68-c316-45aa-b7c1-516186ac21ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.814127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba252b68-c316-45aa-b7c1-516186ac21ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.880856 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.884058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ba252b68-c316-45aa-b7c1-516186ac21ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:06.885822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba252b68-c316-45aa-b7c1-516186ac21ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:06.986865 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 681/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:07.024433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.026007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:07.133879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f61c6-05ee-45d3-9b66-f0ee88934869 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.210192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.210843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.211132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.211677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.213345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:07.240358 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:07.323740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:07.334742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f8fc9-f5bc-4bd8-a098-1fdbf2660703 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.354529 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 653/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:09.541114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.541777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.542004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.543392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 682/1335] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:09.548587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652df43-fe73-4a63-93ac-20e9387871ec None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.549033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652df43-fe73-4a63-93ac-20e9387871ec None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.549139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652df43-fe73-4a63-93ac-20e9387871ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.616144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0652df43-fe73-4a63-93ac-20e9387871ec None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:09.617359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0652df43-fe73-4a63-93ac-20e9387871ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:09.690765 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:09.721802 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 654/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:09.763480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:09.765000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:09.872465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9086020-8cca-41a2-a7be-05e9bae67e2b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:09.901273 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:09.947067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:09.947702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.947979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.948247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.949907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:10.059115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:10.060565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13a53-5a67-403a-904a-2859e2e41b33 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:10.080451 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 683/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:12.495094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.495599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.495599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.496975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 655/1338] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:12.502397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16bfa-51f3-4b51-8254-9466381fb8ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.502805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16bfa-51f3-4b51-8254-9466381fb8ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.502965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16bfa-51f3-4b51-8254-9466381fb8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.568389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fbb16bfa-51f3-4b51-8254-9466381fb8ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:12.569616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fbb16bfa-51f3-4b51-8254-9466381fb8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:12.578013 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.668419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 684/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:12.705691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.707360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:12.810908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44b04d-8b09-4b54-aeb9-8e7f8469346f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.886806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.887459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.887739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.888010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.889688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:12.924358 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.002434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.003883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad8be-224f-4b86-9139-c4b5cd86cfd3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.021867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 656/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:17.126160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.126647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.126741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.128100 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 685/1341] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:17.134047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf521a-6638-4ebe-94b2-ef6844bab7a4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.134508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf521a-6638-4ebe-94b2-ef6844bab7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.134602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf521a-6638-4ebe-94b2-ef6844bab7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.202444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bbbf521a-6638-4ebe-94b2-ef6844bab7a4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:17.203646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bbbf521a-6638-4ebe-94b2-ef6844bab7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.292204 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.305201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 657/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:17.344706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.346314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.453625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993590-3e60-4768-911e-7a692a526ae3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.494164 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.535605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.537001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.537281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.537562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.539373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.656843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.658229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9e265-d631-4416-9792-12741ea0d0e8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:17.678213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 686/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:20.418365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.418881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.418881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.420240 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 658/1344] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:20.426050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383981c-130c-4965-94ce-eacc1620ebae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.426575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383981c-130c-4965-94ce-eacc1620ebae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.427276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383981c-130c-4965-94ce-eacc1620ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.504974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e383981c-130c-4965-94ce-eacc1620ebae None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:20.506936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e383981c-130c-4965-94ce-eacc1620ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.527697 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:20.612449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 687/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:20.651661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:20.653211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.761717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f6d11-99ca-4c6b-b981-e5109dadb852 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:20.836147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:20.837061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.837342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.837615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.839324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.893108 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:20.967852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:20.969343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ed558-0ef1-443f-b5ed-3145a5ba2499 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:20.988019 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 659/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:25.094754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.095315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.095315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.096731 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 688/1347] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:25.103090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775289-e90f-43a6-8fe3-b57526382cc3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.103578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775289-e90f-43a6-8fe3-b57526382cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.103675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775289-e90f-43a6-8fe3-b57526382cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.178030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-81775289-e90f-43a6-8fe3-b57526382cc3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:25.179279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-81775289-e90f-43a6-8fe3-b57526382cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.325324 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.328125 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 660/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:25.369973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:25.371677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.503149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaa8f7-6707-4418-a25b-4acb823f3c62 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.565979 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.594929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.595587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.595870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.596143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.597891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.718666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:25.720213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c9cd-f30d-4061-b073-f65b7519bba0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:25.741534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 689/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:58:30.775024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870c164-b68a-4f66-9868-efbfd430e01b None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.775599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870c164-b68a-4f66-9868-efbfd430e01b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.777471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870c164-b68a-4f66-9868-efbfd430e01b None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.779260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 661/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 00:58:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:30.785400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763fbd-31bd-4fdc-acfc-e68dd181cdcc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.785922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763fbd-31bd-4fdc-acfc-e68dd181cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.786023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b763fbd-31bd-4fdc-acfc-e68dd181cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.876209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4b763fbd-31bd-4fdc-acfc-e68dd181cdcc None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:30.877493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4b763fbd-31bd-4fdc-acfc-e68dd181cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:30.899589 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.047786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 690/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:35.485394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958a36-ff87-4915-bde8-7b1842b97df5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.486020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958a36-ff87-4915-bde8-7b1842b97df5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.486020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958a36-ff87-4915-bde8-7b1842b97df5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:35.487601 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 662/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:35.493411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402eea-6cf6-4906-bc09-ba47f9e0a30f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.494549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402eea-6cf6-4906-bc09-ba47f9e0a30f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.495076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402eea-6cf6-4906-bc09-ba47f9e0a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:35.594982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e6402eea-6cf6-4906-bc09-ba47f9e0a30f None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:35.596648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6402eea-6cf6-4906-bc09-ba47f9e0a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:35.699582 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:35.748056 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 691/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:36.989060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c81d-47cc-4081-bec5-85656d5594ae None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.989547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c81d-47cc-4081-bec5-85656d5594ae None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.989547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c81d-47cc-4081-bec5-85656d5594ae None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.991150 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 663/1354] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.996367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193826c0-fede-4df0-b515-ecf87a836410 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.996795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193826c0-fede-4df0-b515-ecf87a836410 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.997080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193826c0-fede-4df0-b515-ecf87a836410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.075286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-193826c0-fede-4df0-b515-ecf87a836410 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:37.076777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-193826c0-fede-4df0-b515-ecf87a836410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:37.186270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 692/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:40.739013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182461-5bcd-4aa1-ad85-901604b80f07 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.740047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182461-5bcd-4aa1-ad85-901604b80f07 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.740779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182461-5bcd-4aa1-ad85-901604b80f07 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.743289 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 664/1356] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:40.748918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333370d-d8be-41f0-b2b6-6a51fed52ba8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.749375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333370d-d8be-41f0-b2b6-6a51fed52ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.749375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333370d-d8be-41f0-b2b6-6a51fed52ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.793418 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.833446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3333370d-d8be-41f0-b2b6-6a51fed52ba8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:40.835935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3333370d-d8be-41f0-b2b6-6a51fed52ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.939398 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 693/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:40.994507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.995193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.995673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.997570 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 665/1358] 10.222.0.27 () {54 vars in 962 bytes} [Sun Jul 24 00:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:41.006563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751b60-63f6-4d45-b7bb-87ac37282fbe None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.007635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751b60-63f6-4d45-b7bb-87ac37282fbe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.008346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751b60-63f6-4d45-b7bb-87ac37282fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.098768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e3751b60-63f6-4d45-b7bb-87ac37282fbe None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:41.100367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3751b60-63f6-4d45-b7bb-87ac37282fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:41.155024 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.229183 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 694/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 00:58:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:41.237253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.238920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:41.393876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d231-5d3b-47a4-8edb-d85d3111f885 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.476080 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.525572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.526317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.526608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.526883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.528533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:41.627837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.629769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce2577-aa44-4889-b0be-88cc426a0f8a service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.652320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 666/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:44.339172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.339850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.339850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.343985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 695/1361] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:44.347258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513624a3-a7b9-461f-9533-ea9db9fb0873 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.347258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513624a3-a7b9-461f-9533-ea9db9fb0873 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.350225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513624a3-a7b9-461f-9533-ea9db9fb0873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.425749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-513624a3-a7b9-461f-9533-ea9db9fb0873 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:44.427139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-513624a3-a7b9-461f-9533-ea9db9fb0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:44.476616 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.611555 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 667/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:44.660035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.661581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:44.921198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ac908-7e06-4fb8-87df-8487b770a827 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.940573 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.087687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:45.088744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.088920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.089121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.090852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:45.194762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:45.196417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2061c4e-3bcd-4ce7-a09a-0403ee6fc2b3 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:45.217512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 696/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:58:47.976923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa4f1-6c7d-4b38-8c36-7b7985eee562 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.977797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa4f1-6c7d-4b38-8c36-7b7985eee562 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.977961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa4f1-6c7d-4b38-8c36-7b7985eee562 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.980517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 668/1364] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:47.987862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c469-6262-4fe9-aafc-305b0e781093 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.988420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c469-6262-4fe9-aafc-305b0e781093 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.988420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c469-6262-4fe9-aafc-305b0e781093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.011802 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.105023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5cb6c469-6262-4fe9-aafc-305b0e781093 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:48.106219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5cb6c469-6262-4fe9-aafc-305b0e781093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:48.288128 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 697/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:48.348457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.349010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.350102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.353228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 669/1366] 10.222.0.27 () {54 vars in 962 bytes} [Sun Jul 24 00:58:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:48.359543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40c464-7dc7-4dd6-a63f-e32c099834d3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.359936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40c464-7dc7-4dd6-a63f-e32c099834d3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.360097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40c464-7dc7-4dd6-a63f-e32c099834d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.489465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-de40c464-7dc7-4dd6-a63f-e32c099834d3 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:48.491198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-de40c464-7dc7-4dd6-a63f-e32c099834d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:48.542167 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.669817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 698/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 00:58:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:48.678282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.680927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:48.992449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa089d4a-0fda-416e-9191-ae90f93f2217 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.045469 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.183211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.184012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.184314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.185376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.188983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:49.312444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.315730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c70f-9677-4f92-87fb-855350389560 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.348879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 670/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:51.838333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.839318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.839318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.849216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41b77-98de-4673-8f97-59607a4ecfe5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.851396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41b77-98de-4673-8f97-59607a4ecfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.851396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41b77-98de-4673-8f97-59607a4ecfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.854964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 699/1369] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:51 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:51.892346 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.937928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-03d41b77-98de-4673-8f97-59607a4ecfe5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:51.939244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-03d41b77-98de-4673-8f97-59607a4ecfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:52.082210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 671/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:52.119936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.121568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:52.351646 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.359861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228b52-11aa-4236-87d2-cdeb30994330 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.727213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.728821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.729449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.730074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.734778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:53.021525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.025058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ee8e0-098f-41d5-966c-f2ceeeb487a9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.060913 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.069482 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 700/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 950 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:54.923543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc9e7-b267-4bea-b793-8fec3dbfe77d None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.923982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc9e7-b267-4bea-b793-8fec3dbfe77d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.924199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc9e7-b267-4bea-b793-8fec3dbfe77d None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.926091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 672/1372] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:54.932380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af815-6637-4a32-a73a-64fd96a35a8e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.932943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af815-6637-4a32-a73a-64fd96a35a8e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.933195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af815-6637-4a32-a73a-64fd96a35a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.028277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd8af815-6637-4a32-a73a-64fd96a35a8e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:55.029814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd8af815-6637-4a32-a73a-64fd96a35a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:55.161375 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 701/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:55.543773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674129-2cb0-4741-ae07-acf279d5edc9 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.544660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674129-2cb0-4741-ae07-acf279d5edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.545128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674129-2cb0-4741-ae07-acf279d5edc9 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.546747 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 673/1374] 10.222.0.27 () {54 vars in 964 bytes} [Sun Jul 24 00:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:55.552507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.553451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.554538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.736191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] MFA Rules not processed for user `5a901a3ca2b749adb54c7b99a7ff1e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:55.738965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:55.740459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552feb2-1556-4f70-af2f-3349e82ab01c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.740459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552feb2-1556-4f70-af2f-3349e82ab01c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.740459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552feb2-1556-4f70-af2f-3349e82ab01c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.742706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 674/1375] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:55.748905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.749707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.750233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.775871 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.867254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:55.868893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:55.873245 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 702/1376] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Jul 24 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:55.881364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.891566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd5fb6-c09e-4796-84a1-60ccb4802464 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.960590 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.001062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.002445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.002730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.002998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.004950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:56.032170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 675/1377] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:58:56.100450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.102065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:56.145603 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.193197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.197854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bf637-73bc-4a2c-8832-bad9bbc53474 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.234859 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 703/1378] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:58:56.332041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b1ad-4368-44ff-8158-f3bc53d907d5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.448581 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.532706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.533636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.534470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.534951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.537859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:56.701051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.702827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eaca2-c66e-42d3-a45b-3deaba890799 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.732390 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 676/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:58:59.014119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.014725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.014725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.016070 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 704/1380] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:59.022374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87841c1-95e2-4a3b-9e39-d28a1b20d43d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.022930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87841c1-95e2-4a3b-9e39-d28a1b20d43d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.022930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87841c1-95e2-4a3b-9e39-d28a1b20d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.109453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a87841c1-95e2-4a3b-9e39-d28a1b20d43d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:59.110902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a87841c1-95e2-4a3b-9e39-d28a1b20d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:59.159084 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.274141 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 677/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:58:59.326693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.328483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:59.578030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf9e3c-5951-4384-b223-a8ff5acb12fd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.690921 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.801086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.801738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.802113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.802302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.804532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:59.939803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.942115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed436b7-b02f-4521-bd29-2e95d1c799b9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.967156 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 705/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:02.576168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.576710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.576710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.578308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 678/1383] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:02.583721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8da8-0a82-426c-ab61-5b80f123cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.585289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8da8-0a82-426c-ab61-5b80f123cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.586161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8da8-0a82-426c-ab61-5b80f123cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.684522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a6aa8da8-0a82-426c-ab61-5b80f123cfc2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:02.686179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a6aa8da8-0a82-426c-ab61-5b80f123cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:02.696719 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:02.832246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 706/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:02.883828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:02.885364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.138845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb25df-e4fd-42b2-9382-e295a4f3b2f5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:03.165321 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.309839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:03.310770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.311213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.311857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.314421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.454759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:03.457457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2a7b7-73b2-47a1-9f29-74d7b3e66516 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:03.510712 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 679/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:06.192257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.192871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.192962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.195061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 707/1386] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:06.201030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d700-a4f7-4cb0-88fc-415fe0508e89 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.201788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d700-a4f7-4cb0-88fc-415fe0508e89 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.201788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d700-a4f7-4cb0-88fc-415fe0508e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.230434 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.296722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b2e9d700-a4f7-4cb0-88fc-415fe0508e89 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:06.298766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b2e9d700-a4f7-4cb0-88fc-415fe0508e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:06.464129 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 680/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:59:06.538363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.540213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:06.750697 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.764767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289cf3-7554-47c1-9602-18b22b03631a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.947892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.948734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.949115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.949469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.951886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:07.097983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.100687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a4573-bb01-4ae0-8dbd-8d192f8528dd service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.121610 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.136793 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 708/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:09.551416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.552028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.552400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.554824 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 681/1389] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:09.562936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc7cfb-32c1-441d-9879-2130c6408cd5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.563478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc7cfb-32c1-441d-9879-2130c6408cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.563694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc7cfb-32c1-441d-9879-2130c6408cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.674323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b7bc7cfb-32c1-441d-9879-2130c6408cd5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:09.675965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b7bc7cfb-32c1-441d-9879-2130c6408cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:09.836132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 709/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:09.899787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.902190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:10.044604 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.138193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8be8a-d269-4cfb-b142-298142d9e233 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.304809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.305468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.305776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.306049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.307761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:10.379840 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.427588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.430131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796185ad-1de3-474e-9c38-769e9155cb11 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.459859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 682/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:12.761022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.761741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.762069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.764006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 710/1392] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:12.771147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652cb-573b-44d0-84cf-353e184e0ccb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.771704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652cb-573b-44d0-84cf-353e184e0ccb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.771704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652cb-573b-44d0-84cf-353e184e0ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.849422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f9f652cb-573b-44d0-84cf-353e184e0ccb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:12.850865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9f652cb-573b-44d0-84cf-353e184e0ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:12.979746 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 683/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:13.031839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.033560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.140013 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.242514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b86e1d-b81f-4dd2-a900-47cc81587704 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.360643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a800-3fe1-4c24-a9ea-8a3ca1827f34 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.360922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a800-3fe1-4c24-a9ea-8a3ca1827f34 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.361192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a800-3fe1-4c24-a9ea-8a3ca1827f34 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.362612 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 684/1394] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:13.369045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca50c8-ccfe-491f-bfbe-89cd25ce031b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.369348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca50c8-ccfe-491f-bfbe-89cd25ce031b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.369622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca50c8-ccfe-491f-bfbe-89cd25ce031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.410593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.411185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.411475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.411854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.414133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.450093 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.461513 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.478762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-efca50c8-ccfe-491f-bfbe-89cd25ce031b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:13.480083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-efca50c8-ccfe-491f-bfbe-89cd25ce031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.531658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.533488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3106e-1a6a-4b45-983c-29bfda99c8d8 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.558274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 711/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:13.625203 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 685/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:59:13.693848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.694189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.694386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.696314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 712/1397] 10.222.0.27 () {54 vars in 966 bytes} [Sun Jul 24 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:13.702036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b3e3-359d-4338-94e7-1184edd17063 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.702457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b3e3-359d-4338-94e7-1184edd17063 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.702631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370b3e3-359d-4338-94e7-1184edd17063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.798917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a370b3e3-359d-4338-94e7-1184edd17063 None None] MFA Rules not processed for user `1d7eafaa369f49bb9ea2c818d977d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:13.800730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a370b3e3-359d-4338-94e7-1184edd17063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.874147 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.904989 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 686/1398] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Jul 24 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:13.916508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.918458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:14.066778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cba2e-e2f1-4b4b-ab2a-549424addc9c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:14.156641 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.175628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:14.176060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.176330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.176691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.178769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:14.319939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.321396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f895f2-296f-4b78-9cab-449c28ce2c79 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.345409 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 713/1399] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 00:59:15.106304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577152e-554c-48e8-bd45-3f86cc88ccf0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.107096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577152e-554c-48e8-bd45-3f86cc88ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.107096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577152e-554c-48e8-bd45-3f86cc88ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.184749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e577152e-554c-48e8-bd45-3f86cc88ccf0 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:15.185991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e577152e-554c-48e8-bd45-3f86cc88ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.277843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 687/1400] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:15.321844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.322382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.322476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.323827 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 714/1401] 10.222.0.27 () {54 vars in 943 bytes} [Sun Jul 24 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:15.330628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa71cf-cdd6-48d5-97a3-6c51c56193bd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.331014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa71cf-cdd6-48d5-97a3-6c51c56193bd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.331351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa71cf-cdd6-48d5-97a3-6c51c56193bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.406790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-98aa71cf-cdd6-48d5-97a3-6c51c56193bd None None] MFA Rules not processed for user `fdc4ad8dc59b4974a08e687a78764471`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:15.407971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98aa71cf-cdd6-48d5-97a3-6c51c56193bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.421038 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.531069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 688/1402] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Jul 24 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:15.541633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.543300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.635010 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.685235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9421a9-c2f0-42ac-b999-53f375792b1c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.758503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b62b-7d92-4a9b-b1ed-780117fe03bb None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.758787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b62b-7d92-4a9b-b1ed-780117fe03bb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.759246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567b62b-7d92-4a9b-b1ed-780117fe03bb None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.761889 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 689/1403] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:15.767370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3d9c-0693-43c0-9d1c-e48cc68bd551 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.768096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3d9c-0693-43c0-9d1c-e48cc68bd551 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.768096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe3d9c-0693-43c0-9d1c-e48cc68bd551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.795452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.795946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.796231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.796504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.798221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.837817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b6fe3d9c-0693-43c0-9d1c-e48cc68bd551 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:15.839042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6fe3d9c-0693-43c0-9d1c-e48cc68bd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.871167 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.884502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.886473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.895958 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 715/1404] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:59:15.923935 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.949981 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 690/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:59:16.004901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.006199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:16.119226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ce21-87df-42e6-9a1a-a03f55b3f48e service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.284200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.285002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.285359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.285733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.287599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:16.296628 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.394085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.395675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986321e5-4203-4cb9-976f-9998a949f24e service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.416508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 716/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:18.603627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.604644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.604921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.606340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 691/1407] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 00:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:18.611927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9890b-3cf2-4f9f-96ab-33a2c15a1794 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.612397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9890b-3cf2-4f9f-96ab-33a2c15a1794 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.612807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9890b-3cf2-4f9f-96ab-33a2c15a1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.689122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1d9890b-3cf2-4f9f-96ab-33a2c15a1794 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:18.690512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1d9890b-3cf2-4f9f-96ab-33a2c15a1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:18.774837 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.805777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 717/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:18.846855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.848407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:19.025417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26505947-82c8-465e-aa3d-36d1cc5cdd3c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.091105 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.156170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.156827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.157107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.157414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.159140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:19.259378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.261157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207cf63-28e9-42d8-9954-3239ae6beb8c service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.283676 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 692/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:28.798807 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:29.280702 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=70 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.270065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8970b-183f-4fdc-9080-79dbf743a66e None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.270684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8970b-183f-4fdc-9080-79dbf743a66e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.270684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8970b-183f-4fdc-9080-79dbf743a66e None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.272154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 718/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sun Jul 24 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:39.279317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f591b-d463-4738-874f-4332d9a826b6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.280213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f591b-d463-4738-874f-4332d9a826b6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.280213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f591b-d463-4738-874f-4332d9a826b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.374370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-558f591b-d463-4738-874f-4332d9a826b6 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:39.375531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-558f591b-d463-4738-874f-4332d9a826b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.502132 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 693/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Jul 24 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:39.524515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020867-874d-40ef-b86a-3f12a5280cee None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.524796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020867-874d-40ef-b86a-3f12a5280cee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.525068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88020867-874d-40ef-b86a-3f12a5280cee None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.526480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 719/1412] 10.222.0.27 () {54 vars in 918 bytes} [Sun Jul 24 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:39.531570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf6c3-3b3b-4d2a-a764-437ac3cbb047 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.531855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf6c3-3b3b-4d2a-a764-437ac3cbb047 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.532134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bf6c3-3b3b-4d2a-a764-437ac3cbb047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.607268 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.610283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aa9bf6c3-3b3b-4d2a-a764-437ac3cbb047 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:39.612060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa9bf6c3-3b3b-4d2a-a764-437ac3cbb047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.738160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 694/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Jul 24 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:42.544824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.545441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.545441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.546819 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:42.555251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7816b-d85f-4171-8c4c-3b46fd4399f1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.555817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7816b-d85f-4171-8c4c-3b46fd4399f1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.555946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7816b-d85f-4171-8c4c-3b46fd4399f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.636177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-39b7816b-d85f-4171-8c4c-3b46fd4399f1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:42.637626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-39b7816b-d85f-4171-8c4c-3b46fd4399f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:42.703458 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.756457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:42.805659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.807464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:43.005606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45a80-fd70-43ae-9fc5-5d2ba0ded65a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.109893 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.171728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.172848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.173139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.173420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.175470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:43.298107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.300277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba143-d70e-4624-87b5-96547d0ad21f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.327377 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 721/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:44.362350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.363084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.363084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.364530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:44.373209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcced87-a05c-4109-a81b-f1be4cbc8cb5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.373988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcced87-a05c-4109-a81b-f1be4cbc8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.373988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcced87-a05c-4109-a81b-f1be4cbc8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.463215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ebcced87-a05c-4109-a81b-f1be4cbc8cb5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:44.464636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ebcced87-a05c-4109-a81b-f1be4cbc8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:44.500667 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:44.597358 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:44.786104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:44.789186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:44.991965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac769-05cb-480d-afac-e3622a94ced2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:45.051876 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:45.151672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:45.152359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:45.152687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:45.152952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:45.154917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:45.259461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:45.261886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a716a62-3c58-4f6f-936a-384a0bfd8a13 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:45.285122 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 697/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:46.269328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.269847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.270192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.271722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:46.279165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffea25-21a1-4e18-b961-7c79905f26a1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.279165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffea25-21a1-4e18-b961-7c79905f26a1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.279165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffea25-21a1-4e18-b961-7c79905f26a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.340693 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.367720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2dffea25-21a1-4e18-b961-7c79905f26a1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:46.368958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2dffea25-21a1-4e18-b961-7c79905f26a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:46.482075 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 00:59:46.643276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.644976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:46.817339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4d33b-e21c-4002-8f6b-59e23fd49aa4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.832791 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.974009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.974765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.975053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.975347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.977564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:47.081768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.083452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918a12a-af32-434c-9c54-8bb0a9804b6d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.104763 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 724/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:48.095613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.096202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.096202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.097650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:48.103134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c98d-86a6-4d4c-9c7c-9ae7a2d1a484 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.103671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c98d-86a6-4d4c-9c7c-9ae7a2d1a484 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.103671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c98d-86a6-4d4c-9c7c-9ae7a2d1a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.128908 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.207574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1a53c98d-86a6-4d4c-9c7c-9ae7a2d1a484 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:48.208948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a53c98d-86a6-4d4c-9c7c-9ae7a2d1a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:48.331401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:48.486023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.487938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:48.633916 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.674549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b349b6-76c2-446c-bafa-c57ec0fef4ad None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.800804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.801447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.801757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.802030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.803706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:48.886817 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.904637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.906325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe4ad1-3bef-4b91-9285-76e599863c8d service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.926170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 700/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:49.801918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.802534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.802534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.804541 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:49.810445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431821c-14fd-4f10-989c-1d61a706b071 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.810973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431821c-14fd-4f10-989c-1d61a706b071 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.811098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431821c-14fd-4f10-989c-1d61a706b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.890022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f431821c-14fd-4f10-989c-1d61a706b071 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:49.891261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f431821c-14fd-4f10-989c-1d61a706b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:49.988507 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:50.144181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:50.145738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:50.232654 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:50.296872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5eec-7ed9-4632-be91-ad3d7f89f27a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:50.416149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:50.416705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:50.416988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:50.417263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:50.418951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:50.469235 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:50.518920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:50.521014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74e88-e335-4d4b-a062-20236bb015d3 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:50.543350 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 727/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:51.356396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:51.356955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:51.356955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:51.358410 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:51.363487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e3633-6d1d-48ad-b8db-b6f3ad743f00 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:51.363923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e3633-6d1d-48ad-b8db-b6f3ad743f00 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:51.364072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e3633-6d1d-48ad-b8db-b6f3ad743f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:51.445496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-439e3633-6d1d-48ad-b8db-b6f3ad743f00 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:51.446690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-439e3633-6d1d-48ad-b8db-b6f3ad743f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:51.559310 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:51.715646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:51.717360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:51.766384 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:51.866830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844dc85-5ac5-41f8-a539-b4a8497d5c2f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:51.991881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:51.992968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:51.993250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:51.993521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:51.995252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:52.008143 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:52.091221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:52.093114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdda82-cac5-466b-b743-e05bdd5b5eb5 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:52.113959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 703/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:52.947331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:52.947882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:52.947882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:52.949204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:52.954777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4259-580e-4055-be23-6c3069a2c0b4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:52.955328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4259-580e-4055-be23-6c3069a2c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:52.955442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4259-580e-4055-be23-6c3069a2c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:53.041305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b53a4259-580e-4055-be23-6c3069a2c0b4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:53.042576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b53a4259-580e-4055-be23-6c3069a2c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:53.120066 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:53.153365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:53.306956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:53.308490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:53.326267 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:53.455608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d24fe8-e57d-4918-9a2a-d0432cd6ab66 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:53.553613 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:53.580676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:53.581244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:53.581542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:53.581832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:53.583495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:53.674253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:53.675879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f60613-85f9-45f0-b4ab-2fe1a06ba110 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:53.694039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 730/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:54.511010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.511556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.511556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.512855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:54.517820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4ef7-2256-4f14-a0a6-70bac0806c4e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.518272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4ef7-2256-4f14-a0a6-70bac0806c4e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.518397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4ef7-2256-4f14-a0a6-70bac0806c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.593931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4d9a4ef7-2256-4f14-a0a6-70bac0806c4e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:54.595133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d9a4ef7-2256-4f14-a0a6-70bac0806c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:54.636689 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:54.695033 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:54.846874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:54.848410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:54.996718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940dcdb-baaf-423d-bdcd-3c43032e7614 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:55.055913 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:55.127679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:55.128338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:55.128619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:55.128892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:55.130600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:55.232869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:55.234561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21c9a-762f-492d-b699-6aa4792416f9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:55.254012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 706/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:56.120371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:56.120776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:56.120878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:56.122253 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 00:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:56.127804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9504-10d0-4ddf-b8ee-979085da1c42 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:56.128270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9504-10d0-4ddf-b8ee-979085da1c42 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:56.128387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b9504-10d0-4ddf-b8ee-979085da1c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:56.204062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-298b9504-10d0-4ddf-b8ee-979085da1c42 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:56.205280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-298b9504-10d0-4ddf-b8ee-979085da1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:56.207336 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:56.307373 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:56.461517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:56.463003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:56.624446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553d89-4a77-4306-add4-1e42720a5360 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:56.654698 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:56.755502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:56.756057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:56.756340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:56.756614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:56.758681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:56.848571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:56.850211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83562-7ab9-44eb-be84-010a9be9dc88 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:56.869921 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 733/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 00:59:58.875763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:58.876331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:58.876451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:58.877807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 00:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:58.884261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ead7a-b7bd-44ab-bded-26c106dfe9c4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:58.884716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ead7a-b7bd-44ab-bded-26c106dfe9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:58.884816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ead7a-b7bd-44ab-bded-26c106dfe9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:58.926923 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:58.954789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a5ead7a-b7bd-44ab-bded-26c106dfe9c4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:58.956028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a5ead7a-b7bd-44ab-bded-26c106dfe9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:59.060688 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 00:59:59.099765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:59.102806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:59.220097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89429-8d24-4623-a750-2d3f6412a738 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:59.253268 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:59.298109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:59.298767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:59.299051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:59.299335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:59.301029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:59.427232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:59.428687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45290cdc-9528-4b96-9f40-d2b90b7c7803 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:59.452033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 709/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 00:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:00:01.720832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:01.721384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:01.721384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:01.722785 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:01.728915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f10-7547-4904-8f5d-642ce0164127 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:01.729377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f10-7547-4904-8f5d-642ce0164127 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:01.729473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f10-7547-4904-8f5d-642ce0164127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:01.795767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-69835f10-7547-4904-8f5d-642ce0164127 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:01.796980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69835f10-7547-4904-8f5d-642ce0164127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:01.810626 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:01.900992 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:01.941138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:01.942737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.059120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421a810-ef2f-4a31-af9d-2f6341eb17e4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:02.072043 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:02.137448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:02.138132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:02.138416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:02.138691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:02.140347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:02.257964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:02.259415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf9e97-6315-48a1-a28a-6e71a40eb971 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:02.278543 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 736/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:04.713004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:04.713514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:04.713514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:04.714875 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:04.720828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3050-fb45-4a07-a8d5-f1ebca6f8094 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:04.721320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3050-fb45-4a07-a8d5-f1ebca6f8094 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:04.721413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c3050-fb45-4a07-a8d5-f1ebca6f8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:04.773769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:04.794000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-365c3050-fb45-4a07-a8d5-f1ebca6f8094 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:04.795230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-365c3050-fb45-4a07-a8d5-f1ebca6f8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:04.896388 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:04.936568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:04.938578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:05.062279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2305-a87b-467d-a59e-245fd17d12a3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:05.107405 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:05.144203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:05.144862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.145145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.145420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.147129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:05.259884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:05.261332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b35ae1-af53-48ee-95b4-a052970e00ca service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:05.280133 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 712/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:00:07.494474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:07.494990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:07.494990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:07.496326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:07.501704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf8330-16ce-4aec-aaf0-733de400ce3d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:07.502106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf8330-16ce-4aec-aaf0-733de400ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:07.502267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf8330-16ce-4aec-aaf0-733de400ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:07.569141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-69bf8330-16ce-4aec-aaf0-733de400ce3d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:07.571219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69bf8330-16ce-4aec-aaf0-733de400ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:07.592184 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:07.668880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:07.709590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:07.711201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:07.817257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711d20e-7e6d-4787-961e-886f56930386 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:07.837715 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:07.895880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:07.896527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:07.896814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:07.897096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:07.899193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:08.013435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:08.014911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d1b2-1be5-405f-918c-8d92d810d613 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:08.032910 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 739/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:10.163869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.164402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.164402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.165848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:10.171582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2175-e1fe-44b6-8f92-a20b4c7e7e02 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.172063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2175-e1fe-44b6-8f92-a20b4c7e7e02 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.172199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2175-e1fe-44b6-8f92-a20b4c7e7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.245953 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:10.248951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-272c2175-e1fe-44b6-8f92-a20b4c7e7e02 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:10.250652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-272c2175-e1fe-44b6-8f92-a20b4c7e7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.356637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:10.396995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:10.398988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.512164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0831-725a-480c-9a9c-17d12ba9be75 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:10.563841 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:10.589831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:10.590480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:10.590757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:10.591025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:10.592935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:10.711724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:10.713091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5512e-51fc-47b0-8e59-acd7de5efbf1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:10.732542 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 715/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:12.865821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.866885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.866990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.868443 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:12.874368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84619af-0f09-44b9-885d-31c478944d62 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.874869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84619af-0f09-44b9-885d-31c478944d62 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.874964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84619af-0f09-44b9-885d-31c478944d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.941622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f84619af-0f09-44b9-885d-31c478944d62 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:12.942876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f84619af-0f09-44b9-885d-31c478944d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:12.972680 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:13.042501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:13.081750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:13.083227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:13.201358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043338-6484-41a5-b33a-c62e841e39c9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:13.231187 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:13.278874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:13.279531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:13.279814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:13.280091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:13.281808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:13.393769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:13.395165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db1c84-0854-4bb8-b487-e13d97e5b4d6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:13.413013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 742/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:15.676006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.676600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.676600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.677960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:15.684588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033c83-d466-45c1-a3e6-6a0bce0fee27 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.685064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033c83-d466-45c1-a3e6-6a0bce0fee27 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.685180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033c83-d466-45c1-a3e6-6a0bce0fee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.750172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9f033c83-d466-45c1-a3e6-6a0bce0fee27 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:15.751386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9f033c83-d466-45c1-a3e6-6a0bce0fee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:15.760585 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.850948 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:15.890089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.891625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:16.000502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c8b3e-bec9-478f-99f6-75317d26aa61 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:16.060057 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:16.080302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:16.080953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:16.081233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:16.081506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:16.083214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:16.202633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:16.204093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d8865-f34d-4ea1-8bc5-d79a4bd4dbba service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:16.225420 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 718/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:18.361740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.362273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.362390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.363759 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:18.370085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcacd8-117e-4223-880b-f32ea98bad2e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.370574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcacd8-117e-4223-880b-f32ea98bad2e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.370574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcacd8-117e-4223-880b-f32ea98bad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.443985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-21dcacd8-117e-4223-880b-f32ea98bad2e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:18.445904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-21dcacd8-117e-4223-880b-f32ea98bad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.486358 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:18.548658 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:18.591763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:18.593645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.707642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c261f2-00d1-492d-9f5e-e163109706b7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:18.751277 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:18.788898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:18.789603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.789919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.790200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.791854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.947832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:18.950316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c2a2-12c2-4ddc-9b71-e39eb4c5f8ce service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:18.980575 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 745/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:21.081391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:21.081986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:21.081986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:21.083330 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:21.089975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e665c-d978-4696-941b-df22b273ba49 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:21.090476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e665c-d978-4696-941b-df22b273ba49 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:21.090476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e665c-d978-4696-941b-df22b273ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:21.158346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b03e665c-d978-4696-941b-df22b273ba49 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:21.159568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b03e665c-d978-4696-941b-df22b273ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:21.185066 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:21.268853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:21.307329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:21.308883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:21.418197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af632024-1dc3-45e5-9c90-5c11fa737d8e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:21.486162 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:21.492974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:21.493625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:21.493939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:21.494209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:21.495855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:21.605561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:21.607023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44e24c-1528-43a0-bcdb-926f1ff1e809 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:21.625352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 721/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:23.693386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.694227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.694227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.696848 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:23.702232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26aa6-1c02-4edd-b840-1e0c284cdc9b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.702686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26aa6-1c02-4edd-b840-1e0c284cdc9b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.702802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26aa6-1c02-4edd-b840-1e0c284cdc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.769429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d9f26aa6-1c02-4edd-b840-1e0c284cdc9b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:23.770681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9f26aa6-1c02-4edd-b840-1e0c284cdc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:23.820198 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:23.872183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:23.909979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:23.911541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:24.019358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceabc4-b496-46f7-9f07-1ad6f51dd647 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:24.066576 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:24.094464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:24.095108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:24.095386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:24.095661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:24.097303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:24.217834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:24.219604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcea8e6-745e-461e-9022-b29f7a203d21 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:24.241205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 748/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:33.869877 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=22 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:34.238769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=66 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:45.027800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fbbc-0562-456d-9bef-e9692f52a0c6 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:45.029054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fbbc-0562-456d-9bef-e9692f52a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:45.029179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fbbc-0562-456d-9bef-e9692f52a0c6 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:45.030724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 723/1471] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:00:45.036542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e627a-312e-4367-b105-8349c18d14d4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:45.037096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e627a-312e-4367-b105-8349c18d14d4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:45.037096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e627a-312e-4367-b105-8349c18d14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:45.114930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-131e627a-312e-4367-b105-8349c18d14d4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:45.116167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-131e627a-312e-4367-b105-8349c18d14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:45.238832 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 749/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:45.359981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:45.360318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:45.360808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:45.362477 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 724/1473] 10.222.0.27 () {54 vars in 966 bytes} [Sun Jul 24 01:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:45.368723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd650-bad9-46dd-a12a-153521718b73 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:45.369013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd650-bad9-46dd-a12a-153521718b73 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:45.369292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd650-bad9-46dd-a12a-153521718b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:45.464303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7cabd650-bad9-46dd-a12a-153521718b73 None None] MFA Rules not processed for user `1d7eafaa369f49bb9ea2c818d977d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:45.466854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7cabd650-bad9-46dd-a12a-153521718b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:45.493973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:45.575463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 750/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Jul 24 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:00:45.584045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:45.586418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:45.697773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c31d4-d856-48be-ba1f-4ce2abe4aeb1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:45.774728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:45.775478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:45.775765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:45.776039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:45.777744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:45.836602 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:45.911447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:45.912909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6273-d7a4-4909-bc68-1258bc592853 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:45.936152 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 725/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:48.286460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:48.287049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:48.287049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:48.289012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 751/1476] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:48.295358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f4bb-3aca-4702-a17d-2ea6469dccb2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:48.295918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f4bb-3aca-4702-a17d-2ea6469dccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:48.295918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f4bb-3aca-4702-a17d-2ea6469dccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:48.371256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f370f4bb-3aca-4702-a17d-2ea6469dccb2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:48.372391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f370f4bb-3aca-4702-a17d-2ea6469dccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:48.484837 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 726/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:48.509803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:48.511334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:48.640441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccef5c-11db-4df2-9b32-0ecd332ee441 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:48.695746 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:48.747023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:48.747684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:48.747961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:48.748231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:48.748966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:48.750883 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:00:48.750883 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:00:48.750883 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:00:48.752058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba102b-bf82-42e3-bb1d-f4a9b4ca910d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:48.773507 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 752/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Jul 24 01:00:48 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:00:50.890402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:50.890986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:50.890986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:50.892343 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 727/1479] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:00:50.898338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efd0d-854a-43ca-ba63-74325e34192e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:50.898884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efd0d-854a-43ca-ba63-74325e34192e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:50.898884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826efd0d-854a-43ca-ba63-74325e34192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:50.968617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-826efd0d-854a-43ca-ba63-74325e34192e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:50.970208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-826efd0d-854a-43ca-ba63-74325e34192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:51.077456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 753/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:51.122552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:51.124119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:51.135234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:51.279803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ea2b1-1de2-4cad-b03e-2a0fcae89776 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:51.369395 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:51.405173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:51.405860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:51.406148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:51.406426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:51.408106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:51.505866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:51.508160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176cd0-8603-41ed-8865-64037324ba2c service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:51.530576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 728/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:53.821770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:53.822562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:53.822562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:53.823751 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 754/1482] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:53.829498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9e1c-0aca-4beb-b49e-b0ff5e626823 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:53.830027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9e1c-0aca-4beb-b49e-b0ff5e626823 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:53.830302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9e1c-0aca-4beb-b49e-b0ff5e626823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:53.917891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-833b9e1c-0aca-4beb-b49e-b0ff5e626823 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:53.919130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-833b9e1c-0aca-4beb-b49e-b0ff5e626823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:53.982378 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:54.045954 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 729/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:00:54.082913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:54.084451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:54.111278 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:54.204606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd115e8-5e74-4d89-96f6-c4c9a897ed3f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:54.286479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:54.287131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:54.287416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:54.287693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:54.289418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:54.369948 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:54.414986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:54.416725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70712ae1-0dda-4d9e-90f9-f198f3b28e97 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:54.438997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 755/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:56.563246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:56.563849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:56.563849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:56.565261 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 730/1485] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:56.571773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650084b7-d5c3-4b8e-be91-0935969a1d41 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:56.572309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650084b7-d5c3-4b8e-be91-0935969a1d41 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:56.572309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650084b7-d5c3-4b8e-be91-0935969a1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:56.644326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-650084b7-d5c3-4b8e-be91-0935969a1d41 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:56.645634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-650084b7-d5c3-4b8e-be91-0935969a1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:56.756160 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 756/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:00:56.796353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:56.797984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:56.920890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df55f6-ba8e-49f4-a692-0c24d548898e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:56.998116 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:57.000202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:57.000896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:57.001385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:57.001904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:57.003860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:57.131685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:57.133986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65f3b6-6be9-4b1e-a321-a79b639bd1a9 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:57.155190 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 731/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:00:59.484575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:59.485103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:59.485414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:59.487793 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 757/1488] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:00:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:59.494170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf87a-5fcf-47df-ac88-0b5e265835c1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:59.494717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf87a-5fcf-47df-ac88-0b5e265835c1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:59.494717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cf87a-5fcf-47df-ac88-0b5e265835c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:59.566756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-947cf87a-5fcf-47df-ac88-0b5e265835c1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:59.567991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-947cf87a-5fcf-47df-ac88-0b5e265835c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:59.626021 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:59.673215 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 732/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:00:59.714209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:59.715767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:59.757214 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:59.834149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf80e5-f92d-4944-b379-7f9300e804ad None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:59.917266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:59.917946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:59.918228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:59.918502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:59.920168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:00.013979 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:00.049436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:00.050983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3cd3-38c0-43c4-b65b-bddfbf0908f1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:00.072340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 758/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:01:02.369898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:02.370455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:02.370455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:02.371757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 733/1491] 10.222.0.27 () {54 vars in 926 bytes} [Sun Jul 24 01:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:02.377266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3b08-6cd9-4f34-9118-af2e6c1e7c97 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:02.377749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3b08-6cd9-4f34-9118-af2e6c1e7c97 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:02.377850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d3b08-6cd9-4f34-9118-af2e6c1e7c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:02.447089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-477d3b08-6cd9-4f34-9118-af2e6c1e7c97 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:02.448382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-477d3b08-6cd9-4f34-9118-af2e6c1e7c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:02.551824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 759/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:01:02.592647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:02.594297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:02.703485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d812d-9cb1-4fba-a0d8-0051c629087f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:02.779563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:02.780221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:02.780503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:02.780774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:02.782577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:02.795816 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:02.915228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:02.916873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44166-94ff-4f91-836c-48ce8862860f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:02.937342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 734/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:01:12.549746 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=82 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:12.934955 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=50 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:34.116974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:34.117576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:34.117576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:34.318164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:34.320227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:34.420792 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 760/1494] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:02:34.429826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:34.430327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:34.430442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:34.513053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:34.514301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:34.616257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 735/1495] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:02:34.621234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:34.622525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:34.634600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fb3c-c8f3-40d5-96e5-dab125d3df78 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:34.700851 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:34.744853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:34.745515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:34.745854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:34.746129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:34.746860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:34.747165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:34.748207 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:34.748207 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:02:34.748207 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:02:34.749090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:34.761606 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 761/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:34.770103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:34.779874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9c11-826e-45be-be06-01cf9c74f60d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:34.846514 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:34.883864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:34.884503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:34.885092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:34.885444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:34.886844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:34.890179 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:34.890179 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:02:34.890179 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:02:34.892593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:34.972809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 736/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:02:34 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:02:34.977991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:34.979630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:35.016372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262cd9-6d06-4524-ba3b-689990aee14a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:35.114294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:35.114974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.115258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.115537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.116946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:35.118011 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:35.118011 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:02:35.118011 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:02:35.119238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:35.163214 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 762/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:02:34 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:02:35.167698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:35.169604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:35.235803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c50ffc-aaff-427a-8770-2bf64ddf864e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:35.322561 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:35.334882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:35.335758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.336034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.336307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.337051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:35.338108 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:35.338108 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:02:35.338108 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:02:35.339021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:35.352560 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 737/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:02:35.356691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:35.358268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:35.370825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d39c-84f6-456e-8a20-c734d36fe7e7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:35.398866 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:35.470307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:35.470887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.471170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.471444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.472198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:35.473477 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:35.473477 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:02:35.473477 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:02:35.474391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31e735-6cf5-43ec-a6d8-104318e1b61b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:35.488370 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 763/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:02:35.493714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:35.495943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:35.529521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db555-6f44-4f5e-8f3f-9ce737742191 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:35.628462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:35.629361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.629637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.629941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] PATH_INFO: `/v3/projects/476eb6cf8146433f85290d955ed1e31c/users/10070be94b6943b28833a53b643598b2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.652876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=476eb6cf8146433f85290d955ed1e31c, user_id=10070be94b6943b28833a53b643598b2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:35.653973 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:35.653973 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:02:35.653973 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:02:35.655909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bf8e4-9f42-4598-8f42-f23fcedafb6a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:35.682005 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 738/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:02:35 2022] PUT /identity/v3/projects/476eb6cf8146433f85290d955ed1e31c/users/10070be94b6943b28833a53b643598b2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:02:35.694337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4557-119f-44ac-b407-608041aa422b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.694639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4557-119f-44ac-b407-608041aa422b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.694921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4557-119f-44ac-b407-608041aa422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.751254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a1fa4557-119f-44ac-b407-608041aa422b None None] MFA Rules not processed for user `10070be94b6943b28833a53b643598b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:35.752394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a1fa4557-119f-44ac-b407-608041aa422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:35.833376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 764/1502] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:02:35.848057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.848348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.848633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.850782 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 739/1503] 10.222.0.27 () {54 vars in 964 bytes} [Sun Jul 24 01:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:35.856270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ca60-a68e-4f99-bce3-7a37d6066f94 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:35.856559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ca60-a68e-4f99-bce3-7a37d6066f94 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:35.856833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ca60-a68e-4f99-bce3-7a37d6066f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:35.888982 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:35.937279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ee87ca60-a68e-4f99-bce3-7a37d6066f94 None None] MFA Rules not processed for user `5a901a3ca2b749adb54c7b99a7ff1e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:35.938546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee87ca60-a68e-4f99-bce3-7a37d6066f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:36.020775 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 765/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Jul 24 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:02:36.028968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:36.030545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:36.081565 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:36.145318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd26de-f3b7-43be-8e61-4993dae4495f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:36.225129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:36.226635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:36.226922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:36.227200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:36.228917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:36.336153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:36.337596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:36.341251 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:36.357649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 740/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:02:36.404635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65846bc-8684-4502-82c2-07c171e79432 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:36.405071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65846bc-8684-4502-82c2-07c171e79432 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:36.405192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65846bc-8684-4502-82c2-07c171e79432 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:36.406532 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 766/1506] 10.222.0.27 () {52 vars in 829 bytes} [Sun Jul 24 01:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:36.410648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:36.411886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:36.516120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19dac9-861d-4058-a0ba-54f02060bc20 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:36.621057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:36.621871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:36.622152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:36.622423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] PATH_INFO: `/v3/users/10070be94b6943b28833a53b643598b2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:36.636149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10070be94b6943b28833a53b643598b2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:36.637195 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:36.637195 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:02:36.637195 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:02:36.638453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:36.648945 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:36.707653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10070be94b6943b28833a53b643598b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:36.717163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10070be94b6943b28833a53b643598b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:36.730266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10070be94b6943b28833a53b643598b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:36.749345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10070be94b6943b28833a53b643598b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:36.749858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10070be94b6943b28833a53b643598b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:36.760885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 741/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:02:36 2022] DELETE /identity/v3/users/10070be94b6943b28833a53b643598b2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:02:36.765737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:36.766024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:36.766299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:36.830261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:36.831475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:36.907594 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:36.921102 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 767/1508] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:02:36.931007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:36.932278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:37.033896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e528-14b7-4aac-9a1b-9c764d9b3ac7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:37.095287 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:37.117878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:37.118547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:37.118831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:37.119109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:37.120820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:37.357864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:37.359353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d025c-217e-4f79-90d4-eacf8690aace service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:37.379895 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 742/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:02:37.793895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:37.795160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:37.807202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04725367-72b3-4dbc-a184-bc0d6eb38b04 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:37.909346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:37.909771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:37.910048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:37.910317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] PATH_INFO: `/v3/projects/476eb6cf8146433f85290d955ed1e31c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:37.920487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476eb6cf8146433f85290d955ed1e31c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:37.921523 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:02:37.921523 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:02:37.921523 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:02:37.922745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:38.010657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476eb6cf8146433f85290d955ed1e31c', 'request_id': 'req-97824164-cb3c-4973-a91c-bfea6a38cfc8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:38.018854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476eb6cf8146433f85290d955ed1e31c', 'request_id': 'req-97824164-cb3c-4973-a91c-bfea6a38cfc8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:38.031374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476eb6cf8146433f85290d955ed1e31c', 'request_id': 'req-97824164-cb3c-4973-a91c-bfea6a38cfc8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:38.063296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] The token cache is being invalidate because project 476eb6cf8146433f85290d955ed1e31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:02:38.063577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:38.064009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97824164-cb3c-4973-a91c-bfea6a38cfc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:02:38.065479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 768/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:02:37 2022] DELETE /identity/v3/projects/476eb6cf8146433f85290d955ed1e31c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:02:47.377280 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=62 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:48.061093 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:50.538072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8464aa-a573-4b97-81e0-fc7f545496b7 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:50.538682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8464aa-a573-4b97-81e0-fc7f545496b7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:50.538682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8464aa-a573-4b97-81e0-fc7f545496b7 None None] PATH_INFO: `/v3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:50.539943 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 743/1511] 10.222.0.36 () {54 vars in 925 bytes} [Sun Jul 24 01:05:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:05:50.551005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40655-49ce-4076-8d91-2dc8c8466c64 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:50.551481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40655-49ce-4076-8d91-2dc8c8466c64 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:50.551590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40655-49ce-4076-8d91-2dc8c8466c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:50.632422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9be40655-49ce-4076-8d91-2dc8c8466c64 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:50.633635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9be40655-49ce-4076-8d91-2dc8c8466c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:50.750325 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 769/1512] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jul 24 01:05:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:54.391031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edafa0-017f-4901-a0bf-98a367145ead None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:54.391616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edafa0-017f-4901-a0bf-98a367145ead None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:54.391616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edafa0-017f-4901-a0bf-98a367145ead None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:54.393229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 744/1513] 10.222.0.27 () {54 vars in 961 bytes} [Sun Jul 24 01:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:54.398213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55161-030b-4017-860e-51d424b6b621 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:54.398626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55161-030b-4017-860e-51d424b6b621 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:54.398779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55161-030b-4017-860e-51d424b6b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:54.417168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cbf55161-030b-4017-860e-51d424b6b621 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:54.418517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cbf55161-030b-4017-860e-51d424b6b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:54.427924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 770/1514] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Jul 24 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:54.435541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edafa0-017f-4901-a0bf-98a367145ead None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:54.450232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edafa0-017f-4901-a0bf-98a367145ead None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:54.455290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:54.456036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:54.456327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:54.456601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:54.465181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:54.466836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324a1e1-cd12-416d-995e-ab5919695c3d service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:54.477760 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 745/1515] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:04.412098 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=77 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:04.473211 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:07.330846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026aad-b6c5-46e7-a05c-fffa1c1df173 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:07.331414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026aad-b6c5-46e7-a05c-fffa1c1df173 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:07.331414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026aad-b6c5-46e7-a05c-fffa1c1df173 None None] PATH_INFO: `/v3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:07.332728 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 771/1516] 10.222.0.60 () {54 vars in 925 bytes} [Sun Jul 24 01:06:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:06:07.338785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37104d2-149b-4ce1-9f1f-bbb785b39746 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:07.339227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37104d2-149b-4ce1-9f1f-bbb785b39746 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:07.339370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37104d2-149b-4ce1-9f1f-bbb785b39746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:07.357365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e37104d2-149b-4ce1-9f1f-bbb785b39746 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:07.358613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e37104d2-149b-4ce1-9f1f-bbb785b39746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:07.367808 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 746/1517] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 24 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:15.879329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026aad-b6c5-46e7-a05c-fffa1c1df173 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:15.892824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026aad-b6c5-46e7-a05c-fffa1c1df173 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:15.897640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:15.898292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:15.898575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:15.898848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:15.907490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:15.909077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee392f0-cad1-4f1a-b17b-f33d31c2325d service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:15.918732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 772/1518] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:17.352321 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:25.914730 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:27.362546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:27.363104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:27.363104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:27.364794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 747/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:27.369632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd63d6-7d79-4237-9c96-f3d7afb7023f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:27.370110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd63d6-7d79-4237-9c96-f3d7afb7023f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:27.370320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd63d6-7d79-4237-9c96-f3d7afb7023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:27.432133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2bd63d6-7d79-4237-9c96-f3d7afb7023f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:27.433345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2bd63d6-7d79-4237-9c96-f3d7afb7023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:27.527259 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 773/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:27.682772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:27.684595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:27.786587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f622-355c-4ae1-9767-715daccf411e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:27.792112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:27.792757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:27.793041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:27.793315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:27.802227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:27.803801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620e889-c7f5-4d2d-a18f-966dc0d5bb80 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:27.814570 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 748/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:28.653011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da421-ac83-4111-aa6c-83e01224c8bd None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:28.653584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da421-ac83-4111-aa6c-83e01224c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:28.653584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da421-ac83-4111-aa6c-83e01224c8bd None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:28.654982 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:28.660408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9935-6e9d-43ed-8b7e-f6086309a043 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:28.660840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9935-6e9d-43ed-8b7e-f6086309a043 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:28.660950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f9935-6e9d-43ed-8b7e-f6086309a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:28.678702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d66f9935-6e9d-43ed-8b7e-f6086309a043 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:28.679892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d66f9935-6e9d-43ed-8b7e-f6086309a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:28.687769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:28.838520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9da421-ac83-4111-aa6c-83e01224c8bd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:28.853436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9da421-ac83-4111-aa6c-83e01224c8bd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:28.858822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:28.859446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:28.859725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:28.860738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:28.868902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:28.870521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a2228-9207-4188-9c45-13b03bcf70e9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:28.880498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 775/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:32.753129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:32.753655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:32.753655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:32.754992 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:32.760292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f27d4-3147-4c27-a973-c760a6069a29 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:32.760748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f27d4-3147-4c27-a973-c760a6069a29 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:32.760850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f27d4-3147-4c27-a973-c760a6069a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:32.779724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-693f27d4-3147-4c27-a973-c760a6069a29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:32.780910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-693f27d4-3147-4c27-a973-c760a6069a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:32.788679 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:32.864406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:32.866329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:32.944225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b7a07-fa60-4a58-a796-b52e90b9e9f0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:32.947774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:32.948415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:32.948690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:32.948958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:32.958008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:32.959426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e5e44-a261-4974-9df9-066aaf91d5d1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:32.968681 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 751/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:35.062804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:35.063861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:35.063999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:35.065384 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:35.070733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60717-733a-4251-8fd0-c7b7750c3f78 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:35.071165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60717-733a-4251-8fd0-c7b7750c3f78 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:35.071298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60717-733a-4251-8fd0-c7b7750c3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:35.089665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-91d60717-733a-4251-8fd0-c7b7750c3f78 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:35.090901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-91d60717-733a-4251-8fd0-c7b7750c3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:35.099215 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:35.139217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:35.140918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:35.154240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ebd5-161b-4625-81be-ce66c52f30f3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:35.157837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:35.158466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:35.158743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:35.159015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:35.168240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:35.169658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97206698-816c-479d-9a06-e12545014bc7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:35.180057 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 778/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:45.084829 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:45.175629 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=65 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:28.284534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49575db-ed59-4cfd-9b2b-7f41671f3c2c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:28.285165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49575db-ed59-4cfd-9b2b-7f41671f3c2c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:28.285260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49575db-ed59-4cfd-9b2b-7f41671f3c2c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:28.289752 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 753/1531] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:07:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:07:28.294455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271de7c-a14a-4c9c-abbf-7a4a573046bb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:28.295100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271de7c-a14a-4c9c-abbf-7a4a573046bb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:28.295296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271de7c-a14a-4c9c-abbf-7a4a573046bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:28.315609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5271de7c-a14a-4c9c-abbf-7a4a573046bb None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:28.316850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5271de7c-a14a-4c9c-abbf-7a4a573046bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:28.325634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 779/1532] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:38.309468 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:05.590339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.590909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.590909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.617085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:05.618730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:05.632120 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 754/1533] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:05.642710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.643263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.643263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.666584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:05.667794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:05.682619 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 780/1534] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:05.687876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:05.703499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee31f2-10f8-4f13-a705-a07f24be02db None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:05.711281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:05.712252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.712771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.713251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.714251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:05.714768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:05.716009 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:05.716009 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:08:05.716009 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:08:05.718234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b0da-4e2e-4899-9875-aca86ea64bb9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:05.738466 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 755/1535] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:05.746471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:05.756944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93c6f0-fd3c-419a-93d2-6948c2dec32d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:05.762466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1fcaf-70ce-4ec9-9b1b-4cdb4a109e23 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.763186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1fcaf-70ce-4ec9-9b1b-4cdb4a109e23 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.763794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1fcaf-70ce-4ec9-9b1b-4cdb4a109e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.769703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:05.770478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.770748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.771031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.771851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:05.773032 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:05.773032 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:08:05.773032 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:08:05.774364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb0ac-fed6-477b-b62d-c51f5469fbdc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:05.798713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4ba1fcaf-70ce-4ec9-9b1b-4cdb4a109e23 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:05.800454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ba1fcaf-70ce-4ec9-9b1b-4cdb4a109e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:05.822198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 756/1536] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:05.824051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.824635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.825120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.838376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 781/1537] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:05.847743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f4e7-81b8-4e7e-b797-eef457f5c66d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.848033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f4e7-81b8-4e7e-b797-eef457f5c66d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.848236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f4e7-81b8-4e7e-b797-eef457f5c66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:05.870319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:05.871896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:05.883029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2974f4e7-81b8-4e7e-b797-eef457f5c66d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:05.884262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2974f4e7-81b8-4e7e-b797-eef457f5c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:05.970395 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 782/1538] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:05.974424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e00f-6bee-4ffa-8fe0-56ebc8bc5b5a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:05.974921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e00f-6bee-4ffa-8fe0-56ebc8bc5b5a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:05.975352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e00f-6bee-4ffa-8fe0-56ebc8bc5b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.001340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4c3e00f-6bee-4ffa-8fe0-56ebc8bc5b5a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.002905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4c3e00f-6bee-4ffa-8fe0-56ebc8bc5b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.010569 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 757/1539] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.012880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.017826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 783/1540] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.019368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98cd0c-a7a1-43f1-905c-e8f70c181189 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.020110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98cd0c-a7a1-43f1-905c-e8f70c181189 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.020566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98cd0c-a7a1-43f1-905c-e8f70c181189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.034170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a981-71fa-4cdd-b30d-70c44415fc97 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.040995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.041701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.042001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.042263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.043146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.044102 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:06.044102 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:08:06.044102 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:08:06.045423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ff0e-a436-4460-8b95-b1f48c2d9dde admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.047541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b98cd0c-a7a1-43f1-905c-e8f70c181189 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.048763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b98cd0c-a7a1-43f1-905c-e8f70c181189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.061260 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 784/1541] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.062949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47c1c-fb37-464e-ad27-394f484f0838 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.063412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47c1c-fb37-464e-ad27-394f484f0838 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.063686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d47c1c-fb37-464e-ad27-394f484f0838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.071157 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 758/1542] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.072434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.072752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.072991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.085742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a1d47c1c-fb37-464e-ad27-394f484f0838 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.087139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a1d47c1c-fb37-464e-ad27-394f484f0838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.094104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.095495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.101911 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 785/1543] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.101911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331d04-43d2-4dcb-8dea-1e3f41c8a799 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.101911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331d04-43d2-4dcb-8dea-1e3f41c8a799 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.101911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331d04-43d2-4dcb-8dea-1e3f41c8a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.108929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 759/1544] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.109779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.124643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3f331d04-43d2-4dcb-8dea-1e3f41c8a799 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.124643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f331d04-43d2-4dcb-8dea-1e3f41c8a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.129608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116575-5de3-468d-8d46-d32554a0f7b4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.133512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 786/1545] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.134737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.134952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.135199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.135303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.135481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.135578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.135837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.139746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.139746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.139746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3da2d-f50e-4731-90fb-9e0850b5f2cc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.153614 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 760/1546] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.155278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.155562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.155838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.164173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.165382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.175424 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 787/1547] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.176279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.178065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.179440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.187348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331959e-2479-4498-8e88-59dfc44614e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.190894 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 761/1548] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.191757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.192980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.193962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.194408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.194847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.195732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.196198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.197993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc281ec0-7c89-4ed5-993e-c45301f7c814 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.205278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c658ecd-d161-4de6-b4e8-7d14810ebf9b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.213319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.213460 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 788/1549] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.213551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.213551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.213551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.213967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.213967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.213967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.214149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.217395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b69289-3fd3-4e8d-8f3b-05103663339b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.229575 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 762/1550] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:06.230833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.231121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.231400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.233109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.234711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.242616 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 789/1551] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.243556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.250596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.251843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.254113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc7382-308e-4ea6-98a2-17b7a6266946 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.258796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.259444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.259721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.259992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.260108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 763/1552] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.260748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.262501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.262825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.265511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4648d0-17d1-423d-a983-92b3ea79d78d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.270891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931714-e632-46c9-98a7-e88fe38d9944 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.275590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.276244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.276527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.276801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.277532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.279470 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 790/1553] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.279929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.281373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d34-96dc-406a-8616-8bba1f5521d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.281906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d34-96dc-406a-8616-8bba1f5521d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.282391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73d34-96dc-406a-8616-8bba1f5521d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.300453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6fb73d34-96dc-406a-8616-8bba1f5521d2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.301962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6fb73d34-96dc-406a-8616-8bba1f5521d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.312021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 791/1554] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.312187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 764/1555] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.315651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.315774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.315774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.315774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.334363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:06.335964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:06.367190 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:06.381140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33683-1c25-44d4-a041-4ceea9093cda admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.383808 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:06.386562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.387415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.387695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.388519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.389594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.392123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.401567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 792/1556] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:06.402437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.414740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35200c-417a-49f5-915a-9d6133c3f979 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.419205 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 765/1557] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.420184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.422690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.423398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.423681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.423957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.424692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.426326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.438313 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 793/1558] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:06.440430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.449923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77510f6-beb2-44d0-953b-e5237843fd5a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.483376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d43b-603b-4a25-8de4-9a4786836ed0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.488062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.488911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.489191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.489464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.490269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.496291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.496291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.504681 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 766/1559] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.505486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.516866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e57a6-0e98-4da9-9cc0-505f1719a05c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.521763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.522406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.522688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.522960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.523229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.523652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.523901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.524189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.524465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.525201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.525513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.525608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.527141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.539539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 794/1560] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.546631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.559090 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 767/1561] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.559090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.565769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7e94-e59e-4128-8d94-4720ef32ab28 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.625957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed5309-ed1a-4e8c-bb87-44cb78641063 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.629901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.630579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.630675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.630992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.631268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.631359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.631549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.631824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.631960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.632552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.632854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.634106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.634486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.648154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 768/1562] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.649235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.661798 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 795/1563] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.661798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.662391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842cc58-225e-4d88-ac64-74ef2f3f4f0f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.665080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.665767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.666045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.666316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.667051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:06.667350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.668945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.672684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfa395-be96-457d-b855-661c7ae9fcb4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.678248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.679449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.679746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.680030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.680723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.689706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 769/1564] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:06.689885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.689977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.693436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9385-5b47-4996-9dfa-de274fe85c1b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.698378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.699261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.699538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.699810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] PATH_INFO: `/v3/projects/ea590968957f4c1d82b8cd387c54b303/users/3186377eca704aba9fbaaaf8cd4c2b91/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.705660 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 796/1565] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.706348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.716234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea590968957f4c1d82b8cd387c54b303, user_id=3186377eca704aba9fbaaaf8cd4c2b91, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.716660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22dd7-18f4-4682-89ba-b42e52f49e8a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.719072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.723343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.724577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.724865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.725121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.726115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.728029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.734614 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 770/1566] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:06 2022] PUT /identity/v3/projects/ea590968957f4c1d82b8cd387c54b303/users/3186377eca704aba9fbaaaf8cd4c2b91/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:06.735627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.745473 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:06.766346 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 797/1567] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.766346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.794813 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:06.811184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1997-eae5-425e-b4e5-c83ebe9bde8a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.833639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c05a8-00ba-4a32-ad44-3ab6ceeb50fd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.838496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.839192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.839482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.839748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.840440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.843067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.867403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 798/1568] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.868517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.873007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.873801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.874086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.874361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.875116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.877081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.879853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433988-9632-422b-aa07-551bbcc3591d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:06.893021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:06.893768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:06.894049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:06.894327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:06.895070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:06.897025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:06.907936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 771/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 401 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.908953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.934959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 799/1570] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:06.935798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:06.986359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b0a5-2d1d-4bcc-a953-22b795655e3e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.009885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737bc53-ddc3-4984-92fc-95ac41b99aaf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.017033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.017748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.018033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.018315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.019017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.020964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.042319 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.050477 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 800/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:06 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.051520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.058900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.059584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.061098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.061098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.061767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.063378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9009594-d8d8-4152-a3c6-572ce942999b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.073821 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 772/1572] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.075213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.075461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.076354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.104757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] MFA Rules not processed for user `3186377eca704aba9fbaaaf8cd4c2b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:07.106083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:07.128004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75cad-db11-46cf-83c6-a527f826c9b3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.132668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.133343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.133650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.133956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.134724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.136342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.147607 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 801/1573] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.148401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.160110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7e1fb-6a4f-4641-bff4-f40c288966ce admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.164921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.165574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.165894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.166172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.166866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.168831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.177249 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 773/1574] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:07.181372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.183117 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.191593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b10c2d-972f-4182-ac5e-3def624534e2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.195903 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 802/1575] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/users => generated 300 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.196447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.197080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.197189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.197433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.197657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.198451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.200367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.208111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0876e1-ca44-4399-82db-d1874bac6a54 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.211586 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 774/1576] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.212362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.215271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.215986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.216274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.217173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.217946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.219906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.222402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf3bb-2249-4caf-9969-acd02a18b01d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.227288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.227949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.228232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.228515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.229210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.231176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.242163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 803/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/users => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.243142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.254351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4032ef-1389-49d8-b702-0f0a7cb23611 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.258633 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 775/1578] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.258633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.259370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.260031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.260314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.260588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.261331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.264542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.267297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4ce5-2c70-4c65-8287-efffadec5958 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.271922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.272626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.272916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.273263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.273967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.275711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.288488 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 804/1579] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.288488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.288753 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 776/1580] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.289126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.299412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2388b86-f4f0-4d86-b474-6aebd1faadf2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.299568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e992b-358e-4e6d-9d22-bb9ea2a0ebe3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.303956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.304110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.304614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.304719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.304895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.304983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.305169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.305342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.305936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.306044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.307526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.307845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.322158 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 805/1581] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.322158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.330343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91bf45-902e-4134-92ad-f7e240458654 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.335266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.335958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.336225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.336503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.337075 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 777/1582] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.337256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.337728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.338888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.352329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 806/1583] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.352329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.361966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754334d6-a21e-420a-8290-b867c0591a52 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.412855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2a88-d6cb-4047-967e-a9dcd4f5238b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.417761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.418445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.418738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.419035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.420480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.422150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.425895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.426576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.426858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.427125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.427855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.429466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.433452 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 778/1584] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.434402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.443312 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 807/1585] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.443482 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.443576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.448069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35799-42aa-443b-a2cb-d3e2a01467ff admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.452888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382b672-73bd-434b-9807-3ff1a45b5248 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.453770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.454478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.454775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.455138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.455864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.457470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.457827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.458491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.458776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.459049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.459786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.461369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.472906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 779/1586] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.472906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.473153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 808/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.473834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.481821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfc180-4842-41f6-827d-d64e62f9f6d7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.486964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff3a7-5ebf-4198-9998-d20255d8e867 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.493231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.493416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.494160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.494310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.494447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.494561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.494716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] PATH_INFO: `/v3/projects/0bb96ad5350f4ba08c824c9535a4374d/users/533fae7f526843648fc33633404cefd8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.494823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] PATH_INFO: `/v3/projects/24fe7f092bc74aeb8d8d7c1990d97e91/users/00d0e7c10b7d4268af4d0947569f1fce/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.511137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fe7f092bc74aeb8d8d7c1990d97e91, user_id=00d0e7c10b7d4268af4d0947569f1fce, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.511337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb96ad5350f4ba08c824c9535a4374d, user_id=533fae7f526843648fc33633404cefd8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.512238 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:07.512238 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:08:07.512238 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:08:07.514539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.514999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.531874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 780/1588] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:07 2022] PUT /identity/v3/projects/0bb96ad5350f4ba08c824c9535a4374d/users/533fae7f526843648fc33633404cefd8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:07.532841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.544632 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 809/1589] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:07 2022] PUT /identity/v3/projects/24fe7f092bc74aeb8d8d7c1990d97e91/users/00d0e7c10b7d4268af4d0947569f1fce/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:07.545696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.608712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cade71-4f13-4e83-9d81-9ecdbe068cb2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.610270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdde04d-ab06-490f-a7c3-0198d5bdc6dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.613473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.614183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.614466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.614743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.614846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.615432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.615538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.615710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.615995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.616705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.617358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.618317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.619632 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.631441 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 810/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.632394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.641518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 781/1591] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:07.642399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.647875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589cb6b-115a-4700-aeec-3b4cfbb454b0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.651984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c4e8-e448-4c24-aee0-642e9d228554 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.652898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.653904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.654373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.654654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] PATH_INFO: `/v3/projects/20c292602e544b3ba75931d5c9aeb661/users/9af54f5c62c5453faec895bd139d4e1b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.656892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.657538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.657847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.658122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.658847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.660436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.671390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c292602e544b3ba75931d5c9aeb661, user_id=9af54f5c62c5453faec895bd139d4e1b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.671874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 782/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.672293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.674158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.684801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e70-176e-40d4-ae64-1ca49e151a5e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.688376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 811/1593] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:07 2022] PUT /identity/v3/projects/20c292602e544b3ba75931d5c9aeb661/users/9af54f5c62c5453faec895bd139d4e1b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:07.699777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.745677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.746479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.746839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.747183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.748406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.750151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2acb1-5ded-42b8-a53e-220003808e07 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.759414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409b71-3c93-4f40-bbfb-a5babbd36d2e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.760101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 783/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.764000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.764000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.764000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.764866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.765529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.765836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.766107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.766829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.768425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a74f03-4717-440f-a074-e78dd22943dd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.781887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 812/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.781887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.781887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.781887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.790671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] MFA Rules not processed for user `533fae7f526843648fc33633404cefd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:07.791895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:07.806190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] MFA Rules not processed for user `00d0e7c10b7d4268af4d0947569f1fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:07.807375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:07.827001 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.864160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 784/1596] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:07.865089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.876711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 813/1597] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:07.877544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bf564-9d3c-4499-bd67-abc88474b723 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.877652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.882240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.883235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.883588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.883935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] PATH_INFO: `/v3/projects/dd53a8a88895489eb82bd671379ee52a/users/f1a30d650263498d9d81b314b4fca6f0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.888833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2459f-602e-4207-a882-8801fb0c6f19 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.893470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.894213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.894471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.894743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.895468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.897064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.899898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd53a8a88895489eb82bd671379ee52a, user_id=f1a30d650263498d9d81b314b4fca6f0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:07.902553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19799b75-9245-4ace-a518-28a3a8d3cae4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:07.907777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 814/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:07.908876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:07.918303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 785/1599] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:07 2022] PUT /identity/v3/projects/dd53a8a88895489eb82bd671379ee52a/users/f1a30d650263498d9d81b314b4fca6f0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:07.919909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c91da-5081-44a7-9c87-e896dc7a9d9d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:07.920677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.921030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.921375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:07.949241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] MFA Rules not processed for user `9af54f5c62c5453faec895bd139d4e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:07.950433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:07.970900 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:07.988482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:07.989566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:07.990002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:07.990345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] PATH_INFO: `/v3/projects/913058bc11904339a05f4784fee6f1a1/users/b3861659794d4aa699ca3e984999a1fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.007500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=913058bc11904339a05f4784fee6f1a1, user_id=b3861659794d4aa699ca3e984999a1fe, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.010243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.024094 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 786/1600] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:08.028194 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 815/1601] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:07 2022] PUT /identity/v3/projects/913058bc11904339a05f4784fee6f1a1/users/b3861659794d4aa699ca3e984999a1fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:08.028322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.028415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.038846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354a32-dde8-4687-924f-41b5c1ea270c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.093261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5c9a9-9e30-4ff6-a657-139706a7ab3b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.096975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.097930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.098139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.098354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.098632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] PATH_INFO: `/v3/projects/3d121ab923474b2ca0c274a943530dd2/users/1416426260704ceca5211082c2399bca/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.099087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.099366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.099638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] PATH_INFO: `/v3/projects/7e0b26f8e49543df86e6bde6f426d56a/users/edb236adac344c1e8dc1701f972c4ad4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.115065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d121ab923474b2ca0c274a943530dd2, user_id=1416426260704ceca5211082c2399bca, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.115333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0b26f8e49543df86e6bde6f426d56a, user_id=edb236adac344c1e8dc1701f972c4ad4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.117954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.118068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.135865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 787/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:08 2022] PUT /identity/v3/projects/3d121ab923474b2ca0c274a943530dd2/users/1416426260704ceca5211082c2399bca/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:08.136631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.137877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 816/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:08 2022] PUT /identity/v3/projects/7e0b26f8e49543df86e6bde6f426d56a/users/edb236adac344c1e8dc1701f972c4ad4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:08.138682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.176383 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.205082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c897-57cb-4218-ba8a-51887b7dc5ca admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.209731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.210385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.210663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.210932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.211683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.213583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.217257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac0249-6d2c-4617-8017-c70b8e0eb58a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.221892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.222553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.222836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.223110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.223802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.225978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214b3b-b0ca-4c46-af66-a77eae5967cd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.241823 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 817/1604] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.243018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.258317 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 788/1605] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.259615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.259908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.260186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.286349 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.289233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] MFA Rules not processed for user `f1a30d650263498d9d81b314b4fca6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:08.290574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:08.318425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c19a8-c6b2-416d-8f45-2d789df6fd03 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.362570 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 789/1606] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:08.363546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.377625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.378584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.379008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.379294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] PATH_INFO: `/v3/projects/0b389c524b5c44d4b51752037fd3440c/users/5bbfa80e74984402a0e9381be921b4a6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.394491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b389c524b5c44d4b51752037fd3440c, user_id=5bbfa80e74984402a0e9381be921b4a6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.397133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff3fd-2d54-4116-8c4d-9a050ecbc8a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.410340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 818/1607] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:08 2022] PUT /identity/v3/projects/0b389c524b5c44d4b51752037fd3440c/users/5bbfa80e74984402a0e9381be921b4a6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:08.411622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8500-5528-4d85-bf82-f16add2246ad None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.411913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8500-5528-4d85-bf82-f16add2246ad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.412229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc8500-5528-4d85-bf82-f16add2246ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.429721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1ddc8500-5528-4d85-bf82-f16add2246ad None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:08.430225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403ec71-0ca0-4937-8037-f543414e4939 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.430941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1ddc8500-5528-4d85-bf82-f16add2246ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:08.472899 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.489850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.490519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.490796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.491068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.491766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.493011 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 819/1608] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:08.494034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965120-c7db-429a-8fe7-8e4b9866d591 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.494329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.494617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.494890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.524969 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 790/1609] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.526434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.526722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.527001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.530421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] MFA Rules not processed for user `edb236adac344c1e8dc1701f972c4ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:08.531705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:08.555219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] MFA Rules not processed for user `1416426260704ceca5211082c2399bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:08.555742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:08.593148 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.603084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 820/1610] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:08.603994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.626744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 791/1611] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:08.627725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.675157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907e08-543c-4a09-a7cb-81c7aa3ccb44 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.679991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.680701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.681049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.681252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.681980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.683917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.698258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ff60-a554-49cd-b049-aa70d5ca65e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.704208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.704889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.705166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.705439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.706163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.707792 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 821/1612] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.708087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.708875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.718929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b137ae-eb7d-49ac-90a6-12b48694745c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.723829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.724420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.724703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.725012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.725964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.727865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.731319 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 792/1613] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.732898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.742594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5f6f4-4f09-4932-b050-21dab392ae9e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.748211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.749076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.749447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.749665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.750471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.752106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.758761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 822/1614] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.759665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.762393 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 793/1615] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:08.764374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.774257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2444d-ed3f-42f7-a412-1f5b3ecf28f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.809548 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.819321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ff14-a62f-4c94-92c8-15b00830b76c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.823454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.824099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.824381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.824782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.836288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.836961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.837245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.837523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.838294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.840224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.864419 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 794/1616] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.864419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.872415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4590-e6cd-4243-ac8e-da2e58feb854 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.877336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.878030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.878316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.878620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.879313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.881219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.890222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.891668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.902796 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 823/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:08.903504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.913376 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 795/1618] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:08.913376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:08.916667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47034cb6-455b-4fc0-8948-2aaab79ff4ce service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.932566 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:08.986469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.987163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:08.987509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:08.987860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:08.988658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:08.990609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:08.992279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785fe73-bf69-4072-97ff-f8df28afedf0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:08.999114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:08.999955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.000803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.001227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.002669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.004916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.018634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 796/1619] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.019529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.029285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 824/1620] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:08 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:09.029285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.035725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367d94-3b2b-4b2f-abdd-ea50aac74b00 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.106445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e676d-42ac-46fb-b824-a1278c0ef49a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.114739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.115609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.115959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.116309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.116540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.117196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.117526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.117916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.118297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.119279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.121407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.121971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.136690 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 797/1621] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.137972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.151452 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 825/1622] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:09 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:09.151452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.151659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ca62-18d2-4aad-91c3-23bea7b3124d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.154965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.155942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.156315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.156623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] PATH_INFO: `/v3/projects/0b389c524b5c44d4b51752037fd3440c/users/5bbfa80e74984402a0e9381be921b4a6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.158912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b389c524b5c44d4b51752037fd3440c, user_id=5bbfa80e74984402a0e9381be921b4a6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.161637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.162107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9104e-aef3-42a9-b4c4-54d6cd772063 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.167528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.168395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.169728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.170944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.172190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.174088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.179734 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 798/1623] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/0b389c524b5c44d4b51752037fd3440c/users/5bbfa80e74984402a0e9381be921b4a6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:09.180750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.201051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 826/1624] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.201051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.211894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a913a1d-f680-44ab-8559-5c44bdb071f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.224190 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.278684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a1df9-ef0c-478f-addb-068059de26a9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.284706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.285705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.286145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.286696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.287802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.289956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.315445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.316640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.317066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.317497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] PATH_INFO: `/v3/projects/d00d5448f99d408b971c39511ef29def/users/b9ba87bab49345f9a34545b224e53627/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.322503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 799/1625] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:09 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:09.323340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.335645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b6dd-aaca-4201-b7ec-f1503c113b56 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.340987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.342539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.342830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.343142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.343944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.346240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.350059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d5448f99d408b971c39511ef29def, user_id=b9ba87bab49345f9a34545b224e53627, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.354032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.374726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 800/1626] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:09 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:09.375839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.376506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 827/1627] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/d00d5448f99d408b971c39511ef29def/users/b9ba87bab49345f9a34545b224e53627/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:09.377474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.385030 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.391247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeb14c-18fd-4a9c-ac02-995d725c0dfc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.457435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.458381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.458665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.458964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] PATH_INFO: `/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a/users/58b33e12de404074a649ce44afe05e30/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.459909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444a641-8958-45d8-a722-3eadc104c0d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.465456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.466325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.466713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.467166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.468000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.469743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8256-d7df-49c6-abcf-1aceff212b84 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.482429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33915122dc4c62b3f4ad04bf7f9f9a, user_id=58b33e12de404074a649ce44afe05e30, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.486453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 828/1628] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.486453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.486453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.486453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.486838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.510616 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 801/1629] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a/users/58b33e12de404074a649ce44afe05e30/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:09.510616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.521737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] MFA Rules not processed for user `5bbfa80e74984402a0e9381be921b4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:09.523179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:09.587705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983be1-8562-4791-ba56-d4bd52b4276f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.595354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.596360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.596643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.596963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] PATH_INFO: `/v3/projects/6c13d71cdd93487d966180099f431a87/users/a006a21ec5be4ff283502a39b6cf26b2/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.605407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 829/1630] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:09.606822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.618448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c13d71cdd93487d966180099f431a87, user_id=a006a21ec5be4ff283502a39b6cf26b2, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.621296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.635562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26065e-9b74-49c3-844b-eb82003b2f34 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.644668 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 802/1631] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/6c13d71cdd93487d966180099f431a87/users/a006a21ec5be4ff283502a39b6cf26b2/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:09.646183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.652759 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.716119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.716813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.717155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.717437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.718341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.720914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.736481 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 830/1632] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.736481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.742514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dab3a-254f-4dd8-ad3e-b6e90ca2693c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.744265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dc55f-3baf-430f-b57f-bed0fc856e7b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.750291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.750950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.751234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.751509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.752282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.753931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.765794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.766083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.766344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.769182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.770083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.771856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.772815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 831/1633] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.774267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.787789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 803/1634] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.788649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.789258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d28a0-2197-4d06-9f80-f7f7612748ac admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.798878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.800058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.800399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.800768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] PATH_INFO: `/v3/projects/0ec749645f4f431da4417b69517c577f/users/df49d297ac6149d89812ad6595b43103/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.801608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7627b4-f8ca-47c3-bbf8-98e1c4e12e5d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.805432 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:09.806932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.807842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.808267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.808548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.809281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.811058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6fb58-910e-4424-a7d2-918422539963 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.821704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec749645f4f431da4417b69517c577f, user_id=df49d297ac6149d89812ad6595b43103, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.822627 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 804/1635] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.824502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9791a-0dee-4247-bdcd-2afec5931892 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.824791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9791a-0dee-4247-bdcd-2afec5931892 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.824878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.825073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9791a-0dee-4247-bdcd-2afec5931892 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.827421 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 805/1636] 10.222.0.27 () {54 vars in 962 bytes} [Sun Jul 24 01:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:09.828149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9791a-0dee-4247-bdcd-2afec5931892 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.840932 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 832/1637] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/0ec749645f4f431da4417b69517c577f/users/df49d297ac6149d89812ad6595b43103/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:09.842012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.844985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9791a-0dee-4247-bdcd-2afec5931892 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.924017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.924701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.924985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.925262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.926081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.927725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.938478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53704c-2d7c-4fd3-99d8-aa79e383750c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.939995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 806/1638] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:09.941055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:09.944967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.947205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.947749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.948477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] PATH_INFO: `/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f/users/1c501322707445c8b6e8bd170e7cead5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.955157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2cdf1-9ad1-4d10-ac9b-8c567871101c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:09.961691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:09.963992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:09.964545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:09.965471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] PATH_INFO: `/v3/projects/d00d5448f99d408b971c39511ef29def/users/b9ba87bab49345f9a34545b224e53627/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:09.968921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d5448f99d408b971c39511ef29def, user_id=b9ba87bab49345f9a34545b224e53627, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.971813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6a822a6ccb46cbbca449bcd02ee25f, user_id=1c501322707445c8b6e8bd170e7cead5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:09.973308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:09.975635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.005060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 833/1639] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f/users/1c501322707445c8b6e8bd170e7cead5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.005636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.006751 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 807/1640] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:09 2022] PUT /identity/v3/projects/d00d5448f99d408b971c39511ef29def/users/b9ba87bab49345f9a34545b224e53627/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.007995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.093097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c035cb-c0a0-4056-906c-1db93e21526b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.099281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.100213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.100498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.101081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] PATH_INFO: `/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a/users/58b33e12de404074a649ce44afe05e30/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.101310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76b0f0-6fe6-4cbf-ac6a-d3213ecf7753 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.103578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33915122dc4c62b3f4ad04bf7f9f9a, user_id=58b33e12de404074a649ce44afe05e30, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.106684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.106950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43165bc8-873b-469b-8f67-b68468e4be56 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.107877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.108162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.108579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] PATH_INFO: `/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f/users/827c014b86144856912587798bc424cc/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.119364 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 808/1641] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a/users/58b33e12de404074a649ce44afe05e30/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.120800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.121145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.121448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.133241 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.149175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9016477f5fb4f8ca9ae1e2cd9140f1f, user_id=827c014b86144856912587798bc424cc, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.151977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.175285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 834/1642] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f/users/827c014b86144856912587798bc424cc/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.179023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.180527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:10.182880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:10.263531 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.282152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5af45b-ea33-4b75-93d9-a98e2ce1e7bd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.288283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.288963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.289246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.289722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.290424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.292053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.303536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 835/1643] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:10.304299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.320717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015905f-7237-4f7a-8ef2-648627f6359c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.325320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 809/1644] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:10.325943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.326868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.327147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.327420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] PATH_INFO: `/v3/projects/6c13d71cdd93487d966180099f431a87/users/a006a21ec5be4ff283502a39b6cf26b2/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.327864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.329581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c13d71cdd93487d966180099f431a87, user_id=a006a21ec5be4ff283502a39b6cf26b2, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.332719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b20e-62f4-4412-ad40-0564a3e92442 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.344895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc470c56-82dd-45d3-97cd-df2c60fb0bc3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.346718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 836/1645] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/6c13d71cdd93487d966180099f431a87/users/a006a21ec5be4ff283502a39b6cf26b2/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.357514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.357856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.358035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.392757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] MFA Rules not processed for user `b9ba87bab49345f9a34545b224e53627`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:10.395433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:10.436229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.436944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.437227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.437500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.438304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.439961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a3afa-46df-43af-8082-7ad6a80bb90d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.460525 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 810/1646] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:10.463880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdbd9-0e90-4349-be56-e6f5cbf94105 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.464375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdbd9-0e90-4349-be56-e6f5cbf94105 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.464780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdbd9-0e90-4349-be56-e6f5cbf94105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.500810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 837/1647] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:10.502069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.516361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d4afdbd9-0e90-4349-be56-e6f5cbf94105 None None] MFA Rules not processed for user `58b33e12de404074a649ce44afe05e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:10.518317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d4afdbd9-0e90-4349-be56-e6f5cbf94105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:10.518715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93b37b-43f9-4913-ac08-b6c68a68a42e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.525823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.526631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.527021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.527525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.528672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.530940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.551782 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 838/1648] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:10.552729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.568726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319fe0b-82c4-48f9-84c8-8a985ae18671 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.580098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.582349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.582670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.582948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] PATH_INFO: `/v3/projects/0ec749645f4f431da4417b69517c577f/users/df49d297ac6149d89812ad6595b43103/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.585454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec749645f4f431da4417b69517c577f, user_id=df49d297ac6149d89812ad6595b43103, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.588656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.614205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 839/1649] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/0ec749645f4f431da4417b69517c577f/users/df49d297ac6149d89812ad6595b43103/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.614769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.648859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 811/1650] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:10.650788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.651294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.652235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.662430 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.695459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] MFA Rules not processed for user `a006a21ec5be4ff283502a39b6cf26b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:10.697288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:10.724930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b99a3-6d78-45ec-8f29-e98ce8bba355 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.731930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.732701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.732885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.733170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.801050 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:10.824267 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 812/1651] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:10.824267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.864731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.867205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2fa3-233e-4cb0-a787-2d005e0211ad service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.888607 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 840/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:10.890379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a2e8-22da-4842-b5e0-7196ec18d9a2 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.891137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a2e8-22da-4842-b5e0-7196ec18d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.891326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a2e8-22da-4842-b5e0-7196ec18d9a2 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.893179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 841/1653] 10.222.0.27 () {54 vars in 962 bytes} [Sun Jul 24 01:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:10.894024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a2e8-22da-4842-b5e0-7196ec18d9a2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:10.944720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962b7bf-cc7a-4ba4-9165-c35788897b6b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:10.953916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:10.955759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.957344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.958326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] PATH_INFO: `/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f/users/1c501322707445c8b6e8bd170e7cead5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.961362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6a822a6ccb46cbbca449bcd02ee25f, user_id=1c501322707445c8b6e8bd170e7cead5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:10.964456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115578e-f589-44d0-b0fa-9b1a995f3a92 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:10.978934 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 813/1654] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f/users/1c501322707445c8b6e8bd170e7cead5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:10.980889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ef95-3c27-4874-b5b3-12489c1d50f0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:10.981181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ef95-3c27-4874-b5b3-12489c1d50f0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:10.981466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ef95-3c27-4874-b5b3-12489c1d50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:10.997999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a2e8-22da-4842-b5e0-7196ec18d9a2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.064214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f90ef95-3c27-4874-b5b3-12489c1d50f0 None None] MFA Rules not processed for user `df49d297ac6149d89812ad6595b43103`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:11.065430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f90ef95-3c27-4874-b5b3-12489c1d50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:11.083448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.085861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.085861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.085861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] PATH_INFO: `/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f/users/827c014b86144856912587798bc424cc/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.087920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9016477f5fb4f8ca9ae1e2cd9140f1f, user_id=827c014b86144856912587798bc424cc, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.092116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac389cf4-b988-467c-9622-a8b030753a51 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.121263 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 842/1655] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:10 2022] PUT /identity/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f/users/827c014b86144856912587798bc424cc/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:11.125216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853583ce-3903-4404-a898-e29460af8cba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.125531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853583ce-3903-4404-a898-e29460af8cba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.125852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853583ce-3903-4404-a898-e29460af8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.149417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-853583ce-3903-4404-a898-e29460af8cba None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:11.151152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-853583ce-3903-4404-a898-e29460af8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:11.173263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 814/1656] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:11.174970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.175399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.175673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.202791 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:11.215110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] MFA Rules not processed for user `1c501322707445c8b6e8bd170e7cead5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:11.218632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:11.263500 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:11.277825 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 843/1657] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:11.280629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.280982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.281327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.315941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] MFA Rules not processed for user `827c014b86144856912587798bc424cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:11.317980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:11.319667 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 815/1658] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:11.320517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.337798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850c897-dade-4bfe-93f9-a6b0cad2a5d5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.344255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.344911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.345188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.345460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.420568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 844/1659] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:11.422032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.436993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.437188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc07eda-8bdd-428c-b902-ead4f909bf51 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.438946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.443559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.444246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.444526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.444798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.455985 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 816/1660] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:11.522386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.524043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.537082 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 845/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:11.635785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.648574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c41dfc-7286-4960-bb3d-464c0f526156 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.655301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.655965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.656242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.656695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.733413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.735290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.743163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.752456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 817/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:11.757573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d333-ac07-4c26-a465-cb4edd2bfcba service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.765187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.765912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.766717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.767002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.854713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.856488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.869857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 846/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:11.916097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.928539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c609d-2391-44d2-a4cb-f558d64beb53 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.932948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:11.936118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.937011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.937389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.937789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.946121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d53cf9-b92c-429b-a785-f2d3eacdb1ca service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:11.956037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:11.956708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:11.957312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:11.957422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:11.967911 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:11.968071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:11.970367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:11.976730 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:11.984946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 847/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:08:12.021491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.023152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.034335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 818/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:12.062119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.101555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.127007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb3fd2-29af-4723-9b30-d462fbd64826 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.141649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.142359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.142646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.142938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.186883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a4080-23d4-4089-b7e0-427b4f607cd2 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.196352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.197196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.197484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.197798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] PATH_INFO: `/v3/users/edb236adac344c1e8dc1701f972c4ad4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.199099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb236adac344c1e8dc1701f972c4ad4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.200239 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:12.200239 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:08:12.200239 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:08:12.201461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.268673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.270731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.294646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 819/1666] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:12.296054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.313478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61148b9a-d8a9-4b18-b5d0-e653788d8608 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.324857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.326163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.327213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.327213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] PATH_INFO: `/v3/users/9af54f5c62c5453faec895bd139d4e1b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.328525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af54f5c62c5453faec895bd139d4e1b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.330756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.353536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb236adac344c1e8dc1701f972c4ad4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.354264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb236adac344c1e8dc1701f972c4ad4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.368026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb236adac344c1e8dc1701f972c4ad4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.388767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb236adac344c1e8dc1701f972c4ad4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.427553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb236adac344c1e8dc1701f972c4ad4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.454308 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 848/1667] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:12 2022] DELETE /identity/v3/users/edb236adac344c1e8dc1701f972c4ad4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:12.462380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.468161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:12.477265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af54f5c62c5453faec895bd139d4e1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.499863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af54f5c62c5453faec895bd139d4e1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.514725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af54f5c62c5453faec895bd139d4e1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.544819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af54f5c62c5453faec895bd139d4e1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.550578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7032da0-b46c-4120-b79f-8365701fb378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af54f5c62c5453faec895bd139d4e1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:12.567000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 820/1668] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:12 2022] DELETE /identity/v3/users/9af54f5c62c5453faec895bd139d4e1b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:12.569748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb773-4818-436b-8a82-235c3ee2949f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.570129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb773-4818-436b-8a82-235c3ee2949f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.570486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb773-4818-436b-8a82-235c3ee2949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.592420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9cddb773-4818-436b-8a82-235c3ee2949f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:12.593811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9cddb773-4818-436b-8a82-235c3ee2949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:12.657201 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:12.720180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 821/1669] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:12.720180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.720180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.720180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.736622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2304c03-b3d6-4c8f-b162-925784a87277 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.745179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:12.753647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:12.767273 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:12.776846 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 822/1670] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:12.778430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.784579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:12.852719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.853635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.854100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.854520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.857281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:12.911520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5046dc-ab84-438f-b7a4-974238d3ea96 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.916019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.916884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.917424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.917424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.928509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.929626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.939201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.941702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 823/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:12.942427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d572c-03aa-46d5-95c2-96fce1635d5d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.942681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:12.952702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a153343-1c3f-43e6-9fb5-1846a35296a6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:12.955291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 849/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:12.956628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:12.956873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27241-a245-453c-aa84-25fcef17a59b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.957133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.957474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.957591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27241-a245-453c-aa84-25fcef17a59b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.957782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.958095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27241-a245-453c-aa84-25fcef17a59b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.960249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 850/1673] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:12.970583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbcd5-6f7d-4a34-938b-b14cbc5d6003 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:12.970969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbcd5-6f7d-4a34-938b-b14cbc5d6003 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:12.971365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbcd5-6f7d-4a34-938b-b14cbc5d6003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:12.971824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:12.973423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6195-45aa-4245-9a5f-4906e660b3c1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:12.984660 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 824/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:13.015567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2b3cbcd5-6f7d-4a34-938b-b14cbc5d6003 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:13.016900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b3cbcd5-6f7d-4a34-938b-b14cbc5d6003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:13.195728 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 851/1675] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:13.225563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be11cf-cd6a-49bd-9b08-c6c7daf2e1df None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:13.226176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be11cf-cd6a-49bd-9b08-c6c7daf2e1df None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:13.226458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be11cf-cd6a-49bd-9b08-c6c7daf2e1df None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:13.228191 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 825/1676] 10.222.0.27 () {54 vars in 961 bytes} [Sun Jul 24 01:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:08:13.235032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:13.235943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:13.236430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:13.276151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:13.277495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:13.291656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 852/1677] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Jul 24 01:08:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:13.307462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be11cf-cd6a-49bd-9b08-c6c7daf2e1df None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:13.333311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be11cf-cd6a-49bd-9b08-c6c7daf2e1df None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:13.344510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:13.345381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:13.346537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:13.346537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:13.358461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:13.360597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:13.374332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 826/1678] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:13.707286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:13.709453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:13.734589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d732874-8cb0-427e-935a-a06cafda4d39 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:13.754081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:13.755125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:13.755526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:13.755909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] PATH_INFO: `/v3/projects/7e0b26f8e49543df86e6bde6f426d56a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:13.758506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0b26f8e49543df86e6bde6f426d56a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:13.765244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:13.798407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:13.799999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:13.842893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bac47-220d-4097-89e9-7c3b3b3471d8 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:13.853406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:13.855241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:13.855752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:13.856238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] PATH_INFO: `/v3/users/00d0e7c10b7d4268af4d0947569f1fce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:13.859237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d0e7c10b7d4268af4d0947569f1fce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:13.865051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:13.884152 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:13.912159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0b26f8e49543df86e6bde6f426d56a', 'request_id': 'req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.930343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0b26f8e49543df86e6bde6f426d56a', 'request_id': 'req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.947245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0b26f8e49543df86e6bde6f426d56a', 'request_id': 'req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.972541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] The token cache is being invalidate because project 7e0b26f8e49543df86e6bde6f426d56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:13.973166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.975152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d0e7c10b7d4268af4d0947569f1fce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.976267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:13.979030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 853/1679] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:13 2022] DELETE /identity/v3/projects/7e0b26f8e49543df86e6bde6f426d56a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:13.981761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:13.986056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:13.995164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d0e7c10b7d4268af4d0947569f1fce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.012972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d0e7c10b7d4268af4d0947569f1fce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.042837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d0e7c10b7d4268af4d0947569f1fce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.056347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d0e7c10b7d4268af4d0947569f1fce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.074434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 827/1680] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:13 2022] DELETE /identity/v3/users/00d0e7c10b7d4268af4d0947569f1fce => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:14.077602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:14.079256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.110688 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:14.127976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94ca4-6b8b-44d2-88ac-cd0e42188acd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:14.229754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb9e0c-c752-481d-aabf-9e0e71dec9ad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:14.243261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:14.244180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.244460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.244733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] PATH_INFO: `/v3/users/533fae7f526843648fc33633404cefd8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.246540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533fae7f526843648fc33633404cefd8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:14.251296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:14.257078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:14.257982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.258354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.258637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] PATH_INFO: `/v3/projects/20c292602e544b3ba75931d5c9aeb661` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.262275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c292602e544b3ba75931d5c9aeb661)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:14.268836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:14.356973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533fae7f526843648fc33633404cefd8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.378846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533fae7f526843648fc33633404cefd8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.390413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c292602e544b3ba75931d5c9aeb661', 'request_id': 'req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.402681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533fae7f526843648fc33633404cefd8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.406855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c292602e544b3ba75931d5c9aeb661', 'request_id': 'req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.417182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c292602e544b3ba75931d5c9aeb661', 'request_id': 'req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.441307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533fae7f526843648fc33633404cefd8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.442500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533fae7f526843648fc33633404cefd8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.452628 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 828/1681] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:14 2022] DELETE /identity/v3/users/533fae7f526843648fc33633404cefd8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:14.453198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] The token cache is being invalidate because project 20c292602e544b3ba75931d5c9aeb661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:14.453440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:14.454660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.456379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.458960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 854/1682] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:13 2022] DELETE /identity/v3/projects/20c292602e544b3ba75931d5c9aeb661 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:14.460099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:14.462976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.467163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.473234 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:14.582275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c011dd-9f49-4b33-866e-e6dcf6be3f79 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:14.603862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd275c91-b9ea-472d-881a-73fb5e79f5d3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:14.612620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:14.613537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.614371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.614667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] PATH_INFO: `/v3/users/1c501322707445c8b6e8bd170e7cead5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.617534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c501322707445c8b6e8bd170e7cead5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:14.621028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:14.663939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:14.666431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.666903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.667333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] PATH_INFO: `/v3/users/3186377eca704aba9fbaaaf8cd4c2b91` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.668754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3186377eca704aba9fbaaaf8cd4c2b91)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:14.677282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:14.691582 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:14.712299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c501322707445c8b6e8bd170e7cead5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.732619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c501322707445c8b6e8bd170e7cead5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.745767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c501322707445c8b6e8bd170e7cead5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.776235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c501322707445c8b6e8bd170e7cead5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.777024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1500454f-6f3c-4242-87a5-ee582bff2044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c501322707445c8b6e8bd170e7cead5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.783314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3186377eca704aba9fbaaaf8cd4c2b91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.784353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3186377eca704aba9fbaaaf8cd4c2b91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.791605 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 829/1683] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:14 2022] DELETE /identity/v3/users/1c501322707445c8b6e8bd170e7cead5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:14.793660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.794128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.794769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.799836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3186377eca704aba9fbaaaf8cd4c2b91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.813237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3186377eca704aba9fbaaaf8cd4c2b91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.817807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:14.819026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.829451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e495a53-b160-4c2c-9491-050772ea64be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3186377eca704aba9fbaaaf8cd4c2b91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:14.848670 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 855/1684] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:14 2022] DELETE /identity/v3/users/3186377eca704aba9fbaaaf8cd4c2b91 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:14.853175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ff49-6543-4251-b9c9-17d13568a331 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.853473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ff49-6543-4251-b9c9-17d13568a331 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.853771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ff49-6543-4251-b9c9-17d13568a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.889866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1b4ff49-6543-4251-b9c9-17d13568a331 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:14.892143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1b4ff49-6543-4251-b9c9-17d13568a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.895600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 830/1685] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:14.896951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:14.900012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:14.918529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794a17-f67a-478a-9eb2-bb893b64cf53 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:14.940545 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:14.994867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:14.996168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:14.996515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:14.996905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] PATH_INFO: `/v3/users/a006a21ec5be4ff283502a39b6cf26b2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:14.999116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a006a21ec5be4ff283502a39b6cf26b2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.001830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.021885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 856/1686] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:15.023033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.023314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.023652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.079466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a006a21ec5be4ff283502a39b6cf26b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:15.083210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] MFA Rules not processed for user `1416426260704ceca5211082c2399bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:15.085249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.097884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a006a21ec5be4ff283502a39b6cf26b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:15.100129 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:15.119461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a006a21ec5be4ff283502a39b6cf26b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:15.165179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a006a21ec5be4ff283502a39b6cf26b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:15.168764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-71c0d3ae-bd5c-46c5-b405-46000c07e70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a006a21ec5be4ff283502a39b6cf26b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:15.196257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 831/1687] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:14 2022] DELETE /identity/v3/users/a006a21ec5be4ff283502a39b6cf26b2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:15.202244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.203843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.204745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.250237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:15.256321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.318771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 857/1688] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:15.326041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.328344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.421589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423ed3-ad64-4d7d-a0ab-d01ca6027da5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.427974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 832/1689] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:15.429017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.546973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdeec4-b3c5-48be-9cb5-c45203172192 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.554474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.555160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.555462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.556052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.558728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.561656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.562760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.563118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.563469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.566301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.576248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.577781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.598612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.598612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.601132 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 833/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:15.602282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.604172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.610012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 858/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:15.613074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.625320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267e78a-61f2-4326-8b85-9ced78cff446 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.629766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.630723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.632424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.632725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.647097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.648914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4ef9-9092-44cf-b1ac-3161585b9c97 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.662461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 859/1692] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:15.664176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.664538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.665123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.697396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] MFA Rules not processed for user `b3861659794d4aa699ca3e984999a1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:15.700034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.709485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d9c10-7cb9-49c1-a602-6dea2e92b5fd service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.718117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.718671 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:15.718859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.719148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.719859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.721425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.740548 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:15.838988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.843716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.869294 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 860/1693] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:15.870213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.872269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 834/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:15.874938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:15.875177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.879119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:15.924230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17254c76-5eba-486f-ada3-29fb99467f67 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.924547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f98e0-4599-4706-8de2-a1f8422833aa None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:15.935094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.937770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:15.937928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.938233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.938740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.938988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:15.939275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:15.939556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] PATH_INFO: `/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:15.939990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.942548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6a822a6ccb46cbbca449bcd02ee25f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:15.943489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dc2a3-632c-4938-a187-10792abf9322 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:15.946911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.010916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 835/1695] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:15 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:16.015276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd5b0-ff78-4a7c-ba07-4db654fa314e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.015943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd5b0-ff78-4a7c-ba07-4db654fa314e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.016436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd5b0-ff78-4a7c-ba07-4db654fa314e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.026318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 836/1696] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:16.027577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd5b0-ff78-4a7c-ba07-4db654fa314e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.071054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6a822a6ccb46cbbca449bcd02ee25f', 'request_id': 'req-66a59f64-6179-42d3-bf1c-b21b7b223536'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.085273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6a822a6ccb46cbbca449bcd02ee25f', 'request_id': 'req-66a59f64-6179-42d3-bf1c-b21b7b223536'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.109262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6a822a6ccb46cbbca449bcd02ee25f', 'request_id': 'req-66a59f64-6179-42d3-bf1c-b21b7b223536'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.156274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd5b0-ff78-4a7c-ba07-4db654fa314e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.172764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] The token cache is being invalidate because project ba6a822a6ccb46cbbca449bcd02ee25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:16.173231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.174440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66a59f64-6179-42d3-bf1c-b21b7b223536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.176835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 861/1697] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:15 2022] DELETE /identity/v3/projects/ba6a822a6ccb46cbbca449bcd02ee25f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:16.178520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649d36-91fd-46ea-ba5e-da888f9b2b3a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.178951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649d36-91fd-46ea-ba5e-da888f9b2b3a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.179362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649d36-91fd-46ea-ba5e-da888f9b2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.211969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-82649d36-91fd-46ea-ba5e-da888f9b2b3a None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:16.213475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-82649d36-91fd-46ea-ba5e-da888f9b2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.281815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.282534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.282818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.283091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.283834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.288864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.332460 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 837/1698] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:16 2022] POST /identity/v3/users => generated 308 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:16.334604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.340206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.361853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 862/1699] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:16.363945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.364713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.365088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.376799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cb92-4d86-465a-b73b-e34098d64490 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.390760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.392045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.392434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.392844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] PATH_INFO: `/v3/projects/6c13d71cdd93487d966180099f431a87` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.393353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:16.394860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c13d71cdd93487d966180099f431a87)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.396065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.400413 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:08:16.400413 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:08:16.400413 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:08:16.401835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.416335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 863/1700] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:16.417788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.419954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.434200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723afac-0cb3-41cd-a859-6fac8e076c6e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.447454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.448420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.451411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.451732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.452676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.454378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.456549 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:16.478812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 864/1701] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:16.478812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.478812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.496564 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:16.511923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c13d71cdd93487d966180099f431a87', 'request_id': 'req-86a84c57-a8f2-46d8-9850-5737246eeaca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.532395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c13d71cdd93487d966180099f431a87', 'request_id': 'req-86a84c57-a8f2-46d8-9850-5737246eeaca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.545506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c13d71cdd93487d966180099f431a87', 'request_id': 'req-86a84c57-a8f2-46d8-9850-5737246eeaca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.574408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] The token cache is being invalidate because project 6c13d71cdd93487d966180099f431a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:16.575733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.578189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-86a84c57-a8f2-46d8-9850-5737246eeaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.582667 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 838/1702] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:16 2022] DELETE /identity/v3/projects/6c13d71cdd93487d966180099f431a87 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:16.588509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.589032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.597038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.630628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:16.632024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.661142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa0803-23e2-40c9-b57e-f93e2b821fd8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.725589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 839/1703] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:16.727136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.728953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.730552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.731423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.731823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.732179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.735961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.750171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967faa-465e-4a61-8522-97c1ab2ea162 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.755755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.758480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.758863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.759215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] PATH_INFO: `/v3/projects/ea590968957f4c1d82b8cd387c54b303` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.760786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea590968957f4c1d82b8cd387c54b303)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.763767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.827955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea590968957f4c1d82b8cd387c54b303', 'request_id': 'req-f19956d0-5de7-48a8-a6af-c69f4c51fc96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.835412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea590968957f4c1d82b8cd387c54b303', 'request_id': 'req-f19956d0-5de7-48a8-a6af-c69f4c51fc96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.840359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.843081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:16.844299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea590968957f4c1d82b8cd387c54b303', 'request_id': 'req-f19956d0-5de7-48a8-a6af-c69f4c51fc96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.857915 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 865/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:16.859690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.860628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] The token cache is being invalidate because project ea590968957f4c1d82b8cd387c54b303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:16.861026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.861918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:16.862149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.866738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 840/1705] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:16 2022] DELETE /identity/v3/projects/ea590968957f4c1d82b8cd387c54b303 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:16.868023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:16.871445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:16.883647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4229-e599-4975-9059-4ae587a9257c service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.917687 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:16.962040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19956d0-5de7-48a8-a6af-c69f4c51fc96 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:16.970141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:16.972629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:16.973817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:16.974110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] PATH_INFO: `/v3/projects/24fe7f092bc74aeb8d8d7c1990d97e91` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:16.977363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fe7f092bc74aeb8d8d7c1990d97e91)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:16.979548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.014232 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:17.050046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.051097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.051450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.051797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] PATH_INFO: `/v3/projects/ef2087ba847e42c190b9cbad06b0a939/users/d5e1b4111c6348f1ae6fdbe313f04da4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.054573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fe7f092bc74aeb8d8d7c1990d97e91', 'request_id': 'req-260b5bd4-4cd3-4376-96bf-b119e857cd5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.069777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fe7f092bc74aeb8d8d7c1990d97e91', 'request_id': 'req-260b5bd4-4cd3-4376-96bf-b119e857cd5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.072745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2087ba847e42c190b9cbad06b0a939, user_id=d5e1b4111c6348f1ae6fdbe313f04da4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.076660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9186-47a7-4c24-8af8-0fc58107ef93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.082158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fe7f092bc74aeb8d8d7c1990d97e91', 'request_id': 'req-260b5bd4-4cd3-4376-96bf-b119e857cd5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.098867 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 866/1706] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:16 2022] PUT /identity/v3/projects/ef2087ba847e42c190b9cbad06b0a939/users/d5e1b4111c6348f1ae6fdbe313f04da4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:17.103272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.103788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.104214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.111513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] The token cache is being invalidate because project 24fe7f092bc74aeb8d8d7c1990d97e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:17.111930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.112847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.118729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 841/1707] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:16 2022] DELETE /identity/v3/projects/24fe7f092bc74aeb8d8d7c1990d97e91 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:17.120158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.122249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.130870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:17.132415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.210424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5bd4-4cd3-4376-96bf-b119e857cd5f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.212492 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 867/1708] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:17.214294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.217932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.220947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.221851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.222127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.222411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] PATH_INFO: `/v3/projects/0bb96ad5350f4ba08c824c9535a4374d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.223692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb96ad5350f4ba08c824c9535a4374d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.225642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.233339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aa264-a37b-44d3-a900-a1c59c22e5e8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.238681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.239453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.239807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.240156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.240982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:17.241377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.243120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.270649 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 868/1709] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:17.270649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.270649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.284501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fe5ff-52c1-485f-8c50-a59974f1f103 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.300240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb96ad5350f4ba08c824c9535a4374d', 'request_id': 'req-1e2a50fd-073e-4817-a9d1-bcb722016fe0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.308138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb96ad5350f4ba08c824c9535a4374d', 'request_id': 'req-1e2a50fd-073e-4817-a9d1-bcb722016fe0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.315768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb96ad5350f4ba08c824c9535a4374d', 'request_id': 'req-1e2a50fd-073e-4817-a9d1-bcb722016fe0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.319102 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:17.337383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] The token cache is being invalidate because project 0bb96ad5350f4ba08c824c9535a4374d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:17.337383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.337383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.338948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 842/1710] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:17 2022] DELETE /identity/v3/projects/0bb96ad5350f4ba08c824c9535a4374d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:17.339914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.341592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.376890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.378310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.378770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.379219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] PATH_INFO: `/v3/users/5bbfa80e74984402a0e9381be921b4a6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.381209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbfa80e74984402a0e9381be921b4a6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.384738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.438627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a50fd-073e-4817-a9d1-bcb722016fe0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.445979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.446822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.447112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.447390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.448146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.451745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbfa80e74984402a0e9381be921b4a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.452449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbfa80e74984402a0e9381be921b4a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.452834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.463609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbfa80e74984402a0e9381be921b4a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.469474 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:17.476209 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 843/1711] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:17.477808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.480144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbfa80e74984402a0e9381be921b4a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.480821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.507110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a6401fc0-bd71-4c4c-9d8c-64af268b7eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbfa80e74984402a0e9381be921b4a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.508459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8c7ea-fcab-4a99-9556-61060c0c6e55 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.514406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.516158 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 869/1712] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:17 2022] DELETE /identity/v3/users/5bbfa80e74984402a0e9381be921b4a6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:17.516409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.516881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.517365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] PATH_INFO: `/v3/users/b9ba87bab49345f9a34545b224e53627` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.517855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.518213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.518563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.520399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ba87bab49345f9a34545b224e53627)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.522805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.561498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:17.563618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.629714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ba87bab49345f9a34545b224e53627'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.648228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ba87bab49345f9a34545b224e53627'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.663773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ba87bab49345f9a34545b224e53627'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.689764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ba87bab49345f9a34545b224e53627'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.690649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ba87bab49345f9a34545b224e53627'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.698055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 844/1713] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:17 2022] DELETE /identity/v3/users/b9ba87bab49345f9a34545b224e53627 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:17.698923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.701020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.706417 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 870/1714] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:17.707444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.709711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.726393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046d979-6093-410a-b4a0-b814ad0c6379 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.806447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.812000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.812000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.812000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] PATH_INFO: `/v3/users/58b33e12de404074a649ce44afe05e30` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.812996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b33e12de404074a649ce44afe05e30)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.818813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.889805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534887cb-97b8-4e18-b7f4-fda16287a06e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:17.895534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:17.896303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:17.896746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:17.897091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:17.897906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:17.900221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:17.906089 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:17.924121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b33e12de404074a649ce44afe05e30'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.926420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b33e12de404074a649ce44afe05e30'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.942951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b33e12de404074a649ce44afe05e30'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.955129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b33e12de404074a649ce44afe05e30'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:17.959526 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 845/1715] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:17 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:17.960754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:17.965983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:17.990061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:17.993165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-93649732-fcb3-4576-87ea-da3b23fea481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b33e12de404074a649ce44afe05e30'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.005395 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 871/1716] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:17 2022] DELETE /identity/v3/users/58b33e12de404074a649ce44afe05e30 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:18.007063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.007361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.007642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.009235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 872/1717] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:18.010015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.013123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.116471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e038-023b-4e92-973c-d863faae522e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.150679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be5efa-1d8d-41af-ac20-a016ae3fdda0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.166946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.168098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.168388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.168685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.172343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.188893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.190783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.207164 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 873/1718] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:18.208631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.210118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.335589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.337516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.338169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.338650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] PATH_INFO: `/v3/projects/ef2087ba847e42c190b9cbad06b0a939/users/d5e1b4111c6348f1ae6fdbe313f04da4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.345396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2087ba847e42c190b9cbad06b0a939, user_id=d5e1b4111c6348f1ae6fdbe313f04da4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.348589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.369109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863f8b-fac7-4bd1-8fe7-9f3ab9db2e99 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.377725 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 846/1719] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:17 2022] PUT /identity/v3/projects/ef2087ba847e42c190b9cbad06b0a939/users/d5e1b4111c6348f1ae6fdbe313f04da4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:18.378730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.383780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.532010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.534246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.534446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324f93c-3d76-45cb-b728-030f7ab97ee1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.534954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.536718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.539535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:18.540189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.544133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.544792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054abec-d19f-4b37-bf7d-6018915bf3f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.545529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.547300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.548036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.549520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.553738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.584405 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 874/1720] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:18.586165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.586457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.587132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.617508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 847/1721] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:18 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:18.618691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.627279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.638546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:18.640331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.664023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522ea22-e591-41d0-8918-d86f393add38 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.678399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.679307 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:18.681537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.682425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.682950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] PATH_INFO: `/v3/projects/0b389c524b5c44d4b51752037fd3440c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.686533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b389c524b5c44d4b51752037fd3440c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.690374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.722999 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:18.785001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 875/1722] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:18.786003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.787675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.815027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed92cc-d032-4cd3-979f-e8f554e0ece3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:18.821488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:18.823153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:18.823618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:18.824159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] PATH_INFO: `/v3/projects/d00d5448f99d408b971c39511ef29def` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:18.827994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00d5448f99d408b971c39511ef29def)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:18.831449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:18.896578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b389c524b5c44d4b51752037fd3440c', 'request_id': 'req-6598f7c2-6060-4892-a4bb-9037647c5f61'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.909056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b389c524b5c44d4b51752037fd3440c', 'request_id': 'req-6598f7c2-6060-4892-a4bb-9037647c5f61'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.914956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00d5448f99d408b971c39511ef29def', 'request_id': 'req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.916782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b389c524b5c44d4b51752037fd3440c', 'request_id': 'req-6598f7c2-6060-4892-a4bb-9037647c5f61'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.928034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00d5448f99d408b971c39511ef29def', 'request_id': 'req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.941098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] The token cache is being invalidate because project 0b389c524b5c44d4b51752037fd3440c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:18.941540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.942586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.949590 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 848/1723] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:18 2022] DELETE /identity/v3/projects/0b389c524b5c44d4b51752037fd3440c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:18.949590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:18.953657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:18.957551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00d5448f99d408b971c39511ef29def', 'request_id': 'req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.987447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] The token cache is being invalidate because project d00d5448f99d408b971c39511ef29def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:18.987794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.990336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:18.997843 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 876/1724] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:18 2022] DELETE /identity/v3/projects/d00d5448f99d408b971c39511ef29def => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:18.998312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.012253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.154775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed87b4-22d9-40fc-951d-2d38e69bcd9f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.160673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.161627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.161955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.162228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.162968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.164731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.179586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f7c2-6060-4892-a4bb-9037647c5f61 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.193430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 877/1725] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:19.194392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.195219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.195501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.195769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.196626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.199006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.199920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.201286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.249625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f242beb-9cae-4368-8bec-e425682ef8cb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.253922 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 849/1726] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:18 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:19.254437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.260480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.313614 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:19.367108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c387-d852-4095-88a5-578eca1ee003 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.370194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.371069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.373137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.373437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] PATH_INFO: `/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.375139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33915122dc4c62b3f4ad04bf7f9f9a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.381315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.384216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.385099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.385386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.385660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.389149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.483209 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:19.508931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33915122dc4c62b3f4ad04bf7f9f9a', 'request_id': 'req-83dfc140-ce83-4626-aa78-1008de832fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:19.523328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33915122dc4c62b3f4ad04bf7f9f9a', 'request_id': 'req-83dfc140-ce83-4626-aa78-1008de832fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:19.545028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33915122dc4c62b3f4ad04bf7f9f9a', 'request_id': 'req-83dfc140-ce83-4626-aa78-1008de832fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:19.566873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] The token cache is being invalidate because project 3f33915122dc4c62b3f4ad04bf7f9f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:19.567703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:19.568804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-83dfc140-ce83-4626-aa78-1008de832fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:19.571276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 878/1727] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:19 2022] DELETE /identity/v3/projects/3f33915122dc4c62b3f4ad04bf7f9f9a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:19.572834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.573187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.573562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.590140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.595850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276686-d441-4332-9576-6cc4b89cd067 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.610006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:19.614739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.622082 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 850/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:19.626310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.627899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.628324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.667111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:19.668513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.751640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 879/1729] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:19.753153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.758836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.780700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 851/1730] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:19.781909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.785135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be0d6-7c3e-455f-b195-2230a56a8f12 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.788746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.795628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.796366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.802333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.802906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.804158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.805409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9515ce-857b-4e89-8067-e871a8043071 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.808756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f476e65-53e6-4fa2-9a24-608a349e4b71 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.811467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.812680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.813101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.813507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.814393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.816560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4364e-092a-410a-a5cb-445d5682e273 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.828577 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 880/1731] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:19.830301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.830970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.830970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.842812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 852/1732] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:19.844915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50894-b3f3-4318-b2ca-653293d788ad None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.845875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50894-b3f3-4318-b2ca-653293d788ad None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.846408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50894-b3f3-4318-b2ca-653293d788ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.867746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:19.869156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.875190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9fb50894-b3f3-4318-b2ca-653293d788ad None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:19.876824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fb50894-b3f3-4318-b2ca-653293d788ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.889907 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 853/1733] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:19.891615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.892069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.892504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.906043 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 881/1734] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:19.906043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.918310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94beae-83fa-45f3-9931-fccad5eebb57 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:19.924874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:19.925856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:19.926144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:19.926426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] PATH_INFO: `/v3/projects/90cf85a867284439b836757fcb5c67eb/users/6ac6fb9d9e844e489413518629075c19/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:19.936760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:19.942391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:19.946440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cf85a867284439b836757fcb5c67eb, user_id=6ac6fb9d9e844e489413518629075c19, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:19.949409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:19.967945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 854/1735] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:19.968174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.972722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 882/1736] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:19 2022] PUT /identity/v3/projects/90cf85a867284439b836757fcb5c67eb/users/6ac6fb9d9e844e489413518629075c19/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:19.973582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:19.994460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0e166-ff37-40de-96e7-0e417af98c2b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.046635 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:20.103214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b16f-108c-4526-8bb9-2400e82b74d2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.109690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.110667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.111056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.111663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.112695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:20.113126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.118127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40b86-01f6-4bfc-99ae-ed82aa6c3dad admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.118310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.124306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.124306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.124306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.125028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.129924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.133966 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 883/1737] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:20.133966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701b56-8a4c-4ccf-8bd8-7a63e0ca2535 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.133966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701b56-8a4c-4ccf-8bd8-7a63e0ca2535 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.133966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701b56-8a4c-4ccf-8bd8-7a63e0ca2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.155188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-17701b56-8a4c-4ccf-8bd8-7a63e0ca2535 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:20.155840 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 855/1738] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:20.157021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17701b56-8a4c-4ccf-8bd8-7a63e0ca2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:20.161012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.170266 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 884/1739] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:20.170266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.170266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.170266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.191613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8564-3518-449c-82cb-a1d6b562b48b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.202325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.203181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.204835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.205226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.206504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:20.207909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.222216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.239936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] MFA Rules not processed for user `6ac6fb9d9e844e489413518629075c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:20.241479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:20.268975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 856/1740] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:20.270042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.296122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3dfb4-2810-4a31-91df-ee2dd2c614d5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.309763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.310637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.311023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.311401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.312398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.317317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.355057 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:20.374341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 857/1741] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:20.375417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.482334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 885/1742] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:20.483985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.509291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0265607-37f6-45b5-9101-de3aae2fad39 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.525382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.526202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.526538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.526866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.527739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.530197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.535733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637113-81ce-4e70-858b-3901a34f43c1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.547430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 858/1743] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:20.547430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.557174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd41a7-1ac0-4846-8572-48902589e955 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.559105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.561036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.561723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.562337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.563959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.564071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:20.564218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.564319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.564542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.564834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.565608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.567393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.567638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.594593 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 886/1744] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:20.595579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.608109 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 859/1745] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/projects => generated 411 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:20.612833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.623385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2c2a7-ae35-46f3-b289-8217c67442b5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.711363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e3bf-891b-41c4-a62a-4f7c2759ca08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:20.717098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.718010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.718398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.718885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.719597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.721735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.742589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:20.744167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:20.752546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:20.755708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:20.759363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:20.764974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 860/1746] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:20.766463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:20.769318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.901848 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 887/1747] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:20.904331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:20.978031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00315989-5b98-45ee-a5d9-c7aa0021ab56 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.030308 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:21.037777 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:21.045714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433b0d-04f9-441c-a491-d055cf6a284a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.073939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.078496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.080727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.082275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] PATH_INFO: `/v3/projects/fdfb86a9ee0b414da764891a70ddd1d5/users/65e2ffaf77984a22b0c2252b4234792c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.149521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfb86a9ee0b414da764891a70ddd1d5, user_id=65e2ffaf77984a22b0c2252b4234792c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.155968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:21.195310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 861/1748] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:20 2022] PUT /identity/v3/projects/fdfb86a9ee0b414da764891a70ddd1d5/users/65e2ffaf77984a22b0c2252b4234792c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:21.197475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:21.204435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.205380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.207514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.210449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.211922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.217069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:21.285906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 888/1749] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:21.287457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:21.426513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7950d12-639b-4c4b-a19d-9d56241d1e8f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.588708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb190ef-cfbe-412c-b990-0530f8583c0b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.615426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.616127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.616408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.616685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.617401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.623220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:21.689838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.690537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.690819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.691097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.691879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.693791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc35817-cc08-4ff2-b51e-63d89dacf73b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:21.720458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 889/1750] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:21 2022] POST /identity/v3/users => generated 296 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:21.723150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:21.748729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 862/1751] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:21 2022] POST /identity/v3/users => generated 306 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:21.765523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4599bf-adca-49ec-a597-5ab9b78dd744 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.766920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.767219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.767503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.785426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.787022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.787959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.789607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.794625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.807162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:21.838968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] MFA Rules not processed for user `65e2ffaf77984a22b0c2252b4234792c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:21.840661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:21.885648 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 890/1752] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:21.888164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:21.953412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5678-e6bb-4089-b10d-bf302fe98394 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:21.971261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:21.973393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:21.973740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:21.974028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:21.974782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:21.982175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.035327 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 891/1753] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:21 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:22.036270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.067411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 863/1754] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:22.073996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.079212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc95de9-b7a0-47f8-a90d-4ed488cab551 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.091462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.092073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.092359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.092628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.093399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.095176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.121061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972929d6-ff09-4e32-8020-0e8acf1a2de2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.129790 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 892/1755] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.130795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.132757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.134368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.135187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.135934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.145012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.148765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.152184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f895-0a43-4b4c-9030-c886e3e58900 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.155211 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:22.167525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.168233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.168713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.169030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.169769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.171582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348de51-534c-4a5d-9f28-b80af546c34a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.201307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 893/1756] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.201307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.201540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.201996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.218324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 864/1757] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.220188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.240022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeb2cd-273c-47a9-959d-00d5e8df4448 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.261445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.263436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.264415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.266017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.268463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.271133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.351217 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 865/1758] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.368869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.370422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:22.373492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:22.410018 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:22.424440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77f91-7cd3-4b0d-8040-706a868c11e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.430723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.431986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.433896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.437075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.438834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.442446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.522447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 866/1759] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:22 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:22.524467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.605446 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 894/1760] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:22.607198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.646893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173c4ae-8944-41f3-9b37-f4f1c746adf9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.654690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b20da-44a9-4bde-b9cc-01941af47712 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.662145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.663116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.663565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.663904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] PATH_INFO: `/v3/projects/8c1034a79dbc4737b5b62577c7294381/users/eb9723a970c341ceb05aeaae2c684692/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.670215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.671133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.671415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.671689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] PATH_INFO: `/v3/projects/58e5e52270c14573b0d4c868cb9fa69c/users/40b5fc3b4b6d43ab9342da568567140d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.720397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1034a79dbc4737b5b62577c7294381, user_id=eb9723a970c341ceb05aeaae2c684692, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.723591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.752153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e5e52270c14573b0d4c868cb9fa69c, user_id=40b5fc3b4b6d43ab9342da568567140d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.754145 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 867/1761] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:22 2022] PUT /identity/v3/projects/8c1034a79dbc4737b5b62577c7294381/users/eb9723a970c341ceb05aeaae2c684692/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:22.755214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.764605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.796271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 895/1762] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:22 2022] PUT /identity/v3/projects/58e5e52270c14573b0d4c868cb9fa69c/users/40b5fc3b4b6d43ab9342da568567140d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:22.798728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.903513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723bcc-4784-4a8b-beb7-9b6080c50de3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.926310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65e330-b97c-49db-8f38-826c471677f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:22.937812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.939392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.942515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.943067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.943909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:22.944047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.944914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:22.949289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:22.949857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:22.950980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:22.953524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.956725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:22.970327 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 896/1763] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.971542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:22.981362 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 868/1764] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:22.985466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.001906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8651-bbfb-4328-8c14-0bda161ce932 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.007089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483bc8-1976-4428-b19f-2474a2abb1a5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.017602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.018427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.019406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.020428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.021224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.026577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.027748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.029013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.029504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.029592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.030307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.031938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7b02-9255-4c56-a23c-c5ae513ed8a9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.056398 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 869/1765] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:23.061583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.061898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.064485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.075497 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 897/1766] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:22 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:23.076788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.083039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:23.104830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:23.110701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:23.136062 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 870/1767] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:23.137255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.163994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf3364-235d-4031-b7a1-4621056e319e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.179373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.181076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.181363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.181639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] PATH_INFO: `/v3/projects/fcfeba8f31494231b0e7d9ae6f92570d/users/0b6f2ac6037e47d8bf67861ed9d4bb10/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.237719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcfeba8f31494231b0e7d9ae6f92570d, user_id=0b6f2ac6037e47d8bf67861ed9d4bb10, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.242731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.267828 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:23.280573 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 871/1768] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:23 2022] PUT /identity/v3/projects/fcfeba8f31494231b0e7d9ae6f92570d/users/0b6f2ac6037e47d8bf67861ed9d4bb10/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:23.281359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.306294 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:23.333723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846b046-9126-4128-af1d-580f76bd26dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.425525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d67c4-466e-43e8-956e-cb341c7d34ad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.442863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.443908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.444274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.444622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] PATH_INFO: `/v3/projects/c4babc53ae094b53817a8f635b66b264/users/b4e34a1a1c3841efb8535f57b22e20cf/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.458870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.460330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.460958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.461536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.484566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4babc53ae094b53817a8f635b66b264, user_id=b4e34a1a1c3841efb8535f57b22e20cf, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.487360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.518911 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 872/1769] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:23 2022] PUT /identity/v3/projects/c4babc53ae094b53817a8f635b66b264/users/b4e34a1a1c3841efb8535f57b22e20cf/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:23.526840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.604474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.613797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.641071 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 898/1770] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:08:23.644292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.662093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63df4-00c0-4e4e-892f-19f733fd188c service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.800731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282e6b4-54f7-45b7-bb7a-022a2cea394a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:23.845160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.846769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.847255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.847788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] PATH_INFO: `/v3/projects/8c1034a79dbc4737b5b62577c7294381/users/eb9723a970c341ceb05aeaae2c684692/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.873921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1034a79dbc4737b5b62577c7294381, user_id=eb9723a970c341ceb05aeaae2c684692, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.875360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:23.878203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.878469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.878763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:23.879567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:23.886212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.886666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489cca7-7973-4345-ace2-b7822e52c116 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:23.917816 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 899/1771] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:23.927825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:23.931938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:23.957375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 873/1772] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:23 2022] PUT /identity/v3/projects/8c1034a79dbc4737b5b62577c7294381/users/eb9723a970c341ceb05aeaae2c684692/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:23.969525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaeb39-146b-4cda-ac34-fd0a6b2ff631 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:23.975490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaeb39-146b-4cda-ac34-fd0a6b2ff631 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:23.976125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaeb39-146b-4cda-ac34-fd0a6b2ff631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.048177 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:24.098892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2bdaeb39-146b-4cda-ac34-fd0a6b2ff631 None None] MFA Rules not processed for user `0b6f2ac6037e47d8bf67861ed9d4bb10`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:24.100239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2bdaeb39-146b-4cda-ac34-fd0a6b2ff631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:24.123479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2592-9798-47dd-b6e3-e4adb6f99354 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:24.359594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:24.360700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:24.361190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:24.362075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.382333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 874/1773] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:24.384166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:24.384578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:24.384746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.422712 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:24.474461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] MFA Rules not processed for user `b4e34a1a1c3841efb8535f57b22e20cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:24.476300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:24.748201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:24.753408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ba3b4-ed2e-467e-bc50-b60bc0cc4dc5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:24.759269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 875/1774] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:24.762731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:24.802460 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 900/1775] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 884 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:24.805920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:24.806439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:24.806946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.815027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2cf8-b166-4ead-b988-357103c58524 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:24.832912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:24.834345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:24.834773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:24.835187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] PATH_INFO: `/v3/projects/03dcf52c368643b68539bd476718a03d/users/a8ffadfa319b4452a879d7f9854e8a64/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.882480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dcf52c368643b68539bd476718a03d, user_id=a8ffadfa319b4452a879d7f9854e8a64, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:24.890174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d615c96-7fa5-49a7-bd79-bd5e8e581d5b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:24.926243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 876/1776] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:24 2022] PUT /identity/v3/projects/03dcf52c368643b68539bd476718a03d/users/a8ffadfa319b4452a879d7f9854e8a64/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:24.930646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:24.932227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] MFA Rules not processed for user `eb9723a970c341ceb05aeaae2c684692`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:24.932899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:24.933527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:24.935222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:25.051993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:25.055761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:25.100501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 901/1777] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:25.101613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:25.191418 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:25.270069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 877/1778] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jul 24 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:25.272197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:25.296851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cf80-36ff-4342-aaf8-75fa8677038d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:25.307803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:25.309070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:25.309070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:25.312318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:25.313011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:25.319042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:25.337843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e8cfc-a6db-4afd-87de-87b350605845 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:25.344476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:25.345240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:25.345532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:25.345883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:25.347580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:25.349900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:25.396945 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 902/1779] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:25 2022] POST /identity/v3/projects => generated 373 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:25.396945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:25.418315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 878/1780] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:25 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:25.418315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:25.431697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:25.617421 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:25.658996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac607c-d013-495e-be47-3bae5753af18 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:25.746032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a313f-9f2d-4288-9cc7-18bbac73bf57 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:25.767127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:25.770125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:25.770963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:25.771525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:25.832586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:25.833212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:25.833478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:25.834354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:25.835247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:25.837301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:25.859499 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 903/1781] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:25.860504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:25.876313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:25.940412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:25.944057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:25.983197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 879/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:25.985060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.007685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5af1-b7ff-464c-96af-c6bb88bda6ff service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.017483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.018853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.019466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.020234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.021647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.026616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.144808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bcda9-81e1-4465-960e-31e460302bef admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.159446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.160930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.161401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.161875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.167625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 880/1783] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:25 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:26.174939 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:26.175779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.180228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.188195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.213434 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 904/1784] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:26.217520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.252476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307637f-5e13-4b6c-8e90-cd3dbed61f22 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.256689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7763ae3-59d5-48b8-89ea-77c3b9342923 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.266792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.268149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.268427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.268768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] PATH_INFO: `/v3/projects/03dcf52c368643b68539bd476718a03d/users/a8ffadfa319b4452a879d7f9854e8a64/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.274769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dcf52c368643b68539bd476718a03d, user_id=a8ffadfa319b4452a879d7f9854e8a64, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.275054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.275546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.275840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.276168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.276838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.278232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.285518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecb3ff-8751-492a-a428-ea5d7f534e2f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.308795 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 905/1785] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:26 2022] PUT /identity/v3/projects/03dcf52c368643b68539bd476718a03d/users/a8ffadfa319b4452a879d7f9854e8a64/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:26.310578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.388049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 881/1786] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:26 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:26.389845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ccaa-ac86-4ec8-bf8d-d9ac302d828c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.390160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ccaa-ac86-4ec8-bf8d-d9ac302d828c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.391198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6ccaa-ac86-4ec8-bf8d-d9ac302d828c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.393593 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 882/1787] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:26.394801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.395165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.395651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.492246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b139081-b5d5-448e-a752-d21fd0720969 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.502380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] MFA Rules not processed for user `a8ffadfa319b4452a879d7f9854e8a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:26.503837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:26.507116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.507820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.508103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.508520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.509324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.510992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.540021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 906/1788] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:26.540984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.567989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ef0c5-a7aa-4c9e-9583-4b4d2d78c24d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.582403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.583176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.583620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.583901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:26.584657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:26.586632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:26.617486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 907/1789] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:26.623297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:08:26.634694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:26.900867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 883/1790] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:26.905048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.943421 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 24 01:08:26.946652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:26.948071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecded-42c4-4ccc-9d29-8340b93d6ce6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:26.969824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:26.971096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:26.973161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:26.973657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] PATH_INFO: `/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27/users/d8d1644b6b8840f5a1e442aa01504cd1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.017443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4372ea6c414c96bf8f0a9854f0ba27, user_id=d8d1644b6b8840f5a1e442aa01504cd1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.021929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.068478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 884/1791] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:26 2022] PUT /identity/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27/users/d8d1644b6b8840f5a1e442aa01504cd1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:27.071054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.092370 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:27.170029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4402-b790-4f2c-85d8-7608f68fd647 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.191976 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:27.345052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb30dd-80e8-4211-b9c4-98bd6001d02d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.369889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:27.371030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.371316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.372253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] PATH_INFO: `/v3/projects/483ee3c24c6f4b11a40a522283ff6141/users/e763340456414377b4e65edfca7d0e24/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.429258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483ee3c24c6f4b11a40a522283ff6141, user_id=e763340456414377b4e65edfca7d0e24, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.439517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.440493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9723a970c341ceb05aeaae2c684692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c1034a79dbc4737b5b62577c7294381', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:27.443640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.443972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.444244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] PATH_INFO: `/v3/projects/90cf85a867284439b836757fcb5c67eb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.448710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: Authorizing `identity:get_project(project_id=90cf85a867284439b836757fcb5c67eb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.457346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.472091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 885/1793] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:27 2022] PUT /identity/v3/projects/483ee3c24c6f4b11a40a522283ff6141/users/e763340456414377b4e65edfca7d0e24/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:27.474766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.475039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 908/1793] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:08:26 2022] GET /identity/v3/projects/90cf85a867284439b836757fcb5c67eb => generated 377 bytes in 854 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:27.476412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.518759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ac4f-689e-46ad-bc28-8db957b44533 tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.679633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf93d0b-d3a5-432b-ac34-da7e92ac46e2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.696958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:27.697880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.698200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.698636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.704112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.708404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.745800 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 886/1794] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:27.746327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.763154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:27.765436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.767700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.768255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.771965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.775734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.817359 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 909/1795] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:27.818338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.839125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af601bb-38e0-4c8b-8322-0bd3f4fec13c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.854976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:27.856444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:27.856869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:27.857152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] PATH_INFO: `/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27/users/d8d1644b6b8840f5a1e442aa01504cd1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:27.867336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4372ea6c414c96bf8f0a9854f0ba27, user_id=d8d1644b6b8840f5a1e442aa01504cd1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:27.870094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:27.893141 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 910/1796] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:27 2022] PUT /identity/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27/users/d8d1644b6b8840f5a1e442aa01504cd1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:27.894099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:27.915677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1403-27b8-4e28-8587-b7b94eb5c71a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:27.957234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:28.068746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ac86-5844-41a1-b48b-e17a3b47b19a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:28.134115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:28.137554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.137878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.138161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] PATH_INFO: `/v3/projects/483ee3c24c6f4b11a40a522283ff6141/users/e763340456414377b4e65edfca7d0e24/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:28.158693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=483ee3c24c6f4b11a40a522283ff6141, user_id=e763340456414377b4e65edfca7d0e24, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:28.160921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507fdbe-991b-44fd-8ff6-b4651c73a21a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:28.187877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:28.195206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.195651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.195947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:28.229979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 911/1797] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:27 2022] PUT /identity/v3/projects/483ee3c24c6f4b11a40a522283ff6141/users/e763340456414377b4e65edfca7d0e24/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:28.242213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.242570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.242771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:28.322022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] MFA Rules not processed for user `d8d1644b6b8840f5a1e442aa01504cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:28.323773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:28.337519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:28.339539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64c32-eea6-4c92-a5d4-5544bb8be50a service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:28.378210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 887/1798] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:28.378433 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:28.384460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.393586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.394108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:28.503560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] MFA Rules not processed for user `e763340456414377b4e65edfca7d0e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:28.509133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:28.693014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 888/1799] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:28.694141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:28.721717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 912/1800] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:28.825988 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:28.916905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca741-9d81-4955-a3dc-b2041b64da1e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:28.940212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:28.942023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:28.943814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:28.945039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.184401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:29.200435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:29.238189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 889/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:29.362336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:29.397399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a14367-7a58-4432-8e08-22b64185e80c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:29.421385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:29.425504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:29.427220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:29.427554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.491508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:29.498031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edbf2d-5e8c-4ca9-84d8-f8ebcef887ff service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:29.536984 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 913/1802] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:29.600446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:29.605160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:29.605447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:29.605858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.615111 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 914/1803] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:08:29.624133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:08:29.649065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653dff5-c29c-41df-9f50-c7a23e854f1b service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:29.676306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:29.679920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:29.681535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:29.681960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.684661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:29.738686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:29.743434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:29.782231 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 890/1804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:29.902190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03237-e5ed-4089-a7b6-bf121b821488 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:29.922420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb9723a970c341ceb05aeaae2c684692', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c1034a79dbc4737b5b62577c7294381', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:29.923856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:29.924560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:29.924560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] PATH_INFO: `/v3/projects/90cf85a867284439b836757fcb5c67eb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.930609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:29.942428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: Authorizing `identity:get_project(project_id=90cf85a867284439b836757fcb5c67eb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:29.949004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3a5c2-a708-4d10-8508-35c7594fb28f tempest-FlavorsAccessTestJSON-1819818780 tempest-FlavorsAccessTestJSON-1819818780-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:29.952365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4526f-af63-458c-81e7-b17647d6e596 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:29.958972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:29.959880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:29.960345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:29.960774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:29.968629 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 915/1805] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:08:29 2022] GET /identity/v3/projects/90cf85a867284439b836757fcb5c67eb => generated 377 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:30.020356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb916bc-0e2e-4466-882c-c677f2deb2ed None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:30.020803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb916bc-0e2e-4466-882c-c677f2deb2ed None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:30.021489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb916bc-0e2e-4466-882c-c677f2deb2ed None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:30.024179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 916/1806] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:08:30.188463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:30.191350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:30.245736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 891/1807] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:08:30.369651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:30.370200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:30.370200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:30.384369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:30.456329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:30.459101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:30.490040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 917/1808] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:30.512677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:30.542459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8c0b-a1fc-4d49-99ec-634d598fa822 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:30.551089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:30.554561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:30.555820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:30.555820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] PATH_INFO: `/v3/users/65e2ffaf77984a22b0c2252b4234792c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:30.559999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e2ffaf77984a22b0c2252b4234792c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:30.562821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:30.566702 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:30.692835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e2ffaf77984a22b0c2252b4234792c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.702347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434135c4-e7b2-4c25-9053-bdbeb97d8128 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:30.723005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e2ffaf77984a22b0c2252b4234792c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.735149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:30.740771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:30.742256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:30.743064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] PATH_INFO: `/v3/users/b4e34a1a1c3841efb8535f57b22e20cf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:30.751418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e34a1a1c3841efb8535f57b22e20cf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:30.755773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e2ffaf77984a22b0c2252b4234792c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.764644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:30.797985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e2ffaf77984a22b0c2252b4234792c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.798941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b9100a2d-929d-4742-b503-aed92875430a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e2ffaf77984a22b0c2252b4234792c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.828058 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 892/1809] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:30 2022] DELETE /identity/v3/users/65e2ffaf77984a22b0c2252b4234792c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:30.829893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:30.837824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:30.838324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:30.928805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:30.935437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:30.944119 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:30.972974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e34a1a1c3841efb8535f57b22e20cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.974105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e34a1a1c3841efb8535f57b22e20cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:30.992490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e34a1a1c3841efb8535f57b22e20cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.017183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e34a1a1c3841efb8535f57b22e20cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.038568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f09f3c7a-9c03-46de-b24d-b11a94518606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e34a1a1c3841efb8535f57b22e20cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.068608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 918/1810] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:30 2022] DELETE /identity/v3/users/b4e34a1a1c3841efb8535f57b22e20cf => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:31.082137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.083396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.083868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.144381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:31.147724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.181533 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 893/1811] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:31.182919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:31.185831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.200853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561efa-ab86-4f7e-8d93-1ab2ea217cb0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:31.399289 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 919/1812] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:31.402538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:31.402934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:31.404005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.404365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.405913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] PATH_INFO: `/v3/users/6ac6fb9d9e844e489413518629075c19` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.407240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.407483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac6fb9d9e844e489413518629075c19)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:31.413124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:31.487660 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:31.546580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac6fb9d9e844e489413518629075c19'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.561647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac6fb9d9e844e489413518629075c19'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.575986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac6fb9d9e844e489413518629075c19'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.594460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c0cfb-707b-460f-9a75-1ed19e8a5e65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:31.610407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:31.611202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.611489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.612162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac6fb9d9e844e489413518629075c19'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.612566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.612900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac6fb9d9e844e489413518629075c19'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:31.620934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.629388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 894/1813] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:31 2022] DELETE /identity/v3/users/6ac6fb9d9e844e489413518629075c19 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:31.632531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:31.639261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.662223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:31.670115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:31.703238 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 920/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:31.707543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:31.710671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.742118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94092-7d9b-480f-be4e-791234a0f825 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:31.822521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ddd5-5f07-4c16-bea9-48035f29b3e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:31.847689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:31.848472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.848762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.849043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.852285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.871947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:31.875574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d035-c8ee-4018-960b-2a624f8b72c4 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:31.900363 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 895/1815] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:31.902212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.903031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.905847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.914018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:31.915277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:31.917013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:31.917454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:31.924275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.928786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:31.930297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:31.945579 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:32.112667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:32.114961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:32.133189 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 921/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:32.139780 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 896/1817] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:32.275824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:32.293746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873787-f66e-4356-85b1-10a90dadd120 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:32.307864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:32.308464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:32.308747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:32.309058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:32.335034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:32.336886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:32.370823 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 922/1818] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:33.627974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:33.630124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:33.670954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470698b-768a-4ed6-ade3-783b78e8249d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:33.686289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:33.686781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:33.689029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:33.690209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] PATH_INFO: `/v3/projects/fdfb86a9ee0b414da764891a70ddd1d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:33.697097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfb86a9ee0b414da764891a70ddd1d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:33.705024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:33.730480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:33.732982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:33.756888 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:33.803948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1620-5bb6-41af-a543-29dabf480e9f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:33.818244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:33.820730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:33.821026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:33.821309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] PATH_INFO: `/v3/projects/c4babc53ae094b53817a8f635b66b264` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:33.826725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4babc53ae094b53817a8f635b66b264)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:33.828655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:33.853934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfb86a9ee0b414da764891a70ddd1d5', 'request_id': 'req-32b76f53-17c5-4110-bfdc-5cf9ff150f70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.864634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfb86a9ee0b414da764891a70ddd1d5', 'request_id': 'req-32b76f53-17c5-4110-bfdc-5cf9ff150f70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.876341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfb86a9ee0b414da764891a70ddd1d5', 'request_id': 'req-32b76f53-17c5-4110-bfdc-5cf9ff150f70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.924921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] The token cache is being invalidate because project fdfb86a9ee0b414da764891a70ddd1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:33.925209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.926066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.932750 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 897/1819] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:33 2022] DELETE /identity/v3/projects/fdfb86a9ee0b414da764891a70ddd1d5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:33.941901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:33.947449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:33.954981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4babc53ae094b53817a8f635b66b264', 'request_id': 'req-d7a0380f-1bc5-4584-97c2-4b03250d6e55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.969038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4babc53ae094b53817a8f635b66b264', 'request_id': 'req-d7a0380f-1bc5-4584-97c2-4b03250d6e55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:33.986042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4babc53ae094b53817a8f635b66b264', 'request_id': 'req-d7a0380f-1bc5-4584-97c2-4b03250d6e55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.004968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] The token cache is being invalidate because project c4babc53ae094b53817a8f635b66b264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:34.005208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.006394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.008812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 923/1820] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:33 2022] DELETE /identity/v3/projects/c4babc53ae094b53817a8f635b66b264 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:34.012448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:34.018876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:34.182678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0380f-1bc5-4584-97c2-4b03250d6e55 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:34.185475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b76f53-17c5-4110-bfdc-5cf9ff150f70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:34.190786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:34.194516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:34.195024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:34.195471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] PATH_INFO: `/v3/users/a8ffadfa319b4452a879d7f9854e8a64` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:34.197013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ffadfa319b4452a879d7f9854e8a64)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:34.197133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:34.198202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:34.199350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:34.200502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:34.200782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] PATH_INFO: `/v3/users/e763340456414377b4e65edfca7d0e24` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:34.205866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e763340456414377b4e65edfca7d0e24)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:34.211315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:34.246124 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:34.357578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ffadfa319b4452a879d7f9854e8a64'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.359798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e763340456414377b4e65edfca7d0e24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.362054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e763340456414377b4e65edfca7d0e24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.381741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ffadfa319b4452a879d7f9854e8a64'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.384703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e763340456414377b4e65edfca7d0e24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.403415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ffadfa319b4452a879d7f9854e8a64'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.416411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e763340456414377b4e65edfca7d0e24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.435223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ffadfa319b4452a879d7f9854e8a64'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.436096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ffadfa319b4452a879d7f9854e8a64'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.454225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e763340456414377b4e65edfca7d0e24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:34.460854 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 898/1821] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:33 2022] DELETE /identity/v3/users/a8ffadfa319b4452a879d7f9854e8a64 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:34.468225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 924/1822] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:34 2022] DELETE /identity/v3/users/e763340456414377b4e65edfca7d0e24 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:34.582277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:34.584368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:34.733174 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:34.839592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0dfa-0f32-4e64-998a-ff8325bb7af8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:35.040229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:35.041380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:35.041380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:35.041579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] PATH_INFO: `/v3/projects/90cf85a867284439b836757fcb5c67eb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:35.043015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cf85a867284439b836757fcb5c67eb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:35.046188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:35.283090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cf85a867284439b836757fcb5c67eb', 'request_id': 'req-4454636d-304b-49b1-9b2f-acedcbf9e68f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.303035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cf85a867284439b836757fcb5c67eb', 'request_id': 'req-4454636d-304b-49b1-9b2f-acedcbf9e68f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.329341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cf85a867284439b836757fcb5c67eb', 'request_id': 'req-4454636d-304b-49b1-9b2f-acedcbf9e68f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.366581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] The token cache is being invalidate because project 90cf85a867284439b836757fcb5c67eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:35.367271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.373768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4454636d-304b-49b1-9b2f-acedcbf9e68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.380105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 899/1823] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:34 2022] DELETE /identity/v3/projects/90cf85a867284439b836757fcb5c67eb => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:35.381119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:35.382725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:35.417315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f86fc-15c5-4a32-8369-be66529f5196 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:35.532159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:35.532920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:35.533385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:35.572144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:35.573184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:35.573473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:35.573808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] PATH_INFO: `/v3/users/eb9723a970c341ceb05aeaae2c684692` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:35.575789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9723a970c341ceb05aeaae2c684692)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:35.578010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:35.628311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] MFA Rules not processed for user `d5e1b4111c6348f1ae6fdbe313f04da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:35.632693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:35.684031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9723a970c341ceb05aeaae2c684692'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.684804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9723a970c341ceb05aeaae2c684692'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.700929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9723a970c341ceb05aeaae2c684692'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.717490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9723a970c341ceb05aeaae2c684692'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.741118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9723a970c341ceb05aeaae2c684692'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:35.751443 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 925/1824] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:35 2022] DELETE /identity/v3/users/eb9723a970c341ceb05aeaae2c684692 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:35.795114 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:35.871817 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 900/1825] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:35.883750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:35.885284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:35.912640 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:36.065749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58039dbe-16a1-47fb-a2db-f4348c89e58c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:36.082808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:36.083503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:36.083776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:36.084054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:36.089276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:36.229528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:36.231889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:36.255259 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 926/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:36.320292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:36.323134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:36.347016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:36.348462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:36.521982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aea82-bfbb-4747-b2d0-d414d243094b service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:36.527470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:36.528385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:36.528661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:36.528936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] PATH_INFO: `/v3/projects/483ee3c24c6f4b11a40a522283ff6141` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:36.530661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=483ee3c24c6f4b11a40a522283ff6141)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:36.532744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:36.572801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14131f3-e6d1-4ca6-b6b0-fca3d1774d23 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:36.594682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:36.595707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:36.596046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:36.596528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:36.603762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483ee3c24c6f4b11a40a522283ff6141', 'request_id': 'req-9f68bc21-88bb-494a-8346-caa79670ec8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:36.606251 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:36.623808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483ee3c24c6f4b11a40a522283ff6141', 'request_id': 'req-9f68bc21-88bb-494a-8346-caa79670ec8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:36.638851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483ee3c24c6f4b11a40a522283ff6141', 'request_id': 'req-9f68bc21-88bb-494a-8346-caa79670ec8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:36.662593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] The token cache is being invalidate because project 483ee3c24c6f4b11a40a522283ff6141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:36.663388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:36.664486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f68bc21-88bb-494a-8346-caa79670ec8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:36.667605 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 927/1827] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:36 2022] DELETE /identity/v3/projects/483ee3c24c6f4b11a40a522283ff6141 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:36.674264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:36.674854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:36.675370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:36.701445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:36.703272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:36.755474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:36.757122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b81c7-f129-41c4-a948-3ea317f86991 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:36.782975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 901/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:36.872888 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 928/1829] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:36.881518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:36.882164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:36.882164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:36.944866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:36.946341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:36.972020 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 902/1830] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:36.975971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:36.998534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b00cb-af7c-48c2-8f7e-2bf90e804129 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.013707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.014598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.014891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.015816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.016172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:37.016836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:37.022582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:37.041813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.045002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.047727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 929/1831] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:37.052777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.077716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233fbd8-81b3-489b-a613-5a55f6c990ac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.080366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6ace-461a-4c93-b05f-00584985f6f7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.096394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.097078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.097211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.097406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.098257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.099377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:37.100470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.101023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.101312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] PATH_INFO: `/v3/projects/03dcf52c368643b68539bd476718a03d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.101797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:37.107776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dcf52c368643b68539bd476718a03d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:37.112937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:37.194259 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 930/1832] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:37 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:37.198756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.245532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dcf52c368643b68539bd476718a03d', 'request_id': 'req-de529ff1-713e-4217-83e7-cd90a27349bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.262221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dcf52c368643b68539bd476718a03d', 'request_id': 'req-de529ff1-713e-4217-83e7-cd90a27349bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.274645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dcf52c368643b68539bd476718a03d', 'request_id': 'req-de529ff1-713e-4217-83e7-cd90a27349bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.294342 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:37.301157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] The token cache is being invalidate because project 03dcf52c368643b68539bd476718a03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:37.307027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.308544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de529ff1-713e-4217-83e7-cd90a27349bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.314018 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 903/1833] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:37 2022] DELETE /identity/v3/projects/03dcf52c368643b68539bd476718a03d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:08:37.320191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.320191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.320471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.370714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:37.372550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.396411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f0304-f6b5-4746-919e-0e3859c37afe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.517970 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:37.533394 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 904/1834] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:37.533394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.533394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.550925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.551646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.551935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.552215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.552942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:37.554962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4293b3-1592-4217-8717-73a89c92f387 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:37.562895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882504-5ac1-4f1a-a552-3f44e12b6573 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.582211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.583132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.583412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.583690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] PATH_INFO: `/v3/projects/8c1034a79dbc4737b5b62577c7294381` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.592217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1034a79dbc4737b5b62577c7294381)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:37.592217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:37.629087 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 931/1835] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:37 2022] POST /identity/v3/users => generated 303 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:37.630590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008042-9b4a-4920-b0f9-2de06a9e823b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.630879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008042-9b4a-4920-b0f9-2de06a9e823b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.631158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008042-9b4a-4920-b0f9-2de06a9e823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.684568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b1008042-9b4a-4920-b0f9-2de06a9e823b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:37.686084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b1008042-9b4a-4920-b0f9-2de06a9e823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.718446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1034a79dbc4737b5b62577c7294381', 'request_id': 'req-23de8648-245d-46c5-bc75-f5eff23262fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.737384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1034a79dbc4737b5b62577c7294381', 'request_id': 'req-23de8648-245d-46c5-bc75-f5eff23262fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.763352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1034a79dbc4737b5b62577c7294381', 'request_id': 'req-23de8648-245d-46c5-bc75-f5eff23262fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.796100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] The token cache is being invalidate because project 8c1034a79dbc4737b5b62577c7294381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:37.804618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.805874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:37.808411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 905/1836] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:37 2022] DELETE /identity/v3/projects/8c1034a79dbc4737b5b62577c7294381 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:37.809632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.811362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.864236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 932/1837] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:37.864236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.864236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:37.864236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:37.913764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:37.925837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:37.943472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 933/1838] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:37.960907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:37.977058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a86bd1-6b77-46a4-bd90-5745c32355da None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:37.998227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:37.999290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:37.999727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.000155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.001215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:38.001656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.001951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de8648-245d-46c5-bc75-f5eff23262fe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.004064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67d0ce-ff8a-497f-ba34-8c9979b2a22b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.014182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.014891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.015176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.015451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.022924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.028215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.061501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 934/1839] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:38.064636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.065697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.066147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.072578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 906/1840] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:38.075648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.116418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44475e3-09fa-4d32-b56d-1e908141d736 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.118230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:38.119505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:38.132151 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 935/1841] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:38.140842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.141249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.143560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.143560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.143560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.143560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.145737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.160854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aba146-3fda-41b6-8556-0bd3ef1d0432 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.183261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.184506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.184790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.185121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.186794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.188477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.213015 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 936/1842] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:38.214033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.228663 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:38.254190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada92ae-d0e7-49f5-82cb-912eaa67b9e5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.260769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 907/1843] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:38 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:38.261910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.262057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.262996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.263600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.264112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.264954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:38.265269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.273108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.313719 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 937/1844] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:38.315994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.348807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda649-b6d7-43fc-b6a0-4eb5974c873c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.482686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a675d6-49cc-48ba-9594-5486627072c6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.488471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.489978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.492979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.493580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] PATH_INFO: `/v3/projects/f8ed62c1e54848f488f832ca1b222b83/users/4f5199ed3f0a4ae9a9f13c9561f888b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.515915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.517400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.517933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.518374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.520010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ed62c1e54848f488f832ca1b222b83, user_id=4f5199ed3f0a4ae9a9f13c9561f888b0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.520628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.524663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b90b5-1292-4c71-a17c-25e78e21c012 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.525056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.554515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 908/1845] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:38 2022] PUT /identity/v3/projects/f8ed62c1e54848f488f832ca1b222b83/users/4f5199ed3f0a4ae9a9f13c9561f888b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:38.555691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.594886 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 938/1846] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:38 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:38.599763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.600099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.600381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.625590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:38.627362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:38.645003 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:38.710458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb1270-b38d-4c82-a012-6e1eadffb2ae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.733161 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 939/1847] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:38.734343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.738853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.742718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.743378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.744656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.745599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.751696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.756362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40c3af-5113-4b0d-9504-9994de475d57 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:38.769484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:38.770255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:38.770597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:38.770876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:38.772980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:38.777616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:38.808253 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 940/1848] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:38.809381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:38.826536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:38.835053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 909/1849] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:38 2022] POST /identity/v3/projects => generated 391 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:38.838540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.015290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e442d-aeac-41ac-94b2-1e88d6fdbc26 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.023982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401b01-4a3b-46a4-a591-051920bece62 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.032909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.035080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.035660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.036205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.037198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.042625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.078504 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 910/1850] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:39.094410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.103312 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:39.135181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560797-12be-4679-be99-be4c07204824 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.153364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.154745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.155325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.155811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.158960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.160378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.160378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.160378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.160912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.162975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.203029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.205570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.214335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 911/1851] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:39.215887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.222703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 941/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:39.224550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.239422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f127b3-12d8-4921-b927-27f170e0556f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.241922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed530c9-3ce3-4635-807e-388130342050 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.247027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.248102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.248338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.248712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.255150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.257409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.262304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.263218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.263497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.263773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] PATH_INFO: `/v3/projects/f4159384c83647d6bd43a06453826011/users/68744c5599c04075be647c3d06ceb98b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.306370 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 942/1853] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:39.310623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.323231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4159384c83647d6bd43a06453826011, user_id=68744c5599c04075be647c3d06ceb98b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.333081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcaa42-9d08-4bd5-91ce-721cfc84230e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.333951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaafd1-8212-4ed7-a8eb-6439c4ab9a34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.348453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.349347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.349757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.350056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.351065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.352894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b114813-1bba-4913-abe3-7f60b8861af0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.384655 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 912/1854] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:39 2022] PUT /identity/v3/projects/f4159384c83647d6bd43a06453826011/users/68744c5599c04075be647c3d06ceb98b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:39.386465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.387473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.387785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.433556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 943/1855] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:08:39.438360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.439989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.441714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.457128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] MFA Rules not processed for user `40b5fc3b4b6d43ab9342da568567140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:39.458478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:39.503738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] MFA Rules not processed for user `68744c5599c04075be647c3d06ceb98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:39.505194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:39.587712 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:39.609829 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 913/1856] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:39.610764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.658694 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 944/1857] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:39.659553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.661909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:39.725704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310cb6c-c6d3-4c97-a226-b492a1b92be1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.734405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.736591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.737057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.737348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] PATH_INFO: `/v3/projects/a708e3326cf8400fb1830a4642d67987/users/9c1efe99a8be4529a4eab7c6b628bae6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.765582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a708e3326cf8400fb1830a4642d67987, user_id=9c1efe99a8be4529a4eab7c6b628bae6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.770055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.796269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ddd0-59e2-41e2-997e-4ec6e5556e7d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.796717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 914/1858] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:39 2022] PUT /identity/v3/projects/a708e3326cf8400fb1830a4642d67987/users/9c1efe99a8be4529a4eab7c6b628bae6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:39.797623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:39.870496 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:39.915456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.916732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.917497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.918080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.919237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.921264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55237f76-10a8-474a-9525-62b7c5abba3d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.942097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d366c9-5ec3-4a22-8bed-7f250837318b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:39.951891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:39.952599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.952989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.953278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:39.954312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:39.956710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:39.976458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 945/1859] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/projects => generated 369 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:39.976458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:39.976458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:39.976458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.000503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 915/1860] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:40.002847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.015163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] MFA Rules not processed for user `9c1efe99a8be4529a4eab7c6b628bae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:40.017661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:40.112907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f141b5-1725-4ef4-9090-1e3592428601 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.135003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.136234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.137378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.137916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.138899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.143018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.143175 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:40.143799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 946/1861] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:40.145481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.164098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605ed91-9fec-4be7-b6ff-f5242dc14be6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.170968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.171882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.173347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.173573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.174690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.176772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.178166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 916/1862] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:40 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:40.178769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.198468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757469-e3d5-4a6a-aca2-e7cc6f0bc299 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.206527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.211119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 947/1863] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:40 2022] POST /identity/v3/users => generated 298 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:40.212294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.223216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.223503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.223786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.225097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.228845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.238249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecbb8f-6e41-41c0-95d2-424765662219 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.249894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.250850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.250850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.251108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.254190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.256431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.282866 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 917/1864] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:40 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:40.284189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.290139 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 948/1865] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:40.291120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.312655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a82c7-9d50-4f72-864f-1dbb3d34c274 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.388189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3506-cdf9-47af-8b49-19e2ceb2947d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.395042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.395803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.396089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.396366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.397170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.399757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.418312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 918/1866] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:40.420762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.432111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e443d-8b0d-461a-b9ac-cfe9c43e55ae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.437705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.439095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.439376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.439650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] PATH_INFO: `/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31/users/725f3addf4524e98be4cccc41e75b63c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.462482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.463482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.463782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.464066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.465555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.470472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.504123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8b52c0d4d24bd0a8cdbc1c43216b31, user_id=725f3addf4524e98be4cccc41e75b63c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.508826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.514838 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 949/1867] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:40 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:40.516634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.525866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:40.528984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5548a-5e89-443e-a0c5-7fa55cadb501 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.541555 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 919/1868] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:40 2022] PUT /identity/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31/users/725f3addf4524e98be4cccc41e75b63c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:40.543309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.598858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.600068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.600068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.600313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] PATH_INFO: `/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e/users/f1a588296c794f51b7d048f38ae80e5a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.617615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b7aee65cff4ba5a25a3e03ff541c4e, user_id=f1a588296c794f51b7d048f38ae80e5a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.620380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.642228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e887-4502-4e50-b249-d6be28e0106a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.645528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 950/1869] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:40 2022] PUT /identity/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e/users/f1a588296c794f51b7d048f38ae80e5a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:40.646596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.714107 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:40.747684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcfd7c-1cd2-4d19-8b65-4928f60495a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.755870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.756737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.757026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.757963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.758740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.760686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.777644 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 951/1870] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:40.779098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.790047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.790745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.791023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.791294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.792211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.792899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab42b3c-d532-40e0-960f-b93b513195e0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.795026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.807798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.809439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.809766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.810047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.810871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.811424 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 920/1871] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:40.812106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.812522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.837450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d23b0-f7df-46fb-a561-09d80651becb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.840431 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 952/1872] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:40.841281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.848478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.849742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.850030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.851153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] PATH_INFO: `/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31/users/725f3addf4524e98be4cccc41e75b63c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.853352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8b52c0d4d24bd0a8cdbc1c43216b31, user_id=725f3addf4524e98be4cccc41e75b63c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.856667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.860961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfa52b-1332-481f-a230-998d06911f91 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:40.866568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:40.867627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:40.868014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:40.868297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] PATH_INFO: `/v3/projects/bdf06f068d29488db19813b1130e85ce/users/3e63f6cdd81a46e18f6ed1d2724d77dd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:40.872987 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 921/1873] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:40 2022] PUT /identity/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31/users/725f3addf4524e98be4cccc41e75b63c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:40.875928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.894186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf06f068d29488db19813b1130e85ce, user_id=3e63f6cdd81a46e18f6ed1d2724d77dd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:40.899355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:40.939968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 953/1874] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:40 2022] PUT /identity/v3/projects/bdf06f068d29488db19813b1130e85ce/users/3e63f6cdd81a46e18f6ed1d2724d77dd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:40.942956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:40.994009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2eda8-3fce-480f-9a85-3236ddaac661 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:41.090540 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:41.151396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:41.156672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.157352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.158861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] PATH_INFO: `/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e/users/f1a588296c794f51b7d048f38ae80e5a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.170425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b7aee65cff4ba5a25a3e03ff541c4e, user_id=f1a588296c794f51b7d048f38ae80e5a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:41.183259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257aff5-7a59-42d0-8c73-61bf25565072 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:41.223207 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 922/1875] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:40 2022] PUT /identity/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e/users/f1a588296c794f51b7d048f38ae80e5a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:41.224504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee998d-af61-4372-afe4-6fe726217bcc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:41.235322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.235876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.237152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.291395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] MFA Rules not processed for user `f1a588296c794f51b7d048f38ae80e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:41.293549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:41.372020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:41.372934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.373228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.373509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.378582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:41.380332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:41.398724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 954/1876] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:41.409714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:41.438281 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 923/1877] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:41.450821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:41.451439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7be52-96a1-4aad-b3d4-245824f63cd0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:41.452518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:41.469101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:41.471432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.472529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.473340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] PATH_INFO: `/v3/projects/bdf06f068d29488db19813b1130e85ce/users/3e63f6cdd81a46e18f6ed1d2724d77dd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.478910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf06f068d29488db19813b1130e85ce, user_id=3e63f6cdd81a46e18f6ed1d2724d77dd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:41.487975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a616da5-9cea-441d-8a82-af194de78501 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:41.511453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 955/1878] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:41 2022] PUT /identity/v3/projects/bdf06f068d29488db19813b1130e85ce/users/3e63f6cdd81a46e18f6ed1d2724d77dd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:41.514065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.514363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.515245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.583646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] MFA Rules not processed for user `3e63f6cdd81a46e18f6ed1d2724d77dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:41.585115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:41.614413 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:41.628471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb458fde-1ded-4421-b216-5e163d39e788 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:41.760875 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:41.821906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:41.822966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.824348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.825498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.835439 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 956/1879] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:41.844320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:41.847779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:41.897260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012d0c-6385-48d8-8819-2f20e9f8adc5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:41.914330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3068891-b070-415b-a348-a0657b246876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:41.915207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068891-b070-415b-a348-a0657b246876 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.915870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068891-b070-415b-a348-a0657b246876 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.916288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068891-b070-415b-a348-a0657b246876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.935513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3068891-b070-415b-a348-a0657b246876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:41.938174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3068891-b070-415b-a348-a0657b246876 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:41.950751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:41.952610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:41.962807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 957/1880] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:08:41.964254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8169-373c-4a5a-84e9-a60d5f4d594b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:41.966898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8169-373c-4a5a-84e9-a60d5f4d594b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:41.967252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8169-373c-4a5a-84e9-a60d5f4d594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:41.991318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 924/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:42.029417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ef5a8169-373c-4a5a-84e9-a60d5f4d594b None None] MFA Rules not processed for user `b3861659794d4aa699ca3e984999a1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:42.033856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef5a8169-373c-4a5a-84e9-a60d5f4d594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:42.199066 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 958/1882] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:42.222943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:42.338619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc4578-2ed9-476b-8a64-f08a0ee71ed1 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:42.345597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:42.346875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:42.347333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:42.347713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] PATH_INFO: `/v3/users/68744c5599c04075be647c3d06ceb98b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:42.349219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68744c5599c04075be647c3d06ceb98b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:42.351980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:42.433999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68744c5599c04075be647c3d06ceb98b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:42.447093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68744c5599c04075be647c3d06ceb98b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:42.479230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68744c5599c04075be647c3d06ceb98b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:42.536537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68744c5599c04075be647c3d06ceb98b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:42.537697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68744c5599c04075be647c3d06ceb98b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:42.546197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 925/1883] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:42 2022] DELETE /identity/v3/users/68744c5599c04075be647c3d06ceb98b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:42.552189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:42.552893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:42.553281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:42.582725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:42.584292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:42.749745 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 959/1884] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:42.799376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:42.801500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:42.809035 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:42.881033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c16e4-46a7-4ad9-8e38-cdecc4b0b561 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:42.885054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:42.885859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:42.886251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:42.887533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:42.899185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:42.900803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8c9-babd-4c01-bf34-ed3244ace9b4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:42.913448 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 926/1885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:43.062030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:43.063627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:43.094757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995660e-6d5f-470a-bf54-d573089ee962 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:43.103882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:43.105015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.106165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.107214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] PATH_INFO: `/v3/users/9c1efe99a8be4529a4eab7c6b628bae6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.110748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1efe99a8be4529a4eab7c6b628bae6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:43.116394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:43.249285 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:43.252687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1efe99a8be4529a4eab7c6b628bae6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:43.253955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1efe99a8be4529a4eab7c6b628bae6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:43.274021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1efe99a8be4529a4eab7c6b628bae6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:43.286968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1efe99a8be4529a4eab7c6b628bae6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:43.313429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79d5bd0e-d649-4065-8e09-a3acc36824c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1efe99a8be4529a4eab7c6b628bae6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:43.329816 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 960/1886] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:43 2022] DELETE /identity/v3/users/9c1efe99a8be4529a4eab7c6b628bae6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:43.334646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.336454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.336800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.395423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:43.403858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:43.516449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37132390-a2ff-4c4d-946c-a5e31824494f None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.516965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37132390-a2ff-4c4d-946c-a5e31824494f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.517262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37132390-a2ff-4c4d-946c-a5e31824494f None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.519080 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 961/1887] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:08:43.535580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.536467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.537101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.540328 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 927/1888] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:43.572251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:43.572645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:43.575520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:43.577208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:43.672185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 962/1889] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:43.696539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8013290-3438-4190-b344-4f68b42b5a70 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:43.706775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:43.708184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.708477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.708762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.709954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:43.733137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4f75a-47ca-4f1c-943a-10a1d568f07d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:43.735132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:43.736830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:43.739286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:43.740536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.741558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.742413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.755359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:43.759406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:43.766507 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 928/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:43.776278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 963/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:43.826735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:43.828224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:43.852509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794199-e28c-439c-968c-afb366dbc758 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:43.865518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:43.866474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:43.866755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:43.868310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] PATH_INFO: `/v3/projects/f4159384c83647d6bd43a06453826011` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:43.874047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4159384c83647d6bd43a06453826011)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:43.876439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:44.001377 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:44.014261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4159384c83647d6bd43a06453826011', 'request_id': 'req-423ffa19-6a68-4033-8921-2b0d8e6f0845'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.029340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4159384c83647d6bd43a06453826011', 'request_id': 'req-423ffa19-6a68-4033-8921-2b0d8e6f0845'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.047383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4159384c83647d6bd43a06453826011', 'request_id': 'req-423ffa19-6a68-4033-8921-2b0d8e6f0845'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.071334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] The token cache is being invalidate because project f4159384c83647d6bd43a06453826011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:44.071738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.076301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.083425 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 929/1892] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:43 2022] DELETE /identity/v3/projects/f4159384c83647d6bd43a06453826011 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:44.086138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:44.108130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63419-d267-4ed3-b7ac-9878792f3568 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:44.260223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:44.262642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:44.263145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:44.265029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] PATH_INFO: `/v3/users/f1a588296c794f51b7d048f38ae80e5a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:44.270913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a588296c794f51b7d048f38ae80e5a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:44.275475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:44.352085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a588296c794f51b7d048f38ae80e5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.353496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a588296c794f51b7d048f38ae80e5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.367858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a588296c794f51b7d048f38ae80e5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.377569 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:44.381713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a588296c794f51b7d048f38ae80e5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.404421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a588296c794f51b7d048f38ae80e5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:44.414061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 964/1893] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:44 2022] DELETE /identity/v3/users/f1a588296c794f51b7d048f38ae80e5a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:45.541642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:45.543898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:45.548880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:45.551448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:45.578935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffa19-6a68-4033-8921-2b0d8e6f0845 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:45.696546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:45.697645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:45.698077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:45.698491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] PATH_INFO: `/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:45.702727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b7aee65cff4ba5a25a3e03ff541c4e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:45.707631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:45.804776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076c1a7-7954-42cf-8f80-3e7b8aa38e7a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:45.821369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:45.825414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:45.825720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:45.826003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] PATH_INFO: `/v3/projects/a708e3326cf8400fb1830a4642d67987` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:45.831133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a708e3326cf8400fb1830a4642d67987)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:45.851497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:45.923581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b7aee65cff4ba5a25a3e03ff541c4e', 'request_id': 'req-dd18cbbd-d952-4759-b24b-678ade667959'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:45.949853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b7aee65cff4ba5a25a3e03ff541c4e', 'request_id': 'req-dd18cbbd-d952-4759-b24b-678ade667959'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:45.969508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b7aee65cff4ba5a25a3e03ff541c4e', 'request_id': 'req-dd18cbbd-d952-4759-b24b-678ade667959'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.003702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] The token cache is being invalidate because project b2b7aee65cff4ba5a25a3e03ff541c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:46.005117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.005443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a708e3326cf8400fb1830a4642d67987', 'request_id': 'req-ccfcaba7-087f-4df1-b52e-50db6dae41f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.006583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd18cbbd-d952-4759-b24b-678ade667959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.008640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 930/1894] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:45 2022] DELETE /identity/v3/projects/b2b7aee65cff4ba5a25a3e03ff541c4e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:46.016005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2234379-50d8-4304-83bd-57ea4e7b15d3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:46.016748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2234379-50d8-4304-83bd-57ea4e7b15d3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:46.017432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2234379-50d8-4304-83bd-57ea4e7b15d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:46.034530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a708e3326cf8400fb1830a4642d67987', 'request_id': 'req-ccfcaba7-087f-4df1-b52e-50db6dae41f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.054767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a708e3326cf8400fb1830a4642d67987', 'request_id': 'req-ccfcaba7-087f-4df1-b52e-50db6dae41f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.118776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] The token cache is being invalidate because project a708e3326cf8400fb1830a4642d67987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:46.119115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.124503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.132276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 965/1895] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:45 2022] DELETE /identity/v3/projects/a708e3326cf8400fb1830a4642d67987 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:46.135624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:46.156350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:46.198128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c2234379-50d8-4304-83bd-57ea4e7b15d3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:46.209686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c2234379-50d8-4304-83bd-57ea4e7b15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:46.380126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcaba7-087f-4df1-b52e-50db6dae41f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:46.393362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:46.394248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:46.394528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:46.394798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] PATH_INFO: `/v3/users/3e63f6cdd81a46e18f6ed1d2724d77dd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:46.396806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e63f6cdd81a46e18f6ed1d2724d77dd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:46.398806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:46.426111 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:46.515659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e63f6cdd81a46e18f6ed1d2724d77dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.516382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e63f6cdd81a46e18f6ed1d2724d77dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.529837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e63f6cdd81a46e18f6ed1d2724d77dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.538474 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 931/1896] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:46.546191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e63f6cdd81a46e18f6ed1d2724d77dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.547993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:46.548861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:46.549161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:46.577316 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:46.579598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e63f6cdd81a46e18f6ed1d2724d77dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:46.612107 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 966/1897] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:46 2022] DELETE /identity/v3/users/3e63f6cdd81a46e18f6ed1d2724d77dd => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:46.612568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:46.613868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:46.766827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 932/1898] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:46.771617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:46.787667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3e58a-5da2-40a4-b3e9-9d437875ae44 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:46.795082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:46.795791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:46.796188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:46.796588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:46.798577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:46.799638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:46.804107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:46.827657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 967/1899] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:46.831964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:46.847603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220233dc-9b0b-4d7d-bdd1-a12fe6c64874 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:46.868473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:46.869128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:46.869416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:46.869705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:46.874652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:46.876648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:46.946709 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 933/1900] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:46 2022] POST /identity/v3/projects => generated 395 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:08:46.952436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:46.968247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626889eb-f68a-4f7f-9d91-6882808cea56 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:47.153163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:47.154200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.154669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.155098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.156011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:47.161877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:47.218156 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 968/1901] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:46 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:08:47.222353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:47.238375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5cc3-8f59-4f26-8841-ff63f60ab993 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:47.256625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:47.257313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.257599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.257911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.258664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:47.260988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:47.289773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 934/1902] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:47.291823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:47.307403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e8f1a-d7cf-498a-ba61-b01f0bb76146 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:47.328051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:47.329233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.329233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.329429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.330095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:47.335112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaceca-299c-4f3b-8464-1d58ab3829dd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:47.361314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 969/1903] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:47.365372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:47.395966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381a59-a716-4ba4-857e-fadea359c40b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:47.420480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:47.421442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.421759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.422044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] PATH_INFO: `/v3/projects/41f1c61fc5294486acd250397772d337/users/024e7a8f960c49aba947f57f7074459b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.471642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f1c61fc5294486acd250397772d337, user_id=024e7a8f960c49aba947f57f7074459b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:47.487858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b8e1e-ffed-4f41-bd05-3e352155e3a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:47.531052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305211-0c49-4e50-b48b-32359d6f5786 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.531350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305211-0c49-4e50-b48b-32359d6f5786 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.531635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305211-0c49-4e50-b48b-32359d6f5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.537713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 935/1904] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:47 2022] PUT /identity/v3/projects/41f1c61fc5294486acd250397772d337/users/024e7a8f960c49aba947f57f7074459b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:47.588787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-44305211-0c49-4e50-b48b-32359d6f5786 None None] MFA Rules not processed for user `024e7a8f960c49aba947f57f7074459b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:47.591656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44305211-0c49-4e50-b48b-32359d6f5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:47.695504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a43fb-04d6-4f82-8a76-2a4b10640651 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.696029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a43fb-04d6-4f82-8a76-2a4b10640651 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.696105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a43fb-04d6-4f82-8a76-2a4b10640651 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.697867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 936/1905] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:08:47.733424 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:47.812775 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 970/1906] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:47.813431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a43fb-04d6-4f82-8a76-2a4b10640651 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:47.876409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:47.876710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:47.876986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:47.931835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:47.935011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:48.063619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a43fb-04d6-4f82-8a76-2a4b10640651 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.074026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.074803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.075100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.075458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.076338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.078485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:48.154659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 937/1907] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:47 2022] POST /identity/v3/projects => generated 395 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:48.155689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.210280 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:48.257094 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 971/1908] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:08:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:48.272504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6bdf-9456-4aab-a96e-5fc03bc77fd3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.313113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.314702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.315160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.315695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.317235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.329592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:48.366309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 938/1909] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:48 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:48.367928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.387296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84605-480c-4b46-bf0c-3659218bea2a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.398138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.398767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.399053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.399333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.400091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.408184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:48.464945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.469303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:48.493657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 972/1910] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:48.494822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.519996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cee97-3c0b-4b62-929d-dae45f179f58 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.535568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.538371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.538752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.540719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] PATH_INFO: `/v3/projects/bc93307263c84424a756bc6e25d6ce65/users/111038b0b9cf44cf8187aff490e7b0e3/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.582834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93307263c84424a756bc6e25d6ce65, user_id=111038b0b9cf44cf8187aff490e7b0e3, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.590244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:48.619968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 973/1911] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:48 2022] PUT /identity/v3/projects/bc93307263c84424a756bc6e25d6ce65/users/111038b0b9cf44cf8187aff490e7b0e3/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:48.625158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.835586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179472-2924-4d16-bb30-12b630aadaf1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.856523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.857260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.857589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.857922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.858659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.860535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56634135-684b-42b7-ad19-3663f4d4cdca admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.863606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:48.913549 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 974/1912] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:48.914700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:48.919929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:48.956518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39f88-4ced-4628-866c-6111b4aa747b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:48.969634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:48.970903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:48.971205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:48.971632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] PATH_INFO: `/v3/projects/bdf06f068d29488db19813b1130e85ce` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:48.973972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf06f068d29488db19813b1130e85ce)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:48.979666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:49.101227 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:49.117799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:49.118726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:49.118726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:49.119053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:49.148561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf06f068d29488db19813b1130e85ce', 'request_id': 'req-758a0373-1937-4cfe-bbd8-6610a34976d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:49.157920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:49.159601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:49.177031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf06f068d29488db19813b1130e85ce', 'request_id': 'req-758a0373-1937-4cfe-bbd8-6610a34976d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:49.194903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf06f068d29488db19813b1130e85ce', 'request_id': 'req-758a0373-1937-4cfe-bbd8-6610a34976d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:49.216731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 939/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:49.218063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:49.252670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] The token cache is being invalidate because project bdf06f068d29488db19813b1130e85ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:49.255644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:49.260966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-758a0373-1937-4cfe-bbd8-6610a34976d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:49.264152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aede3f-9416-45a9-8089-ddefc86c97aa service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:49.269920 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 975/1914] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:48 2022] DELETE /identity/v3/projects/bdf06f068d29488db19813b1130e85ce => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:49.276584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4461-87a3-4f9b-9350-bfadd8a631a2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:49.277208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4461-87a3-4f9b-9350-bfadd8a631a2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:49.277951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a4461-87a3-4f9b-9350-bfadd8a631a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:49.343161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-894a4461-87a3-4f9b-9350-bfadd8a631a2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:49.348669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-894a4461-87a3-4f9b-9350-bfadd8a631a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:49.414540 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:49.483034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:49.488300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:49.491559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:49.492494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] PATH_INFO: `/v3/projects/bc93307263c84424a756bc6e25d6ce65/users/111038b0b9cf44cf8187aff490e7b0e3/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:49.497282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93307263c84424a756bc6e25d6ce65, user_id=111038b0b9cf44cf8187aff490e7b0e3, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:49.505212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75042c-bf55-4e13-9b04-dcb91cf12e70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:49.529216 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 940/1915] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:49 2022] PUT /identity/v3/projects/bc93307263c84424a756bc6e25d6ce65/users/111038b0b9cf44cf8187aff490e7b0e3/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:49.548483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:49.549570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:49.550659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:49.642388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] MFA Rules not processed for user `111038b0b9cf44cf8187aff490e7b0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:49.643826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:49.730682 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 976/1916] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:49.735576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:49.736435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:49.737573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:49.785484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:49.791368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:49.968672 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 941/1917] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:49.982945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:49.988487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:50.158901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 977/1918] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:50.164104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:50.212860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0ea28-691c-4f9b-8bb2-621e7e853510 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:50.239639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:50.240493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:50.241149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:50.241149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:50.244361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:50.244700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:50.253734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:50.276768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a89583-f7e1-43fe-8623-cb07c5587f9a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:50.289706 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 978/1919] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:08:50.292002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:50.295474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:50.302178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:50.305039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:50.305330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:50.346883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd40a-16aa-4b92-b2f8-433f8b329919 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:50.351769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:50.354413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:50.367219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:50.369134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:50.369434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:50.369739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:50.372599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:50.376254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:50.397027 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 942/1920] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:50.456446 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 979/1921] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:50 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:50.457938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:50.476812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3b05-595f-47bb-b0b4-3e4a9a9f18c9 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:50.530798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:50.532650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:50.610158 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:50.729341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d47f-df6e-41b0-b82b-3213e287e05d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:50.750228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:50.751262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:50.751461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:50.751738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] PATH_INFO: `/v3/users/024e7a8f960c49aba947f57f7074459b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:50.758210 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:50.762583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024e7a8f960c49aba947f57f7074459b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:50.771164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:50.819163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:50.825839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:50.826348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:50.826844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:50.831062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:50.844785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:50.921726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024e7a8f960c49aba947f57f7074459b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:50.922655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024e7a8f960c49aba947f57f7074459b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:50.955493 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 943/1922] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:50 2022] POST /identity/v3/users => generated 296 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:50.959730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024e7a8f960c49aba947f57f7074459b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:50.963014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:50.968333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:50.988142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024e7a8f960c49aba947f57f7074459b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:51.038086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e0d1-bde7-47f1-a0df-7e9dfc51de26 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:51.048900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a95bec-8df4-44e6-b02b-15a53bf7be62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024e7a8f960c49aba947f57f7074459b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:51.052686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:51.054792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.056652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.057103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.060371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:51.072868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:51.073277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 980/1923] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:50 2022] DELETE /identity/v3/users/024e7a8f960c49aba947f57f7074459b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:51.078007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318af-618f-4282-9e7f-ecb27ac16352 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.078546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318af-618f-4282-9e7f-ecb27ac16352 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.079057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318af-618f-4282-9e7f-ecb27ac16352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.104052 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 944/1924] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:51.104991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:51.123133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e1b318af-618f-4282-9e7f-ecb27ac16352 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:51.126023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e1b318af-618f-4282-9e7f-ecb27ac16352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:51.131693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c60f-d91f-4cc0-b356-03242dd7d44e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:51.270066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:51.271590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.272057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.272474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.273378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:51.282290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:51.296578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 945/1925] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:51.306675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:51.327341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99ab6-0cee-476d-acb7-b1874176ea6b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:51.353726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:51.360073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.360430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.361429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] PATH_INFO: `/v3/projects/5b71ae9481534a73b488311b7a5505f2/users/356010337f5d4198be4b76df3e6272ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.363994 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 981/1926] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:51.409910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b71ae9481534a73b488311b7a5505f2, user_id=356010337f5d4198be4b76df3e6272ab, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:51.421336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361084c-3550-4b23-ba7c-cdd09d8a98d9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:51.441989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.442457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.443198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.487006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] MFA Rules not processed for user `725f3addf4524e98be4cccc41e75b63c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:51.488463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:51.498462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 946/1927] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:51 2022] PUT /identity/v3/projects/5b71ae9481534a73b488311b7a5505f2/users/356010337f5d4198be4b76df3e6272ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:51.511037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.511842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.512088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:51.563397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] MFA Rules not processed for user `356010337f5d4198be4b76df3e6272ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:51.565985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:51.607164 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:51.732561 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 947/1928] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:51.733613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:51.735191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:51.763128 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 982/1929] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:51.774641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:51.837145 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:51.958995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65c528-0cb4-4653-96ce-c8c64c925b69 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:51.963944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:51.965380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:51.965654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:51.966019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.063263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.068485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae926e3-fb9b-47ec-8a7f-20dbb1dbcf9b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.070944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246a713-f580-4e3b-8c03-5a85e3fe16fe None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.088188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.093199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.093199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.093199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.093199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.097639 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 948/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:52.097854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.099338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.099784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.100360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.162699 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 983/1931] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:51 2022] POST /identity/v3/projects => generated 389 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:52.166543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.172593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] MFA Rules not processed for user `40b5fc3b4b6d43ab9342da568567140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:52.176022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:52.311657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce523b-e60a-44d4-a827-e3f7050a96c4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.319298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256901-1384-457c-a951-4630013e8622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.320114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256901-1384-457c-a951-4630013e8622 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.320472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256901-1384-457c-a951-4630013e8622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.320822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256901-1384-457c-a951-4630013e8622 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.322084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256901-1384-457c-a951-4630013e8622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.324098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256901-1384-457c-a951-4630013e8622 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.351497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 949/1932] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:52.359329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 984/1933] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:52 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:08:52.364415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.365441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256901-1384-457c-a951-4630013e8622 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.366004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:52.391460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256901-1384-457c-a951-4630013e8622 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.402833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.404171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.404484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.404999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.405875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.409568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.429499 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 985/1934] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:52.436553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.456956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deba1c-2e80-4170-bca0-5d6c4d5c4a5a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.482263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.486672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.486672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.486672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] PATH_INFO: `/v3/projects/d4e498b2b815422f85b169019fc0e55a/users/803f51dff960493c9e2000e7138e9c90/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.555984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ded6e-6c6a-4f22-b135-57eff0b680d9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.563603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.564353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.565735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.565735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.568087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e498b2b815422f85b169019fc0e55a, user_id=803f51dff960493c9e2000e7138e9c90, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.571829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.573584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:52.590192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.592682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.614024 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 986/1935] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:52 2022] PUT /identity/v3/projects/d4e498b2b815422f85b169019fc0e55a/users/803f51dff960493c9e2000e7138e9c90/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:52.615001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.621923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 950/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:52.646237 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:52.783733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048026b7-db45-43f3-9092-4e5fc0022bfe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.797411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.798324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.798695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.799027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.799849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.801804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d2527-14d2-473c-bf75-b734dc703df8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.824467 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 987/1937] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:52.828428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:52.849196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb0de-a5c6-4403-a493-620bd201f3a6 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:52.867432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:52.871075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.871337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.871900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] PATH_INFO: `/v3/projects/d4e498b2b815422f85b169019fc0e55a/users/803f51dff960493c9e2000e7138e9c90/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:52.879547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e498b2b815422f85b169019fc0e55a, user_id=803f51dff960493c9e2000e7138e9c90, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:52.880219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:52.896185 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:52.930428 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 951/1938] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:52 2022] PUT /identity/v3/projects/d4e498b2b815422f85b169019fc0e55a/users/803f51dff960493c9e2000e7138e9c90/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:52.939998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:52.940685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:52.940685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:53.005896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] MFA Rules not processed for user `803f51dff960493c9e2000e7138e9c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:53.007833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:53.207573 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 988/1939] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:53.361155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:53.362985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:53.534193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:53.537429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:53.588033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6f89-431b-42e3-9c1d-5f3caca33c7c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:53.606441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:53.608115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:53.608408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:53.608690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] PATH_INFO: `/v3/projects/41f1c61fc5294486acd250397772d337` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:53.616868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f1c61fc5294486acd250397772d337)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:53.625980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:53.703278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb8b5-db6a-4657-a08b-d1fc86cd3690 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:53.716910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:53.717582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:53.717891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:53.718276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:53.737523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:53.740431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:53.748514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f1c61fc5294486acd250397772d337', 'request_id': 'req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:53.767046 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 989/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:53.784968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f1c61fc5294486acd250397772d337', 'request_id': 'req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:53.800736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f1c61fc5294486acd250397772d337', 'request_id': 'req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:53.836371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] The token cache is being invalidate because project 41f1c61fc5294486acd250397772d337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:53.841289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:53.845510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5b7f453-c2de-4181-ac2c-a07ee77a5cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:53.847799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 952/1941] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:53 2022] DELETE /identity/v3/projects/41f1c61fc5294486acd250397772d337 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:53.851767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:53.864324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31ad23-8780-40ef-b914-3815799f7ac1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:53.908931 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:53.967690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:53.968579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:53.968969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.031119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] MFA Rules not processed for user `4f5199ed3f0a4ae9a9f13c9561f888b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:54.032047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.044271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:54.045196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:54.045483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:54.045791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] PATH_INFO: `/v3/users/111038b0b9cf44cf8187aff490e7b0e3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.047715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] RBAC: Authorizing `identity:delete_user(user_id=111038b0b9cf44cf8187aff490e7b0e3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:54.050060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:54.162498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111038b0b9cf44cf8187aff490e7b0e3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.163290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111038b0b9cf44cf8187aff490e7b0e3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.175554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111038b0b9cf44cf8187aff490e7b0e3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.189850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111038b0b9cf44cf8187aff490e7b0e3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.213299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111038b0b9cf44cf8187aff490e7b0e3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.224668 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 953/1942] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:54.229170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:54.233094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.233244 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 990/1943] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:53 2022] DELETE /identity/v3/users/111038b0b9cf44cf8187aff490e7b0e3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:54.262481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e13e4-514d-4760-bff7-ca19b79032f5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:54.284193 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:54.377893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:54.379339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:54.379790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:54.380134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.381136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:54.383354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:54.387874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:54.389766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.425455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731239f-3ceb-46c4-a393-82f2f94e224c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:54.431600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:54.443056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:54.443380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:54.443634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] PATH_INFO: `/v3/users/356010337f5d4198be4b76df3e6272ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.449342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=356010337f5d4198be4b76df3e6272ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:54.452715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:54.550217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356010337f5d4198be4b76df3e6272ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.550971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356010337f5d4198be4b76df3e6272ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.568084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356010337f5d4198be4b76df3e6272ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.581288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356010337f5d4198be4b76df3e6272ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.595518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 954/1944] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:54 2022] POST /identity/v3/projects => generated 403 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:08:54.596860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:54.600402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.618533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65d7efbc-b03e-4780-af87-cb643197ee6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356010337f5d4198be4b76df3e6272ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:54.635925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 991/1945] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:54 2022] DELETE /identity/v3/users/356010337f5d4198be4b76df3e6272ab => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:54.640964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:54.641253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:54.641532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.674114 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:54.684866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:54.687114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.836141 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 992/1946] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:54.848301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f041-1739-4651-885f-84cfe3356115 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:54.848429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:54.851212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:54.870992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:54.871937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:54.878150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:54.878508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:54.879283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:54.885284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:54.984940 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 955/1947] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:54 2022] POST /identity/v3/users => generated 308 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:54.987684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:55.017898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312dc38-a0e4-4fda-8109-cf390248267a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.043615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.044619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.045519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.046030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.046928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.049827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.068184 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 956/1948] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:55.072356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:55.077011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2134ea-af19-4b3a-9fe8-0211431bfa6f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.086193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.087009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.087292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.087563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.115340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.116803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6bf-6491-4485-8cf5-15b941166325 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.117015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.136679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.137902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.138351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.138791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] PATH_INFO: `/v3/projects/b802f081bf61468c810f8dc6724ff12c/users/f0a5743fa5294d1e9670c66bca17b248/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.148717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 993/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:55.219317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:55.221383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:55.226894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b802f081bf61468c810f8dc6724ff12c, user_id=f0a5743fa5294d1e9670c66bca17b248, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.242080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.262628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27092a6-d9c3-4f72-974e-dd9cabc47abb service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.285207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.286279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.286564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.286824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] PATH_INFO: `/v3/projects/bc93307263c84424a756bc6e25d6ce65` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.294880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 957/1950] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:55 2022] PUT /identity/v3/projects/b802f081bf61468c810f8dc6724ff12c/users/f0a5743fa5294d1e9670c66bca17b248/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:08:55.299066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:55.301810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc93307263c84424a756bc6e25d6ce65)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.303882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.503541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc93307263c84424a756bc6e25d6ce65', 'request_id': 'req-d87ec140-8218-4163-b2ca-4bbdbf875f1e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:55.514687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc93307263c84424a756bc6e25d6ce65', 'request_id': 'req-d87ec140-8218-4163-b2ca-4bbdbf875f1e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:55.519494 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:55.532018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc93307263c84424a756bc6e25d6ce65', 'request_id': 'req-d87ec140-8218-4163-b2ca-4bbdbf875f1e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:55.538755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62bd0b-384c-4de9-a3dc-68feb0ad980a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.577816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] The token cache is being invalidate because project bc93307263c84424a756bc6e25d6ce65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:55.577816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:55.578519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d87ec140-8218-4163-b2ca-4bbdbf875f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:55.581365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 994/1951] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:55 2022] DELETE /identity/v3/projects/bc93307263c84424a756bc6e25d6ce65 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:08:55.587424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b293-51a4-4b00-8e70-c90c57fb7803 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.591807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b293-51a4-4b00-8e70-c90c57fb7803 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.592151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b293-51a4-4b00-8e70-c90c57fb7803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.645966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5cd4b293-51a4-4b00-8e70-c90c57fb7803 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:55.649055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5cd4b293-51a4-4b00-8e70-c90c57fb7803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:55.732542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.733230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.733512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.733859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.734775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.736352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.751830 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 958/1952] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:55.753434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:55.757297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:55.761640 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:55.787280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2b84-266a-4657-a5a3-15afbec848c6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:55.803416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:55.805269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.805713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.808225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] PATH_INFO: `/v3/projects/b802f081bf61468c810f8dc6724ff12c/users/f0a5743fa5294d1e9670c66bca17b248/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.813254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b802f081bf61468c810f8dc6724ff12c, user_id=f0a5743fa5294d1e9670c66bca17b248, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:55.822565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:55.846356 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 995/1953] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:55.861928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 959/1954] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:55 2022] PUT /identity/v3/projects/b802f081bf61468c810f8dc6724ff12c/users/f0a5743fa5294d1e9670c66bca17b248/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:08:55.868053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:55.870739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:55.873308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:55.962801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:55.966894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:56.094325 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 996/1955] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:56.094933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.110965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0270ec1-1914-47f3-b220-adcfa0f671dc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.145480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.146383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.146663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.147256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.148025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:08:56.148332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.150948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.179919 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 960/1956] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:08:56.185106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.205181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909e29d-42ac-4b04-9e35-1ba97326ec4c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.222208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.222907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.223167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.223499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.224300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.227768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.285205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 997/1957] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:56 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:56.289398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.301579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7614-b2ef-42d2-a985-256385a38339 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.465436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.466162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.466449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.468706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.469265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.483723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.533312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 961/1958] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:56 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:56.534036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.553578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c3ed-ce73-44fb-a8a0-f734a92fe1a4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.572531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.576961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.579727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.581662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.582651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.603534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.608230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.612538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:56.656959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 998/1959] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:56.658118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.668476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c912b-f1b6-4200-9670-612177d8775e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.690693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df511e-ec2a-48b2-ae62-43a8c446e45b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.694448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.697441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.697787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.698295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] PATH_INFO: `/v3/projects/5b71ae9481534a73b488311b7a5505f2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.701820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b71ae9481534a73b488311b7a5505f2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.705709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:56.706505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:56.706895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:56.707277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:56.708142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:56.712637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.719038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:56.753463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 999/1960] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:56.767309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.805079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2f22-da98-4146-942c-5051391a7b9c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:56.833474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b71ae9481534a73b488311b7a5505f2', 'request_id': 'req-aa267acb-9df0-4554-a5f2-d3417d862e24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:56.842950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b71ae9481534a73b488311b7a5505f2', 'request_id': 'req-aa267acb-9df0-4554-a5f2-d3417d862e24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:56.848094 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:56.851862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b71ae9481534a73b488311b7a5505f2', 'request_id': 'req-aa267acb-9df0-4554-a5f2-d3417d862e24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:56.903208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] The token cache is being invalidate because project 5b71ae9481534a73b488311b7a5505f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:08:56.903819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:56.904713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:56.914321 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 962/1961] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:08:56 2022] DELETE /identity/v3/projects/5b71ae9481534a73b488311b7a5505f2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:56.915853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:56.919597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:57.020343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:57.021393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.022009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.024772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] PATH_INFO: `/v3/projects/3a66209b0c5f43928a52519ee8f5edbf/users/d9d620962dcc40a8afaf6f97ae605eec/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.117153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a66209b0c5f43928a52519ee8f5edbf, user_id=d9d620962dcc40a8afaf6f97ae605eec, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:57.139121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b750100-1e46-48c8-a5ee-c06f52694752 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:57.192201 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1000/1962] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:56 2022] PUT /identity/v3/projects/3a66209b0c5f43928a52519ee8f5edbf/users/d9d620962dcc40a8afaf6f97ae605eec/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:57.204895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.205200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.205487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.215962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267acb-9df0-4554-a5f2-d3417d862e24 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:57.293004 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:57.309979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] MFA Rules not processed for user `d9d620962dcc40a8afaf6f97ae605eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:57.313308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:57.414991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:57.416859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.418662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.419947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] PATH_INFO: `/v3/users/803f51dff960493c9e2000e7138e9c90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.425046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803f51dff960493c9e2000e7138e9c90)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:57.430098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:57.480972 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1001/1963] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:57.482758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:57.487034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:57.514748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677dd11-fc4f-49fe-bfa1-584a7a4bde18 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:57.535782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:57.536515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.536799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.537076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.537827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:57.539823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:57.541320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803f51dff960493c9e2000e7138e9c90'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:57.554577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803f51dff960493c9e2000e7138e9c90'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:57.571565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803f51dff960493c9e2000e7138e9c90'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:57.611717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803f51dff960493c9e2000e7138e9c90'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:57.612021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1002/1964] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:08:57 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:08:57.614411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:57.614577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803f51dff960493c9e2000e7138e9c90'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:08:57.621968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:57.626088 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 963/1965] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:08:56 2022] DELETE /identity/v3/users/803f51dff960493c9e2000e7138e9c90 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:57.763996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5ac9-5bef-45ef-8616-c2e36032cbbe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:57.892519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:57.893639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.893953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.894232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.895245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:57.898256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:57.939512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1003/1966] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:08:57 2022] POST /identity/v3/users => generated 303 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:08:57.939792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:57.957068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54e28-c8aa-4b8b-99b4-1059b205e453 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:57.974369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:57.976392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:57.976811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:57.976970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:57.977749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:57.984499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:58.009188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 964/1967] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:08:58.010442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:58.024731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94461f3-3537-4b0b-8755-4c86044dda6b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:58.043205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:58.044255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.044549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.044831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] PATH_INFO: `/v3/projects/a09785ffe2da4839a184914bfacfebc3/users/a250ab409dd8445b910baf57f2e80b48/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.099317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09785ffe2da4839a184914bfacfebc3, user_id=a250ab409dd8445b910baf57f2e80b48, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:58.144504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:58.151286 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:58.185884 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1004/1968] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:58 2022] PUT /identity/v3/projects/a09785ffe2da4839a184914bfacfebc3/users/a250ab409dd8445b910baf57f2e80b48/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:58.190205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:58.197121 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:08:58.206139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262a86-e796-4cca-8b28-25f38a54e4d2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:58.349389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:58.350352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.350636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.351172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.351989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:58.353747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b0cc3-6ef9-412f-886c-bf272f5ff9eb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:58.378748 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 965/1969] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:08:58.382954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:58.403357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38fc5c-b23e-456e-8503-486bb959b913 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:58.415532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:58.417284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.417650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.418025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] PATH_INFO: `/v3/projects/a09785ffe2da4839a184914bfacfebc3/users/a250ab409dd8445b910baf57f2e80b48/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.425292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09785ffe2da4839a184914bfacfebc3, user_id=a250ab409dd8445b910baf57f2e80b48, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:58.431408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe7bd4-ee96-4bfa-834d-770fa5d7d38e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:58.470827 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1005/1970] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:08:58 2022] PUT /identity/v3/projects/a09785ffe2da4839a184914bfacfebc3/users/a250ab409dd8445b910baf57f2e80b48/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:08:58.471925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee3a-fc07-4d7b-8925-c7fa1cda8a5d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.472226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee3a-fc07-4d7b-8925-c7fa1cda8a5d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.472561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee3a-fc07-4d7b-8925-c7fa1cda8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.494118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.494551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.494923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.530256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e6aaee3a-fc07-4d7b-8925-c7fa1cda8a5d None None] MFA Rules not processed for user `a250ab409dd8445b910baf57f2e80b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:58.532286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6aaee3a-fc07-4d7b-8925-c7fa1cda8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:58.534562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:58.535792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:58.689253 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1006/1971] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 24 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:08:58.718799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 966/1972] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:58.727609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:58.731303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:58.732981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a296-b7a1-4344-b311-765fcd72189b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.733435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a296-b7a1-4344-b311-765fcd72189b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.733894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a296-b7a1-4344-b311-765fcd72189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.752988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a96ae-ed23-4057-91cf-e78206c543e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:58.767744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2493a296-b7a1-4344-b311-765fcd72189b None None] MFA Rules not processed for user `d9d620962dcc40a8afaf6f97ae605eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:08:58.769453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2493a296-b7a1-4344-b311-765fcd72189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:58.770603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:58.771296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:58.771573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:58.771845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:58.791803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:58.800432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:58.827344 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1007/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:08:58.845876 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 967/1974] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:08:59.326810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:08:59.328808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:59.477298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64fc5-1fe3-43b8-9f85-62916da35b2d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:08:59.491268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:08:59.491888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:08:59.492188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:08:59.492523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:08:59.494661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:08:59.519266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:08:59.531816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e233fac-0a66-472d-b016-a752ea77970f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:08:59.556614 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1008/1975] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:08:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:00.197442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:00.198386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:00.200613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:00.202654 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 968/1976] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:09:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:00.274918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bd7b6-374a-4a72-8912-bc1140e38bf2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:00.275215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bd7b6-374a-4a72-8912-bc1140e38bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:00.275663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bd7b6-374a-4a72-8912-bc1140e38bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:00.325011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-213bd7b6-374a-4a72-8912-bc1140e38bf2 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:00.326688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-213bd7b6-374a-4a72-8912-bc1140e38bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:00.352981 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1009/1977] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:00.355813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:00.358349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:00.437701 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:00.522596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbd957-2af9-4ce9-b288-811ea6e7acdb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:00.544118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:00.544825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:00.545110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:00.545391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] PATH_INFO: `/v3/projects/d4e498b2b815422f85b169019fc0e55a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:00.556192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e498b2b815422f85b169019fc0e55a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:00.558525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:00.685728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e498b2b815422f85b169019fc0e55a', 'request_id': 'req-829cc411-44b4-4df4-a144-e117bc94ea9e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:00.699468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e498b2b815422f85b169019fc0e55a', 'request_id': 'req-829cc411-44b4-4df4-a144-e117bc94ea9e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:00.718935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e498b2b815422f85b169019fc0e55a', 'request_id': 'req-829cc411-44b4-4df4-a144-e117bc94ea9e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:00.758935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] The token cache is being invalidate because project d4e498b2b815422f85b169019fc0e55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:00.759402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:00.760375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:00.762917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 969/1978] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:00 2022] DELETE /identity/v3/projects/d4e498b2b815422f85b169019fc0e55a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:00.767688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032b13-5ebb-4e54-aa0b-08d3123b5123 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:00.767979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032b13-5ebb-4e54-aa0b-08d3123b5123 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:00.768255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032b13-5ebb-4e54-aa0b-08d3123b5123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:00.804888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-04032b13-5ebb-4e54-aa0b-08d3123b5123 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:00.808833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04032b13-5ebb-4e54-aa0b-08d3123b5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:00.955313 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:00.963916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:00.966290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:00.987572 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1010/1979] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:01.001047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.009747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.013235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.058453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:01.061358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:01.085382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1011/1980] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:01.086728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.123400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc7ce1-f477-490d-bbd1-0ab0de9b678a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.142343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.143162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.146025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.146328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.147115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:01.147426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.154080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.181165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cc411-44b4-4df4-a144-e117bc94ea9e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.188305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1012/1981] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:01.189305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.201258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.202020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b680-585f-4d35-99a4-5a4aae0dabdb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.202817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.204672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.206479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.207385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.208088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.209254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.210193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.210958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.212953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.223809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:01.251349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.260235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.286407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1013/1982] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:01 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:01.290740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.302717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 970/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:01.568509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a12658-95e6-4f57-b242-20fc497054d6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.575125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.576288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.590287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.590636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.592057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.597494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.653745 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1014/1984] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:01 2022] POST /identity/v3/users => generated 292 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:01.658921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.684434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49335e83-da4b-4dbd-9f5e-2b8fb3c3bd57 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.718784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.719484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.719770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.720078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.721249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.731884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.775182 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 971/1985] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:01.778036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.793842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990abff8-07b0-46ef-96dc-19c96a64d23d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.810107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.811164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.812513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.813049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.814704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.818904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357695-d078-4f7f-ba91-c1c152622503 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.855785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:01.856955 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1015/1986] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:01.875319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733cdbb-3fc4-4af2-b307-e82a7bced3c4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:01.898434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:01.899579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:01.900033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:01.900355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] PATH_INFO: `/v3/projects/13ec745840974e619c55b12f82afee78/users/7487ae5931b044aaa87631f8f999fcbe/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:01.958256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ec745840974e619c55b12f82afee78, user_id=7487ae5931b044aaa87631f8f999fcbe, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:01.966158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:01.994564 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 972/1987] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:01 2022] PUT /identity/v3/projects/13ec745840974e619c55b12f82afee78/users/7487ae5931b044aaa87631f8f999fcbe/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:02.013123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:02.013748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:02.014880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:02.090948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] MFA Rules not processed for user `7487ae5931b044aaa87631f8f999fcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:02.092236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:02.355901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1016/1988] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:02.360739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:02.381329 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:02.530090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b22de-b9d4-4eb7-9b5a-f16459bf25f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:02.544334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:02.546971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:02.548784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:02.550371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:02.553586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:02.555689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:02.613913 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 973/1989] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:02 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:02.618077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:02.633641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c478-37c6-4352-adca-17f7c26179c7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:02.711094 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:02.819426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:02.821692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:02.822033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:02.822317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:02.823114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:02.828052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:02.861570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1017/1990] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:02 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:02.862839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:02.901112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039656-ad68-41bc-87ea-74654f9263e9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:02.913115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:02.913877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:02.914167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:02.914947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:02.915195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:02.920879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:02.959755 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 974/1991] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:02.960319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:02.979864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2908-29e6-43e0-b0e5-847d01dca5d0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:02.996661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:02.998777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:02.999067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:03.000202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] PATH_INFO: `/v3/projects/6cd08074ee44420abdc96f1abe771ee2/users/fab4642deb1a4313af4bd35ab63c04d0/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:03.055226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd08074ee44420abdc96f1abe771ee2, user_id=fab4642deb1a4313af4bd35ab63c04d0, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:03.064489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:03.117089 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1018/1992] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:02 2022] PUT /identity/v3/projects/6cd08074ee44420abdc96f1abe771ee2/users/fab4642deb1a4313af4bd35ab63c04d0/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:03.118042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:03.140675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66324bf-e0ba-469c-9710-3db3ea53531a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:03.303440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:03.304530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:03.304970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:03.305366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:03.306614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:03.309419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d502b-a3ac-4036-aa36-d661b6678e1a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:03.327974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 975/1993] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:03.332803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:03.355243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adce2f-2c0e-450a-a782-8d4448a05eed admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:03.362827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:03.363853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:03.364129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:03.364408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] PATH_INFO: `/v3/projects/6cd08074ee44420abdc96f1abe771ee2/users/fab4642deb1a4313af4bd35ab63c04d0/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:03.366724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd08074ee44420abdc96f1abe771ee2, user_id=fab4642deb1a4313af4bd35ab63c04d0, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:03.369705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:03.383468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1019/1994] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:03 2022] PUT /identity/v3/projects/6cd08074ee44420abdc96f1abe771ee2/users/fab4642deb1a4313af4bd35ab63c04d0/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:03.395947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:03.396479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:03.396747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:03.432393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] MFA Rules not processed for user `fab4642deb1a4313af4bd35ab63c04d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:03.435062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:03.545906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 976/1995] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:03.558691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:03.751049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d819a-6d63-407a-a9de-df2a683dc0f9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:03.770744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:03.771435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:03.771725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:03.772004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:03.785591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:03.787408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e47c4-70be-4565-b206-b70cc00f9f89 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:03.804922 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1020/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:04.322236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:04.329822 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:04.557320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4009-d271-4706-9a16-9d7aa3ecf86e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:04.569138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:04.573841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:04.574375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:04.574851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] PATH_INFO: `/v3/users/7487ae5931b044aaa87631f8f999fcbe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:04.597155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7487ae5931b044aaa87631f8f999fcbe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:04.601750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:04.778173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7487ae5931b044aaa87631f8f999fcbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:04.793287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7487ae5931b044aaa87631f8f999fcbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:04.817427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7487ae5931b044aaa87631f8f999fcbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:04.865482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7487ae5931b044aaa87631f8f999fcbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:04.867186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a936ba29-c16c-4565-8c20-caab39a1f7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7487ae5931b044aaa87631f8f999fcbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:04.883286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 977/1997] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:04 2022] DELETE /identity/v3/users/7487ae5931b044aaa87631f8f999fcbe => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:04.889204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:04.890078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:04.890533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:04.913864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232772d-9fdb-48f6-a4ea-3ece4d4c35c2 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:04.914229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232772d-9fdb-48f6-a4ea-3ece4d4c35c2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:04.914333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232772d-9fdb-48f6-a4ea-3ece4d4c35c2 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:04.916365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 978/1998] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:04.921862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:04.923955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:04.928775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:04.929584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:04.930136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:04.961513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:04.962921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:05.040481 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:05.058759 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1021/1999] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:05.082590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:05.084673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:05.146456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 979/2000] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:05.186173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:05.188723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:05.217298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7f713-d575-4c4f-b9e2-3b2fafb891cd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:05.225428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:05.226454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:05.226794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:05.227018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:05.232378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b233557-65fb-4b6f-af65-26279c0231bd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:05.239062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:05.241255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:05.250136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:05.250983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:05.251276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:05.251553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:05.264876 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 980/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:05.279313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:05.280605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:05.308585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1022/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:07.317466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:07.322805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:07.381072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0e13-f569-49c2-8afd-b7b8a4ce5951 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:07.409844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:07.410839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:07.411124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:07.411408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] PATH_INFO: `/v3/projects/13ec745840974e619c55b12f82afee78` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:07.420292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ec745840974e619c55b12f82afee78)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:07.422450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:07.427205 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:07.563944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ec745840974e619c55b12f82afee78', 'request_id': 'req-499eca50-e73f-492e-b1a6-9b7bcf56bf34'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:07.595629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ec745840974e619c55b12f82afee78', 'request_id': 'req-499eca50-e73f-492e-b1a6-9b7bcf56bf34'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:07.614344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ec745840974e619c55b12f82afee78', 'request_id': 'req-499eca50-e73f-492e-b1a6-9b7bcf56bf34'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:07.712082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] The token cache is being invalidate because project 13ec745840974e619c55b12f82afee78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:07.712767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:07.714615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-499eca50-e73f-492e-b1a6-9b7bcf56bf34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:07.717438 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 981/2003] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:07 2022] DELETE /identity/v3/projects/13ec745840974e619c55b12f82afee78 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:07.722682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:07.784092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17203d-2ecc-46f2-936d-a612966670a2 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:07.962750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:07.970816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:07.976393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:07.976992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] PATH_INFO: `/v3/users/fab4642deb1a4313af4bd35ab63c04d0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:07.984242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab4642deb1a4313af4bd35ab63c04d0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:07.990582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:08.199580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab4642deb1a4313af4bd35ab63c04d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:08.203985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab4642deb1a4313af4bd35ab63c04d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:08.228602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab4642deb1a4313af4bd35ab63c04d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:08.255696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab4642deb1a4313af4bd35ab63c04d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:08.287493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab4642deb1a4313af4bd35ab63c04d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:08.312274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1023/2004] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:07 2022] DELETE /identity/v3/users/fab4642deb1a4313af4bd35ab63c04d0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:09.750061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:09.750710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:09.750710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:09.778258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:09.780799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:09.791290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] MFA Rules not processed for user `f0a5743fa5294d1e9670c66bca17b248`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:09.793640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:09.859830 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:09.942275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 982/2005] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:09.946897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8358f-a0f5-4246-b720-875e276450a5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:09.960739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:09.962277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:09.964563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:09.967532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:09.968020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:09.969323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] PATH_INFO: `/v3/projects/6cd08074ee44420abdc96f1abe771ee2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:09.972114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd08074ee44420abdc96f1abe771ee2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:09.980893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:09.984405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb4aef-bf27-4979-8317-0f35689de659 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:09.997580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:10.003912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.004913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.013726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] PATH_INFO: `/v3/users/0b6f2ac6037e47d8bf67861ed9d4bb10` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.018651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6f2ac6037e47d8bf67861ed9d4bb10)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:10.023802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:10.113889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd08074ee44420abdc96f1abe771ee2', 'request_id': 'req-c1e52519-a689-403a-b3c2-3c1732a866e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.125915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd08074ee44420abdc96f1abe771ee2', 'request_id': 'req-c1e52519-a689-403a-b3c2-3c1732a866e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.147881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd08074ee44420abdc96f1abe771ee2', 'request_id': 'req-c1e52519-a689-403a-b3c2-3c1732a866e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.178252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] The token cache is being invalidate because project 6cd08074ee44420abdc96f1abe771ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:10.178557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.183420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1e52519-a689-403a-b3c2-3c1732a866e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.185567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6f2ac6037e47d8bf67861ed9d4bb10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.190020 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1024/2006] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:09 2022] DELETE /identity/v3/projects/6cd08074ee44420abdc96f1abe771ee2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:10.196891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e3c7-bd10-475e-ba2b-b7ef3e40f93b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.197623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e3c7-bd10-475e-ba2b-b7ef3e40f93b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.200206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e3c7-bd10-475e-ba2b-b7ef3e40f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.203051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6f2ac6037e47d8bf67861ed9d4bb10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.226816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6f2ac6037e47d8bf67861ed9d4bb10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.245412 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:10.263095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-90a7e3c7-bd10-475e-ba2b-b7ef3e40f93b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:10.264750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90a7e3c7-bd10-475e-ba2b-b7ef3e40f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:10.272541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6f2ac6037e47d8bf67861ed9d4bb10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.273408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-310f4186-7d44-42bf-94ed-610b7e6d020a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6f2ac6037e47d8bf67861ed9d4bb10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:10.295925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 983/2007] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:09 2022] DELETE /identity/v3/users/0b6f2ac6037e47d8bf67861ed9d4bb10 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:10.298295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.298771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.299134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.332462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:10.335836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:10.449175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1025/2008] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:10.453452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.453932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.455231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.517287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:10.522673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:10.626405 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 984/2009] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:10.677808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:10.679221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:10.781596 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:10.807221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448aa5c-d463-432a-842f-9364d5bac52a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:10.821860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:10.822572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.822859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.823816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.828916 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1026/2010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:10.830179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:10.837884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:10.860320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:10.861871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:10.888524 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 985/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:10.893978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:10.923033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa46f2-9f79-49e8-b04e-d78549cc83f2 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:10.938681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:10.940470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:10.940771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:10.941108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:10.947782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:10.948875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:10.950912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:10.991626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 986/2012] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:10.996961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.031266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ddbcf-406c-4347-b577-403b7f7b8cbb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.048885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.055767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.056042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.056363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.057215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.063174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.075346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc0ac9-be73-4a22-8d2c-8dee381d8b38 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.092079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.092765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.093051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.093331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.104048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:11.130105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 987/2013] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:10 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:11.135452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.283118 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:11.299634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c10e0a-6ef5-4ca8-b898-005e2b69ed9d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.301545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.308235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.319660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.320392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.320674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.320945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.321713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.324501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.342077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1027/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:11.358993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 988/2015] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:11 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:11.369083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.388151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9765-a763-479c-8f5e-fe9f5ea7a93f service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.409043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.409043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.409043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.409043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.409732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.411581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.437531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1028/2016] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:11.438386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.457174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba4fd-10c8-40bc-9dda-0e58920c464e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.470065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.471193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.471727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.472198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.473294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.478362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e066-154a-44e4-8765-e1e56d6162ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.503288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.513169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 989/2017] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:11.520707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a17c-2e6c-4644-a7a3-784420002d58 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:11.546929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:11.548980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.550756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.551672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] PATH_INFO: `/v3/projects/c028787727e34a489f5a99f937538b6f/users/bfd5b02713f54950b7a5fae18bf4d485/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.608026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c028787727e34a489f5a99f937538b6f, user_id=bfd5b02713f54950b7a5fae18bf4d485, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:11.613767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:11.638661 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1029/2018] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:11 2022] PUT /identity/v3/projects/c028787727e34a489f5a99f937538b6f/users/bfd5b02713f54950b7a5fae18bf4d485/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:11.649830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:11.650201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:11.650438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:11.710502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] MFA Rules not processed for user `bfd5b02713f54950b7a5fae18bf4d485`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:11.714020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:11.901974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 990/2019] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:11.904671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:11.986088 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:11.992695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68220-1af9-45f8-80d9-58e1a8a66a0e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:12.001998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:12.004163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:12.004889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:12.005242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:12.006082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:12.009370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:12.054806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1030/2020] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:11 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:12.056235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:12.079729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47e6f-262a-46a9-91b3-a308adfccf1c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:12.161443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:12.164740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:12.316305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:12.320289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:12.320726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:12.321109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:12.321990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:12.329916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:12.406397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 991/2021] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:12 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:12.412847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:12.443946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581c347-6640-4673-9081-ec30786ba8a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:12.454791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764db07-47cc-4e93-b6c1-3fef9536c773 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:12.475342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:12.477162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:12.477652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:12.481146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] PATH_INFO: `/v3/projects/fcfeba8f31494231b0e7d9ae6f92570d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:12.485450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:12.487268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcfeba8f31494231b0e7d9ae6f92570d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:12.488649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:12.491923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:12.492722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:12.494893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:12.495917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:12.505105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:12.618055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcfeba8f31494231b0e7d9ae6f92570d', 'request_id': 'req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:12.618729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 992/2022] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:12.624020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:12.626513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcfeba8f31494231b0e7d9ae6f92570d', 'request_id': 'req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:12.639795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcfeba8f31494231b0e7d9ae6f92570d', 'request_id': 'req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:12.675929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7873e2-4866-4fe5-8a48-677d59c59254 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:12.679652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] The token cache is being invalidate because project fcfeba8f31494231b0e7d9ae6f92570d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:12.680143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:12.684375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:12.692058 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1031/2023] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:12 2022] DELETE /identity/v3/projects/fcfeba8f31494231b0e7d9ae6f92570d => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:12.696144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:12.704265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:12.932156 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:13.020523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:13.021588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.021907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.022184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] PATH_INFO: `/v3/projects/8a01e29df907490aaa30e9b7f77ee406/users/b21288bea81c460291ad43b26f517457/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.026461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afbdd-af4d-4cce-9076-97f4fbf302e0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:13.053402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:13.055113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.055611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.063004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] PATH_INFO: `/v3/users/d8d1644b6b8840f5a1e442aa01504cd1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.080043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d1644b6b8840f5a1e442aa01504cd1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:13.083560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:13.109795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a01e29df907490aaa30e9b7f77ee406, user_id=b21288bea81c460291ad43b26f517457, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:13.113187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:13.166551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 993/2024] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:12 2022] PUT /identity/v3/projects/8a01e29df907490aaa30e9b7f77ee406/users/b21288bea81c460291ad43b26f517457/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:13.169843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:13.175229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:13.213290 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:13.454753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89aa7b-77af-4742-a617-e69641726f5b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:13.457911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d1644b6b8840f5a1e442aa01504cd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:13.462436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d1644b6b8840f5a1e442aa01504cd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:13.477995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:13.478707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.478992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.479319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.481299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:13.483035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:13.494777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d1644b6b8840f5a1e442aa01504cd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:13.516988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d1644b6b8840f5a1e442aa01504cd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:13.533846 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 994/2025] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:13.535109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:13.545550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:13.563415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c06d1c05-f6d9-4281-82d8-e9c879e10a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d1644b6b8840f5a1e442aa01504cd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:13.580405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370830-1422-4aaa-bf32-42c5d4d2b9e6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:13.584533 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1032/2026] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:12 2022] DELETE /identity/v3/users/d8d1644b6b8840f5a1e442aa01504cd1 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:13.718773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:13.719931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.720466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.720855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] PATH_INFO: `/v3/projects/8a01e29df907490aaa30e9b7f77ee406/users/b21288bea81c460291ad43b26f517457/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.725371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a01e29df907490aaa30e9b7f77ee406, user_id=b21288bea81c460291ad43b26f517457, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:13.730069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f2c4a-4f5b-4bb8-a237-e084929079f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:13.751847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 995/2027] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:13 2022] PUT /identity/v3/projects/8a01e29df907490aaa30e9b7f77ee406/users/b21288bea81c460291ad43b26f517457/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:13.765246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.765544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.765878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.819625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] MFA Rules not processed for user `b21288bea81c460291ad43b26f517457`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:13.821121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:13.935602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1033/2028] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:13.946445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:13.947444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:13.948031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:13.971791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] MFA Rules not processed for user `bfd5b02713f54950b7a5fae18bf4d485`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:13.973424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:14.108570 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:14.157555 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 996/2029] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:14.233220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:14.235076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:14.442349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e84b84-3435-4d55-9c13-8bc449e20fa1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:14.460946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:14.461913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:14.462203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:14.462483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:14.473423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:14.493460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:14.495770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57255-fe0a-4197-adbd-4693f91c75dd service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:14.522225 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:14.546583 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1034/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:14.758203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:14.758203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:14.945885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96295183-166c-49ed-9cc7-4c04ede39a58 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:14.958719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:14.959743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:14.959913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:14.962930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] PATH_INFO: `/v3/users/1416426260704ceca5211082c2399bca` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:14.967982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1416426260704ceca5211082c2399bca)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:14.972711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:15.112178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1416426260704ceca5211082c2399bca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:15.160901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1416426260704ceca5211082c2399bca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:15.175353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1416426260704ceca5211082c2399bca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:15.230205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1416426260704ceca5211082c2399bca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:15.232902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1416426260704ceca5211082c2399bca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:15.270050 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 997/2031] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:14 2022] DELETE /identity/v3/users/1416426260704ceca5211082c2399bca => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:15.275420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:15.276283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:15.278013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:15.360492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:15.363952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:15.621636 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1035/2032] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:15.703958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:15.706819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:15.854939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c54d0b-36d2-4af0-938f-c7941682d908 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:15.859718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:15.860845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:15.861350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:15.861917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:15.885189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:15.887225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563c0bd-a461-4cf6-9573-d869aed61145 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:15.912264 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 998/2033] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:16.188201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:16.191826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:16.230516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2947-82bc-4df2-a8ea-2f342613d3d5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:16.252487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:16.266546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:16.267060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:16.267657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] PATH_INFO: `/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:16.270228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4372ea6c414c96bf8f0a9854f0ba27)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:16.276752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:16.425124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4372ea6c414c96bf8f0a9854f0ba27', 'request_id': 'req-7a9d37ef-938e-445d-bb4d-3691a3190848'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:16.450278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4372ea6c414c96bf8f0a9854f0ba27', 'request_id': 'req-7a9d37ef-938e-445d-bb4d-3691a3190848'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:16.472111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4372ea6c414c96bf8f0a9854f0ba27', 'request_id': 'req-7a9d37ef-938e-445d-bb4d-3691a3190848'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:16.498475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] The token cache is being invalidate because project db4372ea6c414c96bf8f0a9854f0ba27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:16.499115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:16.500627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a9d37ef-938e-445d-bb4d-3691a3190848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:16.504009 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1036/2034] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:16 2022] DELETE /identity/v3/projects/db4372ea6c414c96bf8f0a9854f0ba27 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:16.511285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:16.512792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:16.513209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:16.583652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:16.614416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:16.617473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af572-d041-4aaa-b3ba-43b46987ef42 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:16.618032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af572-d041-4aaa-b3ba-43b46987ef42 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:16.618526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af572-d041-4aaa-b3ba-43b46987ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:16.708875 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:16.758009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7d2af572-d041-4aaa-b3ba-43b46987ef42 None None] MFA Rules not processed for user `bfd5b02713f54950b7a5fae18bf4d485`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:16.764706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7d2af572-d041-4aaa-b3ba-43b46987ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:17.029015 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 999/2035] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:17.030025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:17.032823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:17.070485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec75f2-515b-4263-90ff-3be308d74138 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:17.087616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:17.094607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:17.098488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:17.098488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] PATH_INFO: `/v3/projects/3d121ab923474b2ca0c274a943530dd2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:17.106376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d121ab923474b2ca0c274a943530dd2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:17.122564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1037/2036] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:17.130031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:17.130397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:17.130708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:17.131498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:17.173722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:17.175409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:17.213109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1038/2037] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:17.216396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:17.232466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112daac-67dd-4cc3-8b66-dc488bbba2ed None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:17.254623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:17.255701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:17.255701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:17.255910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:17.265842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:17.266307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:17.268763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:17.323746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1039/2038] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:17.326019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:17.338365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d121ab923474b2ca0c274a943530dd2', 'request_id': 'req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.356220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d121ab923474b2ca0c274a943530dd2', 'request_id': 'req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.387787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807f5a2-bb7d-4b53-9065-c499af015c04 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:17.401814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d121ab923474b2ca0c274a943530dd2', 'request_id': 'req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.460221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] The token cache is being invalidate because project 3d121ab923474b2ca0c274a943530dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:17.460584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.461583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.468541 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:17.471565 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1000/2039] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:17 2022] DELETE /identity/v3/projects/3d121ab923474b2ca0c274a943530dd2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:17.476518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:17.479165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:17.696692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:17.699610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:17.701076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:17.703485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:17.709883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1839c-53aa-4dfa-98ea-1dbd2d038a3b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:17.719690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:17.722119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:17.722513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:17.722872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] PATH_INFO: `/v3/users/827c014b86144856912587798bc424cc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:17.727906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:17.728427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=827c014b86144856912587798bc424cc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:17.731556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:17.736087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:17.863012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827c014b86144856912587798bc424cc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.865595 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:17.880916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827c014b86144856912587798bc424cc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.892141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827c014b86144856912587798bc424cc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.900313 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1040/2040] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:17 2022] POST /identity/v3/projects => generated 399 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:17.902758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:17.911147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827c014b86144856912587798bc424cc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.912151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827c014b86144856912587798bc424cc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:17.924289 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1001/2041] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:17 2022] DELETE /identity/v3/users/827c014b86144856912587798bc424cc => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:17.931231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:18.306340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131db66-c8a9-4554-a0f2-57a51681e24d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:18.649411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:18.650729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:18.651318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:18.652191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:18.653856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:18.670969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:18.777429 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1041/2042] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:17 2022] POST /identity/v3/users => generated 300 bytes in 876 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:18.787777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:18.793478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:18.806454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:18.825897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:18.857635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269cb9-00f3-4086-8c26-fc1c9d8adc1a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:18.881747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa41e-1b7b-432e-9b3c-d859e8c0829d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:18.898618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:18.900111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:18.900617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:18.901925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] PATH_INFO: `/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:18.904183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9016477f5fb4f8ca9ae1e2cd9140f1f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:18.906916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:18.915527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:18.917361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:18.918386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:18.923415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:18.925070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:18.934186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:18.966833 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1002/2043] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:18.972256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.008737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a7514-6f6a-4bfe-8e4f-df9cafe392e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:19.040221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:19.048894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.049695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.050123 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:19.050655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.055217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:19.077224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:19.164575 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1003/2044] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:19.166169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.183765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9016477f5fb4f8ca9ae1e2cd9140f1f', 'request_id': 'req-4641bca6-d63a-4893-89d9-678d5720d244'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:19.192982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de517a83-c92b-4586-bd5d-6defadc15462 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:19.212586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9016477f5fb4f8ca9ae1e2cd9140f1f', 'request_id': 'req-4641bca6-d63a-4893-89d9-678d5720d244'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:19.239476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9016477f5fb4f8ca9ae1e2cd9140f1f', 'request_id': 'req-4641bca6-d63a-4893-89d9-678d5720d244'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:19.293306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] The token cache is being invalidate because project e9016477f5fb4f8ca9ae1e2cd9140f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:19.294057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:19.298198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4641bca6-d63a-4893-89d9-678d5720d244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:19.307760 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1042/2045] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:18 2022] DELETE /identity/v3/projects/e9016477f5fb4f8ca9ae1e2cd9140f1f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:19.314682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbf51-4662-4fb1-80b3-248d96d012bf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.315537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbf51-4662-4fb1-80b3-248d96d012bf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.316221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fbf51-4662-4fb1-80b3-248d96d012bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.321286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:19.326171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.326549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.326895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] PATH_INFO: `/v3/projects/f8249364e75f4359877fce7cf0eebd6b/users/f22e08f30fbd4508b91385ff807ee1ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.372704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9c4fbf51-4662-4fb1-80b3-248d96d012bf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:19.375920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9c4fbf51-4662-4fb1-80b3-248d96d012bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:19.376383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8249364e75f4359877fce7cf0eebd6b, user_id=f22e08f30fbd4508b91385ff807ee1ac, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:19.384898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587bf233-3a2f-4bef-9ee4-3fd75d1c98e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:19.397413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1043/2046] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:19.411070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.411447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.412185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.442288 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1004/2047] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:19 2022] PUT /identity/v3/projects/f8249364e75f4359877fce7cf0eebd6b/users/f22e08f30fbd4508b91385ff807ee1ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:19.444333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.444624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.444908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.488026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:19.490027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:19.547483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] MFA Rules not processed for user `f22e08f30fbd4508b91385ff807ee1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:19.566414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:19.618842 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1044/2048] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:19.622201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.634623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e260bc2-f556-4143-ad74-afe6d16b8e55 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:19.641921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:19.643078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.643541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.643962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.646616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:19.647144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:19.649131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:19.673958 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1045/2049] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:19.675642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.700798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5b1bf-8fdd-4b31-84fc-f1450ce96e08 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:19.717636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:19.718847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:19.719297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:19.719721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:19.720831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:19.728233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:19.829299 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1046/2050] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:19.834546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.926964 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1005/2051] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:19.931536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:19.933467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:19.970244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853e05b-5f60-42fc-b2fa-5f696dc6bb5d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:19.998526 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:20.032041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fb541-748c-43e1-81e0-721551bc9a10 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.047198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.047983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.048380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.048656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.049896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.054082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.140652 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1047/2052] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:20.141525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.163728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.164428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.164710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.164985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.165769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:20.169771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.178352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.183012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ad09-d152-4c9b-9ae5-27f5cff63d92 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.200328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.201189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.201474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.201778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.202563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.205238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.235620 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1048/2053] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:20.236777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.260672 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1006/2054] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:19 2022] POST /identity/v3/projects => generated 395 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:20.261950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.275329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdb6d-6d5c-433c-bddb-cd84f19a2bcb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.433373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928eed0-daca-4e33-8952-9a4f8172e826 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.451956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.452743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.453128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.453590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.454471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.456975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.486575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.488283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.488641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.488996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.489863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.491760 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1007/2055] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:20 2022] POST /identity/v3/users => generated 304 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:20.491928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.500115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.522152 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1049/2056] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:20.525070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.561051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befb62b-156b-42ae-acf4-efa198992e76 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.564443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22ba2f-9b13-464f-8105-26656c126852 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.585792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.586747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.587679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.587958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.588237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] PATH_INFO: `/v3/projects/69a0aac42f6042fa92a841f661d06e3f/users/c5f9ae6edb5c404d85403c6a351ff245/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.593145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.593343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.593576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.597697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.599407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.645825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1008/2057] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:20.647941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:20.663867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a0aac42f6042fa92a841f661d06e3f, user_id=c5f9ae6edb5c404d85403c6a351ff245, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.671233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678096-d2f3-402b-96ca-7462408783a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.698429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700796-ba65-4de4-9057-264b91d1dc64 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:20.715387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1050/2058] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:20 2022] PUT /identity/v3/projects/69a0aac42f6042fa92a841f661d06e3f/users/c5f9ae6edb5c404d85403c6a351ff245/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:20.728617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:20.730548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.730823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.731106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] PATH_INFO: `/v3/projects/222bab9a1b974b4abc3219746c8606e0/users/407c887cb9244591a3d4557e2222889d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.733242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:20.733534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:20.733841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:20.794010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222bab9a1b974b4abc3219746c8606e0, user_id=407c887cb9244591a3d4557e2222889d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:20.796832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:20.832441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] MFA Rules not processed for user `c5f9ae6edb5c404d85403c6a351ff245`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:20.833776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:20.842723 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1009/2059] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:20 2022] PUT /identity/v3/projects/222bab9a1b974b4abc3219746c8606e0/users/407c887cb9244591a3d4557e2222889d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:20.848602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.035520 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:21.048730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65c7d6-39c5-450c-9756-f27789ddb960 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:21.063761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:21.064475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:21.064758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:21.065158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:21.066000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:21.072493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:21.116521 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1010/2060] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:21.123037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.149423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62aef-0f02-45f4-9c3d-0d3ebfa11eb8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:21.177402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:21.178365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:21.178648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:21.178929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] PATH_INFO: `/v3/projects/222bab9a1b974b4abc3219746c8606e0/users/407c887cb9244591a3d4557e2222889d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:21.185437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222bab9a1b974b4abc3219746c8606e0, user_id=407c887cb9244591a3d4557e2222889d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:21.188734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cc066-6403-4bd0-8235-9f3a93e53545 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:21.244076 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1051/2061] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:21.244296 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1011/2062] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:21 2022] PUT /identity/v3/projects/222bab9a1b974b4abc3219746c8606e0/users/407c887cb9244591a3d4557e2222889d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:21.265002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.265145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:21.265341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:21.265623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:21.301530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42124251-5106-4e1f-8726-f316a4b946a8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:21.394535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] MFA Rules not processed for user `407c887cb9244591a3d4557e2222889d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:21.396184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:21.504615 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:21.558235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:21.558888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:21.559542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:21.561501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:21.563445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:21.569196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:21.673855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1012/2063] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:21.675215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.676747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:21.701170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f643-80ba-4cf0-a7e4-f1f718672d6e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:21.706923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:21.708077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:21.708533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:21.708918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] PATH_INFO: `/v3/users/f1a30d650263498d9d81b314b4fca6f0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:21.713643 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1052/2064] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:21 2022] POST /identity/v3/projects => generated 377 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:21.713995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a30d650263498d9d81b314b4fca6f0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:21.714073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.714343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:21.723422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:21.822272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a30d650263498d9d81b314b4fca6f0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:21.848772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a30d650263498d9d81b314b4fca6f0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:21.887517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a30d650263498d9d81b314b4fca6f0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:21.952712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a30d650263498d9d81b314b4fca6f0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:21.953805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a30d650263498d9d81b314b4fca6f0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:21.965804 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1013/2065] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:21 2022] DELETE /identity/v3/users/f1a30d650263498d9d81b314b4fca6f0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:21.967029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:21.973447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:22.004306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ce9c2-5104-4ecf-8200-87e13824d7d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.121493 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:22.194352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f01fa-2d6a-4586-9f57-88d7b23f8037 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.208751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.209385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.210062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.210062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.213149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.218525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abab34e-e149-4b02-84cb-f12ecb629746 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.235092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.236054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.236499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.236788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.240818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:22.272750 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1014/2066] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:21 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:22.272750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e366c3-328f-43d3-830c-ff03af784f53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.273179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e366c3-328f-43d3-830c-ff03af784f53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.274083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e366c3-328f-43d3-830c-ff03af784f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.328545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-02e366c3-328f-43d3-830c-ff03af784f53 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:22.331227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-02e366c3-328f-43d3-830c-ff03af784f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:22.353101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1015/2067] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:22.356234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d12-a1b2-4c75-86f3-3ac2a730d77f None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.358171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d12-a1b2-4c75-86f3-3ac2a730d77f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.358756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d12-a1b2-4c75-86f3-3ac2a730d77f None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.360798 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1016/2068] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:09:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:22.362128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7d12-a1b2-4c75-86f3-3ac2a730d77f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:22.390374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7d12-a1b2-4c75-86f3-3ac2a730d77f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.398897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.400420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.401855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.402621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.404383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.407048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.428909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1017/2069] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:22.430549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:22.435386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:22.438843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.442984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.467634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1053/2070] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:22.469088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:22.502669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314fd31-b26a-4b3b-88b6-0dc964e9db34 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.528558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.530227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.530737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.531251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] PATH_INFO: `/v3/projects/b34b2b2fc8f345568bea78b9fdc860df/users/7fa78d4aec664a10887217fee117a469/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.640983 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:22.669240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34b2b2fc8f345568bea78b9fdc860df, user_id=7fa78d4aec664a10887217fee117a469, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.681147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1ce7-af59-4a5a-b059-223128ffad4d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.691977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823ad9d-55df-45a9-a977-f3cc9900b960 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.700566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.701284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.701574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.701916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.741937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1054/2071] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:22 2022] PUT /identity/v3/projects/b34b2b2fc8f345568bea78b9fdc860df/users/7fa78d4aec664a10887217fee117a469/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:22.746273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a51e0-a52f-4907-a938-c8a8d9863c90 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.747810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a51e0-a52f-4907-a938-c8a8d9863c90 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.747810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a51e0-a52f-4907-a938-c8a8d9863c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.753352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.756713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.799169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b39a51e0-a52f-4907-a938-c8a8d9863c90 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:22.808310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b39a51e0-a52f-4907-a938-c8a8d9863c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:22.833243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1018/2072] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:22.841433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:22.881637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def30fe-59a1-4a12-a2f7-a5fbd2e93ef5 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:22.970261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:22.971009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:22.971302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:22.971584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:22.972347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:22.974573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:22.992895 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1019/2073] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:22.994219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:23.028826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef586-0432-4b60-b7fe-655bc70cd765 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:23.056284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:23.057587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:23.060531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:23.061325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] PATH_INFO: `/v3/projects/b34b2b2fc8f345568bea78b9fdc860df/users/7fa78d4aec664a10887217fee117a469/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:23.074438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34b2b2fc8f345568bea78b9fdc860df, user_id=7fa78d4aec664a10887217fee117a469, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:23.083242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:23.117053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1055/2074] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:23.129091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1020/2075] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:22 2022] PUT /identity/v3/projects/b34b2b2fc8f345568bea78b9fdc860df/users/7fa78d4aec664a10887217fee117a469/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:23.143743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:23.146443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:23.147046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:23.159235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:23.162404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:23.239914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] MFA Rules not processed for user `7fa78d4aec664a10887217fee117a469`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:23.242272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:23.303072 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:23.441149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e49b-18ce-43f8-b529-e65da41180f1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:23.458486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:23.460253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:23.461747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:23.461747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:23.467382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:23.525040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1056/2076] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:23.526621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:23.529652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:23.631870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:23.634434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:23.654177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1021/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:23.717849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b257-6579-42cd-b264-6d4277e2769a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:23.723969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:23.724782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:23.725381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:23.726293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:23.738973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:23.741144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:23.748487 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:23.753906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1057/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:23.804375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:23.821001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ebf7-ec86-4b79-ae7d-2f014d9905d2 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:23.838254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:23.839036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:23.839380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:23.839794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:23.854701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:23.857504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:23.879243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1022/2079] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:24.133470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:24.136108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:24.156286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281ebb-d93f-4c14-a3f5-52c4c9527d8b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:24.163483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:24.164930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:24.165515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:24.165938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:24.169962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:24.269564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:24.271788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:24.285628 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1058/2080] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:24.902664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:24.911712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:25.064815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24f620-cf09-4d33-9d7f-79b818ce6832 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:25.088653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:25.089743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:25.090131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:25.091197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] PATH_INFO: `/v3/projects/dd53a8a88895489eb82bd671379ee52a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:25.092843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd53a8a88895489eb82bd671379ee52a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:25.095651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:25.185132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd53a8a88895489eb82bd671379ee52a', 'request_id': 'req-73c87dbf-ffb9-4591-967b-039aaf2c7c58'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.202145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd53a8a88895489eb82bd671379ee52a', 'request_id': 'req-73c87dbf-ffb9-4591-967b-039aaf2c7c58'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.204675 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:25.214583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd53a8a88895489eb82bd671379ee52a', 'request_id': 'req-73c87dbf-ffb9-4591-967b-039aaf2c7c58'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.305796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] The token cache is being invalidate because project dd53a8a88895489eb82bd671379ee52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:25.306017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.308746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.313404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:25.325147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1023/2081] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:24 2022] DELETE /identity/v3/projects/dd53a8a88895489eb82bd671379ee52a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:25.329526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:25.332316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:25.336251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b2f78-3dd1-47b2-b3be-3f1238cccfed service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:25.503237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:25.504031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:25.504319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:25.504602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:25.508108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:25.574645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c87dbf-ffb9-4591-967b-039aaf2c7c58 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:25.591770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:25.593742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:25.594562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:25.595494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] PATH_INFO: `/v3/users/df49d297ac6149d89812ad6595b43103` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:25.597892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df49d297ac6149d89812ad6595b43103)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:25.600664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:25.602542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdde4f4-c0a9-4e0d-8086-21ed1c402bb6 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:25.606073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:25.620519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1059/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:25.699399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44408e-a42d-4696-a739-0e2c264e843d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:25.700001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44408e-a42d-4696-a739-0e2c264e843d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:25.700485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44408e-a42d-4696-a739-0e2c264e843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:25.728885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cf44408e-a42d-4696-a739-0e2c264e843d None None] MFA Rules not processed for user `d9d620962dcc40a8afaf6f97ae605eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:25.730456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cf44408e-a42d-4696-a739-0e2c264e843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:25.770617 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:25.846651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df49d297ac6149d89812ad6595b43103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.880479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df49d297ac6149d89812ad6595b43103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.900812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1060/2083] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:25.928565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df49d297ac6149d89812ad6595b43103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.984177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df49d297ac6149d89812ad6595b43103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:25.985292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b07cd82-976f-4ae7-a671-650cc0489348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df49d297ac6149d89812ad6595b43103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:26.006110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1024/2084] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:25 2022] DELETE /identity/v3/users/df49d297ac6149d89812ad6595b43103 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:27.140224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:27.140224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:27.141308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:27.142413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1061/2085] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:27.155825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:27.156671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:27.156671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:27.209500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:27.211307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:27.322352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:27.325147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:27.458446 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:27.496042 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1025/2086] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:27.503379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:27.519480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:27.533905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937af92-d47d-48e3-b312-5d94b4e131df None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:27.546927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bed39-d437-43f7-adbc-8af20be1a281 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:27.563188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:27.564414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:27.565342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:27.565630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:27.565947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] PATH_INFO: `/v3/projects/0ec749645f4f431da4417b69517c577f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:27.566371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:27.566984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:27.569095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec749645f4f431da4417b69517c577f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:27.569465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] PATH_INFO: `/v3/users/f22e08f30fbd4508b91385ff807ee1ac` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:27.571189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22e08f30fbd4508b91385ff807ee1ac)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:27.572190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:27.578449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:27.715103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22e08f30fbd4508b91385ff807ee1ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.727750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec749645f4f431da4417b69517c577f', 'request_id': 'req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.731985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22e08f30fbd4508b91385ff807ee1ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.741713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22e08f30fbd4508b91385ff807ee1ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.760125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec749645f4f431da4417b69517c577f', 'request_id': 'req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.760594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22e08f30fbd4508b91385ff807ee1ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.762293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22e08f30fbd4508b91385ff807ee1ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.773286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1026/2087] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:27 2022] DELETE /identity/v3/users/f22e08f30fbd4508b91385ff807ee1ac => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:27.774863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:27.777447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:27.794587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec749645f4f431da4417b69517c577f', 'request_id': 'req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.828283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] The token cache is being invalidate because project 0ec749645f4f431da4417b69517c577f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:27.828283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.830165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8f54e97a-9a60-4e8c-87de-439b55c2b2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:27.839930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1062/2088] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:27 2022] DELETE /identity/v3/projects/0ec749645f4f431da4417b69517c577f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:27.841715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9d865-7f9c-40c2-a902-97a5ce6a07ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:27.842176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9d865-7f9c-40c2-a902-97a5ce6a07ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:27.842466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9d865-7f9c-40c2-a902-97a5ce6a07ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:27.895700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ec9d865-7f9c-40c2-a902-97a5ce6a07ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:27.898678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ec9d865-7f9c-40c2-a902-97a5ce6a07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.036122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf43c2-b566-4bea-b1b8-1da09e5cc058 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:28.049442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:28.050160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.050435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.050713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.055597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.060608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1063/2089] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:28.063182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad607-51da-43a6-94d0-ec055ef6d39a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.063469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad607-51da-43a6-94d0-ec055ef6d39a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.063781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad607-51da-43a6-94d0-ec055ef6d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.087584 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:28.088347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:28.092080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:28.119660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-218ad607-51da-43a6-94d0-ec055ef6d39a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:28.119660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-218ad607-51da-43a6-94d0-ec055ef6d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.124333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1027/2090] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:28.127254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:28.131021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.152249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1064/2091] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:28.165869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.166174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.167015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.220890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:28.223737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.263012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1065/2092] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:28.265468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:28.298126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360471d-efb9-4a10-b594-ff6f53b82369 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:28.317947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:28.321972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.324512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.325256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.325594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f76e-a664-44b4-8ed6-14bff6aaec68 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:28.328561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:28.334447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:28.337636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:28.349842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:28.351571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.351899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.352592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.380988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1066/2093] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:28.387451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:28.393514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:28.402077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:28.426052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62457-6f9d-476b-a789-f19c62cb6773 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:28.432917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:28.437287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:28.437575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:28.441433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:28.442573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:28.446033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1028/2094] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:28.450143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:28.585955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:28.598340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1067/2095] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:28 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:28.599646 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:28.608453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:28.616228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:28.629234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c6384-d9fc-4774-9f26-d918d6132f66 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:29.095048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:29.096236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.096763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.097263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.134084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:29.155537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:29.167913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e7c84-25ff-4885-9a41-a0b2b9d8a493 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:29.184357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:29.187921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.188780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.204615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.210040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1029/2096] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:28 2022] POST /identity/v3/users => generated 292 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:29.215794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:29.217023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:29.236555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7c99f-6f40-4bed-9894-f2d1e3621a53 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:29.260431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:29.261278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:29.261405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.261563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.261867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.262640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:29.264054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:29.264282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:29.291507 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1030/2097] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:29.297153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1068/2098] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:29.297481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:29.314486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b20d-5093-4f34-9166-7b9260f09838 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:29.334031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:29.334736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.335020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.335290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.336055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:29.338944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ad260-ea56-446b-8ba6-9bcf03661604 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:29.378872 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1031/2099] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:29.382781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:29.409175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a02e9-841b-4926-bdcd-662c000ad1ea service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:29.442073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:29.444227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.446245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.446552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] PATH_INFO: `/v3/projects/503784753839487d8ebe2d47c3c88da6/users/482d5c4231dd42f8a2a1f8d54d63ec89/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.485563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503784753839487d8ebe2d47c3c88da6, user_id=482d5c4231dd42f8a2a1f8d54d63ec89, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:29.506279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:29.537479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1069/2100] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:29 2022] PUT /identity/v3/projects/503784753839487d8ebe2d47c3c88da6/users/482d5c4231dd42f8a2a1f8d54d63ec89/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:29.552277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.552740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.553480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.638251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] MFA Rules not processed for user `482d5c4231dd42f8a2a1f8d54d63ec89`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:29.647758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:29.800692 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1032/2101] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:29.843455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:29.857538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:29.873807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:29.876489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:30.205572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5bc-ffb5-4ef9-9b58-ae632d7abe84 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:30.221363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:30.223253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:30.224182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:30.224928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:30.254637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf427d-7e37-4ac7-a259-e83a8ae5d7dd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:30.267577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:30.270467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:30.280980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:30.284228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:30.284975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:30.286768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] PATH_INFO: `/v3/projects/f8249364e75f4359877fce7cf0eebd6b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:30.290009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8249364e75f4359877fce7cf0eebd6b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:30.301576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:30.310111 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:30.351562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1070/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:30.499368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:30.502734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:30.529284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8249364e75f4359877fce7cf0eebd6b', 'request_id': 'req-dc4dd115-a416-46af-8ee8-c56b5e6f4435'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:30.570968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8249364e75f4359877fce7cf0eebd6b', 'request_id': 'req-dc4dd115-a416-46af-8ee8-c56b5e6f4435'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:30.600474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8249364e75f4359877fce7cf0eebd6b', 'request_id': 'req-dc4dd115-a416-46af-8ee8-c56b5e6f4435'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:30.627784 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:30.668237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] The token cache is being invalidate because project f8249364e75f4359877fce7cf0eebd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:30.668754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:30.673133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:30.678098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1033/2103] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:29 2022] DELETE /identity/v3/projects/f8249364e75f4359877fce7cf0eebd6b => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:30.687086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:30.689835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:30.802556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec33212-fda8-4c59-a8ec-719c629bd8e4 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:30.900220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dd115-a416-46af-8ee8-c56b5e6f4435 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:30.913811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:30.915999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:30.917577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:30.918467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] PATH_INFO: `/v3/users/407c887cb9244591a3d4557e2222889d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:30.925214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407c887cb9244591a3d4557e2222889d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:30.930727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:30.940166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:30.940845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:30.941125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:30.941399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:30.943811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.043980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407c887cb9244591a3d4557e2222889d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:31.055347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407c887cb9244591a3d4557e2222889d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:31.067043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407c887cb9244591a3d4557e2222889d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:31.088776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407c887cb9244591a3d4557e2222889d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:31.091264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53e90cbf-1f55-47a7-8938-4eb09e9889f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407c887cb9244591a3d4557e2222889d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:31.105210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1034/2104] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:30 2022] DELETE /identity/v3/users/407c887cb9244591a3d4557e2222889d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:31.107373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33e3c-1112-4ba4-9967-c787dafbda33 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.108091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33e3c-1112-4ba4-9967-c787dafbda33 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.108091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c33e3c-1112-4ba4-9967-c787dafbda33 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.111164 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1035/2105] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:31.132648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36651ea4-1f2a-4625-987f-8a82d62bf2db None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.132936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36651ea4-1f2a-4625-987f-8a82d62bf2db None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.133215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36651ea4-1f2a-4625-987f-8a82d62bf2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.151461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:31.157469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:31.164950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-36651ea4-1f2a-4625-987f-8a82d62bf2db None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:31.168266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36651ea4-1f2a-4625-987f-8a82d62bf2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.179940 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:31.184334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1071/2106] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:31.313996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1036/2107] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:31.340345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:31.342179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.456675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d316-95e8-4984-854f-c980024bf188 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:31.469735 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:31.537344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:31.538664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.540427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.540941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.567295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:31.569430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:31.589108 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1072/2108] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:31.683974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933295c3-48f2-46c3-9e49-424874761252 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.686574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933295c3-48f2-46c3-9e49-424874761252 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.687213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933295c3-48f2-46c3-9e49-424874761252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.737308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-933295c3-48f2-46c3-9e49-424874761252 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:31.739137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-933295c3-48f2-46c3-9e49-424874761252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.747167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1037/2109] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:31.770714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:31.774286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.826355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933295c3-48f2-46c3-9e49-424874761252 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:31.829244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-933295c3-48f2-46c3-9e49-424874761252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.866026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933295c3-48f2-46c3-9e49-424874761252 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:31.881656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:31.882719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.883227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.883770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.920900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:31.928553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838aba-a1ab-4621-a4a4-96c8f5557837 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:31.972322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1038/2110] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:31.988084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b8381-4a76-4742-ba0e-be1aa46c1439 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:32.002935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:32.004919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:32.006352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:32.008452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] PATH_INFO: `/v3/users/482d5c4231dd42f8a2a1f8d54d63ec89` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:32.011310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482d5c4231dd42f8a2a1f8d54d63ec89)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:32.016335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:32.210547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482d5c4231dd42f8a2a1f8d54d63ec89'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.211650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482d5c4231dd42f8a2a1f8d54d63ec89'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.233377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482d5c4231dd42f8a2a1f8d54d63ec89'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.255808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482d5c4231dd42f8a2a1f8d54d63ec89'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.324847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482d5c4231dd42f8a2a1f8d54d63ec89'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.341132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1073/2111] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:31 2022] DELETE /identity/v3/users/482d5c4231dd42f8a2a1f8d54d63ec89 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:32.348220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:32.349813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:32.351838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:32.404194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:32.408881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:32.605261 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1039/2112] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:32.643933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:32.647027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:32.648296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:32.650781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:32.680164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d7303-bd6b-4959-948e-102da6343b46 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:32.713269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:32.714774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:32.715231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:32.715645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] PATH_INFO: `/v3/projects/222bab9a1b974b4abc3219746c8606e0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:32.717236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222bab9a1b974b4abc3219746c8606e0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:32.719493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:32.827913 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:32.868240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222bab9a1b974b4abc3219746c8606e0', 'request_id': 'req-db4705bb-4f3d-49fa-b139-109570108fb2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.875723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222bab9a1b974b4abc3219746c8606e0', 'request_id': 'req-db4705bb-4f3d-49fa-b139-109570108fb2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.875936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c07fab-2dd8-4fb7-b6b0-9a362bc792df None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:32.892029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222bab9a1b974b4abc3219746c8606e0', 'request_id': 'req-db4705bb-4f3d-49fa-b139-109570108fb2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.928800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] The token cache is being invalidate because project 222bab9a1b974b4abc3219746c8606e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:32.928800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.929654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db4705bb-4f3d-49fa-b139-109570108fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:32.933326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1074/2113] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:32 2022] DELETE /identity/v3/projects/222bab9a1b974b4abc3219746c8606e0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:32.939418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db81dab-aaf4-4575-89ff-49cb16cd4b76 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:32.939941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db81dab-aaf4-4575-89ff-49cb16cd4b76 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:32.940201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db81dab-aaf4-4575-89ff-49cb16cd4b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:32.977304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0db81dab-aaf4-4575-89ff-49cb16cd4b76 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:32.977881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0db81dab-aaf4-4575-89ff-49cb16cd4b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:32.994764 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:33.079831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.081940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.084104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.085033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.104999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:33.145726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1075/2114] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:33.153730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.154937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.155397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.201693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:33.202995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:33.232043 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1076/2115] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:33.237533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.270336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a88f4c-71b2-4a1b-9131-9a5cbb52474f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.286226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.287748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.288896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.289595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.290073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.290487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.292050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:33.297221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.299270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.317351 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1040/2116] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:33.324144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1077/2117] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:33.330536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.344339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29c11-c8d5-46da-83e4-9b5e88214c40 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.361510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.364135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.366468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.367149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.369017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.374402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.466600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.468530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1041/2118] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:33 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:33.481472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e8f0-892c-429b-af73-fe09cdda3cbb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.654019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.655004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.655470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.655894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.656801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.659518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.699737 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1078/2119] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:33 2022] POST /identity/v3/users => generated 305 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:09:33.707801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.734084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.736248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:33.755677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dcc88-5c12-4282-ad19-da173df25d65 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.756613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d8eef-9a60-4a96-955e-94fe37af0bbf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.763596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.764667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.765013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.765297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] PATH_INFO: `/v3/users/4f5199ed3f0a4ae9a9f13c9561f888b0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.767655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5199ed3f0a4ae9a9f13c9561f888b0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.770337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.778101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.779047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.779337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.779612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.780499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.782465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.817503 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:33.842179 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1042/2120] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:33.844880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:33.895039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7864c0-9078-4f9a-a12d-8d9668ed11fb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:33.909505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5199ed3f0a4ae9a9f13c9561f888b0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:33.914860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5199ed3f0a4ae9a9f13c9561f888b0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:33.926598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:33.928500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:33.928977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:33.929710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:33.934069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:33.942966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5199ed3f0a4ae9a9f13c9561f888b0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:33.943967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:33.972999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5199ed3f0a4ae9a9f13c9561f888b0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.006719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7a15b3fb-4b62-472b-b5d1-aa73eba000e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5199ed3f0a4ae9a9f13c9561f888b0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.007508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1043/2121] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:34.009254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:34.012812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:34.029549 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1079/2122] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:33 2022] DELETE /identity/v3/users/4f5199ed3f0a4ae9a9f13c9561f888b0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:34.059965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6e288-8edd-4c11-8f6c-ffb26f680f30 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:34.202101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:34.205230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.205829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.206285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] PATH_INFO: `/v3/projects/ae313a73b87e46b8bba18fc93f680fc2/users/96a45526bcbd48c2a255fb736e8cb94a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.238757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae313a73b87e46b8bba18fc93f680fc2, user_id=96a45526bcbd48c2a255fb736e8cb94a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:34.246805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:34.271124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1044/2123] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:34 2022] PUT /identity/v3/projects/ae313a73b87e46b8bba18fc93f680fc2/users/96a45526bcbd48c2a255fb736e8cb94a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:34.288546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.288909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.289180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.342676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] MFA Rules not processed for user `96a45526bcbd48c2a255fb736e8cb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:34.350584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:34.352427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:34.355275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:34.423334 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:34.479121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff519e9-dc42-41c7-9278-0f1d099882c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:34.487213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:34.489387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.490026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.490499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] PATH_INFO: `/v3/projects/503784753839487d8ebe2d47c3c88da6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.492131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503784753839487d8ebe2d47c3c88da6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:34.496015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:34.608871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503784753839487d8ebe2d47c3c88da6', 'request_id': 'req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.623496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503784753839487d8ebe2d47c3c88da6', 'request_id': 'req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.633522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503784753839487d8ebe2d47c3c88da6', 'request_id': 'req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.660027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] The token cache is being invalidate because project 503784753839487d8ebe2d47c3c88da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:34.660360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.661551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a112d54-8ff7-4640-8fc0-c06e3cbab1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:34.664087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1045/2124] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:34 2022] DELETE /identity/v3/projects/503784753839487d8ebe2d47c3c88da6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:34.672983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666411-b292-459f-bae4-0fc26baae89c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.673455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666411-b292-459f-bae4-0fc26baae89c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.673753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666411-b292-459f-bae4-0fc26baae89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.705938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1080/2125] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:34.712409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:34.745305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235020d2-9878-4bbe-9daa-85c4b1aaa660 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:34.763072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-20666411-b292-459f-bae4-0fc26baae89c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:34.765776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-20666411-b292-459f-bae4-0fc26baae89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:34.866519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:34.867720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.868221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.870243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.871462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:34.874569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:34.977310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1046/2126] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:34.987466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:34.988220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:34.988828 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1081/2127] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:34 2022] POST /identity/v3/projects => generated 409 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:34.989875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:34.990804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:34.997642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:35.046966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:35.049155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:35.053143 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:35.195388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb9f0-43c5-4911-8c81-62d4be0a3808 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.201090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.202946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.203290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.203558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.204301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.207023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.248595 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1082/2128] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:34 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:35.254340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.290412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5c71-bfaa-43e6-b1e9-eaf0d933cab4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.304475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.304800 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:35.305578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.307139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.307996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.310221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.312993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.340070 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1047/2129] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:35.346875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.360045 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1083/2130] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:35.362544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.383269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30126-282a-43bb-a006-41d22fc6340f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.395176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4f32-56a3-443c-a6db-d9ee85de64d3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.406516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.410725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.411322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.411754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.412749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:35.413465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.416393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.441128 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1048/2131] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:35.442690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.444727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.456780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747522e-2e63-429a-bd70-ba47c2fb6ff1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.458032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.459299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.459972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] PATH_INFO: `/v3/projects/ae9b8dfe882846c490521313a74d78da/users/e19f1628b0044d99a21c2d70165ca207/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.463968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.465424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.466065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.466494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.470373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.473102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.523926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1049/2132] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:35 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:35.524946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.551672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9b8dfe882846c490521313a74d78da, user_id=e19f1628b0044d99a21c2d70165ca207, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.557569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.630939 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1084/2133] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:35 2022] PUT /identity/v3/projects/ae9b8dfe882846c490521313a74d78da/users/e19f1628b0044d99a21c2d70165ca207/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:35.633472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.688498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ea5-35de-482a-9095-2f53d7027e69 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.791764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.792885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.793416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.794032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.794977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.822053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.861087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1050/2134] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:35 2022] POST /identity/v3/users => generated 294 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:35.865180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.874662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afc69c-1375-4d30-abda-be21064e8efa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.878853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a73bf-5b02-4e1c-b62d-643554689a43 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.885429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.886227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.886429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.886807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.887319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.888206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.888598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.889328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.890047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.890383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.892349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.895913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.905255 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1051/2135] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:35.910540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.926946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1085/2136] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:35.927250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbd097-4670-44f7-ab50-25e669106422 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.933990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.943767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.944947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.945565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.946029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.947390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.951837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.958999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913bf3-52de-4109-94c2-c00b85c42a81 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.968454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.970921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.971737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:35.972420 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1052/2137] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:35.972768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] PATH_INFO: `/v3/projects/ae9b8dfe882846c490521313a74d78da/users/e19f1628b0044d99a21c2d70165ca207/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:35.976583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:35.978693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9b8dfe882846c490521313a74d78da, user_id=e19f1628b0044d99a21c2d70165ca207, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:35.985411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf47630-1898-469a-b964-d735a95e7457 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:35.989965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139f51-f2c5-4b0b-ad59-b84d4b4ac4f0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:35.997976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:35.998982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:35.999451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.000194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] PATH_INFO: `/v3/projects/7a228611da9b47f785568447a4caa0eb/users/1070815bb60c44fcb6a586fd2d1f6e71/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.010424 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1086/2138] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:35 2022] PUT /identity/v3/projects/ae9b8dfe882846c490521313a74d78da/users/e19f1628b0044d99a21c2d70165ca207/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:36.032540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:36.034705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a228611da9b47f785568447a4caa0eb, user_id=1070815bb60c44fcb6a586fd2d1f6e71, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:36.035768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.038254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.038477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d677c0-31ab-49dc-9b46-62a8fc3bf22c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:36.106737 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1053/2139] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:35 2022] PUT /identity/v3/projects/7a228611da9b47f785568447a4caa0eb/users/1070815bb60c44fcb6a586fd2d1f6e71/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:36.121364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:36.124073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.124073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.183840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] MFA Rules not processed for user `e19f1628b0044d99a21c2d70165ca207`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:36.187237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:36.242583 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:36.254188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] MFA Rules not processed for user `1070815bb60c44fcb6a586fd2d1f6e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:36.255494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:36.319151 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:36.483500 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1087/2140] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:36.486531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:36.500506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:36.532623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1054/2141] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:36.537289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:36.668216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c5b16-3497-4f35-a683-64bfa04597d8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:36.684569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:36.686034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:36.686389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.686894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.688415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:36.692880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:36.711650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd0d08-aab4-481d-86ea-22a7c39582a3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:36.719081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:36.720420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:36.720728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.721130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] PATH_INFO: `/v3/projects/f8ed62c1e54848f488f832ca1b222b83` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.722691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ed62c1e54848f488f832ca1b222b83)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:36.725003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:36.766893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1055/2142] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:36 2022] POST /identity/v3/projects => generated 389 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:09:36.768556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:36.771767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:36.833144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ed62c1e54848f488f832ca1b222b83', 'request_id': 'req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:36.842588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ed62c1e54848f488f832ca1b222b83', 'request_id': 'req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:36.858865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ed62c1e54848f488f832ca1b222b83', 'request_id': 'req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:36.881083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] The token cache is being invalidate because project f8ed62c1e54848f488f832ca1b222b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:36.881786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:36.882760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:36.885506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1088/2143] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:36 2022] DELETE /identity/v3/projects/f8ed62c1e54848f488f832ca1b222b83 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:36.886616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:36.888375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:36.986991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b7f9-8a13-4b1b-b2aa-51cb78d91c16 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:36.995996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:36.996696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:36.996984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:36.997406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:36.998993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.002071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.031324 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:37.044117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fbeda-ad8a-41b5-a6f1-11c2c577b27b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.044960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1089/2144] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:36 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:37.044960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:37.049542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:37.073247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b5d45-db5c-443c-891c-e99f5f662508 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.085903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.086876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.087172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.087448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] PATH_INFO: `/v3/users/f0a5743fa5294d1e9670c66bca17b248` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.089830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a5743fa5294d1e9670c66bca17b248)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.092222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.200379 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:37.246322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a5743fa5294d1e9670c66bca17b248'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:37.247435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a5743fa5294d1e9670c66bca17b248'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:37.264118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a5743fa5294d1e9670c66bca17b248'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:37.282569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a5743fa5294d1e9670c66bca17b248'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:37.304917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a5743fa5294d1e9670c66bca17b248'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:37.320389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1090/2145] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:37 2022] DELETE /identity/v3/users/f0a5743fa5294d1e9670c66bca17b248 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:37.320389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:37.320389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:37.342242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.343710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.344623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.345303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.348737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:37.433509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3491a0-d65e-4b6d-a80f-d766fce47271 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.439355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.440253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.440651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.441040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.441983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.444029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.480399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1091/2146] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:37.489014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:37.506494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.510916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.514008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b9b8-0a31-420e-9ea2-2fd92f7b844f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.523795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.524787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.526982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.527661 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1056/2147] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:37.540132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] PATH_INFO: `/v3/projects/930f37d3579f4c2a8166fd439bcc56da/users/29186ffc84d64ac29b1d2b66e7e31cd9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.643567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930f37d3579f4c2a8166fd439bcc56da, user_id=29186ffc84d64ac29b1d2b66e7e31cd9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.653231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.694162 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1092/2148] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:37 2022] PUT /identity/v3/projects/930f37d3579f4c2a8166fd439bcc56da/users/29186ffc84d64ac29b1d2b66e7e31cd9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:37.706143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:37.720999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccd02-5301-4756-9931-998d107f55d9 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.893348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.894437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.894884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.895238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.895945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.898124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1342-ed7d-431f-9c36-5d6acd73e7b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.913721 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1057/2149] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:37.922405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:37.942383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fb56b-1f36-49e2-af7b-b09c0586a106 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:37.952357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:37.954344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:37.955062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:37.955708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] PATH_INFO: `/v3/projects/930f37d3579f4c2a8166fd439bcc56da/users/29186ffc84d64ac29b1d2b66e7e31cd9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:37.960259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930f37d3579f4c2a8166fd439bcc56da, user_id=29186ffc84d64ac29b1d2b66e7e31cd9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:37.966897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:37.983831 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1093/2150] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:37 2022] PUT /identity/v3/projects/930f37d3579f4c2a8166fd439bcc56da/users/29186ffc84d64ac29b1d2b66e7e31cd9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:38.003821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bddae-e704-40d3-ad95-b74ef68f05d3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:38.004492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bddae-e704-40d3-ad95-b74ef68f05d3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:38.005023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bddae-e704-40d3-ad95-b74ef68f05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:38.055205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f1bddae-e704-40d3-ad95-b74ef68f05d3 None None] MFA Rules not processed for user `29186ffc84d64ac29b1d2b66e7e31cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:38.069711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f1bddae-e704-40d3-ad95-b74ef68f05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.081100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:38.084134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.146786 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:38.186326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1058/2151] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:38.196656 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:38.199340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:38.199697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:38.200589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:38.228147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] MFA Rules not processed for user `1070815bb60c44fcb6a586fd2d1f6e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:38.231168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.292519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eef65-b87c-4798-9c31-0376cb673dd8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:38.301181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:38.301965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:38.302338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:38.302760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:38.305996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.360585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1059/2152] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:38.410798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:38.413218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:38.427437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1094/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:38.457146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:38.474117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e81e0-5a7d-4c44-8a3a-ee565e73e854 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:38.486978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:38.488178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:38.488732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:38.489224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:38.492914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.517235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:38.519419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:38.543435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1060/2154] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:38.617452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:38.619345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.786670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687328-0c0b-4394-99eb-64b6ebf4ca6a service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:38.798902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:38.800752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:38.801261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:38.801871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] PATH_INFO: `/v3/projects/b802f081bf61468c810f8dc6724ff12c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:38.804322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b802f081bf61468c810f8dc6724ff12c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:38.809571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:38.935189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b802f081bf61468c810f8dc6724ff12c', 'request_id': 'req-9d47cd09-645a-441b-b197-696f6043d669'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:38.952561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b802f081bf61468c810f8dc6724ff12c', 'request_id': 'req-9d47cd09-645a-441b-b197-696f6043d669'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:38.959637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:38.961291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:38.976907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b802f081bf61468c810f8dc6724ff12c', 'request_id': 'req-9d47cd09-645a-441b-b197-696f6043d669'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:38.979323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f87e9-663e-4230-947b-15fed95f7abe service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:38.982161 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:39.011544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] The token cache is being invalidate because project b802f081bf61468c810f8dc6724ff12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:39.012959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.015407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9d47cd09-645a-441b-b197-696f6043d669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.023293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1095/2155] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:38 2022] DELETE /identity/v3/projects/b802f081bf61468c810f8dc6724ff12c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:39.029321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac71bf-810e-4788-a3da-0435156d532f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.032597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac71bf-810e-4788-a3da-0435156d532f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.033039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac71bf-810e-4788-a3da-0435156d532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.105056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.106639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.107340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.107580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] PATH_INFO: `/v3/users/c5f9ae6edb5c404d85403c6a351ff245` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.112267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f9ae6edb5c404d85403c6a351ff245)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.115532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.116280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-33ac71bf-810e-4788-a3da-0435156d532f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:39.118687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33ac71bf-810e-4788-a3da-0435156d532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:39.168600 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1096/2156] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:39.176125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.176725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.177519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.274874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:39.276719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:39.300550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f9ae6edb5c404d85403c6a351ff245'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.302445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1097/2157] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:39.308616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.320515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc87e0-7009-41e7-844b-795441b4cedd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.328908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f9ae6edb5c404d85403c6a351ff245'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.340664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f9ae6edb5c404d85403c6a351ff245'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.342643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.343383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.343667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.343946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.345910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:39.346285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.348155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.366416 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:39.367401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1098/2158] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:39.374660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.389851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f9ae6edb5c404d85403c6a351ff245'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.390677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26f1aa5f-5a66-4255-b417-297931be3357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f9ae6edb5c404d85403c6a351ff245'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:39.397801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7b620-cbfd-45f7-afba-c25ad1501209 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.404514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.405203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.405491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.406622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.406622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.408738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.415572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1061/2159] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:38 2022] DELETE /identity/v3/users/c5f9ae6edb5c404d85403c6a351ff245 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:39.420848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.421628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.431801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.453108 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1099/2160] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:39.458845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.461255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:39.485897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:39.488599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:39.557934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50ff1-8713-4465-8659-95083e180f67 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.565285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.566061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.566393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.566689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.567413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.569424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.597736 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1100/2161] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:39.603061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.616666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f976af-8043-4f33-b855-db8730c8b3d7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.640224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.642336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.642901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.643343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.644395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.648128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.667633 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1101/2162] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:39.673138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.687020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc301d8e-e2a6-4011-839a-53431120f047 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.693277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.694394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.694874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.695322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.696266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.698529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.716555 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1102/2163] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:39.718196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.734443 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1062/2164] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:39.744368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f953137-4b29-4f5d-ae4d-df55fd5f8128 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.754186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:39.755661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:39.758316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:39.759573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.759929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.761505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] PATH_INFO: `/v3/projects/aa9af5838d3645b2acad12161d65b6bc/users/7fe15455304f4fe4a990a1d32e0d1c28/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.803650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9af5838d3645b2acad12161d65b6bc, user_id=7fe15455304f4fe4a990a1d32e0d1c28, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:39.805716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b80c4-0a8c-4191-b8b0-5eb67b8e0071 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:39.835729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1103/2165] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:39 2022] PUT /identity/v3/projects/aa9af5838d3645b2acad12161d65b6bc/users/7fe15455304f4fe4a990a1d32e0d1c28/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:39.847770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:39.848141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:39.848528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:39.902259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbac61-3ae6-436a-aa81-f22e91e434ff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:39.943235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] MFA Rules not processed for user `7fe15455304f4fe4a990a1d32e0d1c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:39.945509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:40.036565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.038181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.039309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.040659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.163200 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:40.313544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1104/2166] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:40.314577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.317022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:40.407695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.410274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:40.417100 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:40.427756 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1063/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:40.439995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.469925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fcd0-6a02-46bb-a2d5-0c26cf24cd8e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:40.487223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.488446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.489243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.490898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.492034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.492337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b8d3-0b5e-4e8d-9943-71717d426cf8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:40.499924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:40.503508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.504529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.504889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.505246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] PATH_INFO: `/v3/users/96a45526bcbd48c2a255fb736e8cb94a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.508041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a45526bcbd48c2a255fb736e8cb94a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.513319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:40.559900 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1064/2168] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:40 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:40.561468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.648730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a45526bcbd48c2a255fb736e8cb94a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:40.649469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a45526bcbd48c2a255fb736e8cb94a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:40.663425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a45526bcbd48c2a255fb736e8cb94a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:40.683510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a45526bcbd48c2a255fb736e8cb94a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:40.692005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc745e-5608-456c-ad16-873ac8e74a62 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:40.710006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.712040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.714322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.714658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.717779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.719281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-782c0288-3457-454a-a76d-54f8aedb3073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a45526bcbd48c2a255fb736e8cb94a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:40.722643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:40.743633 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1105/2169] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:40 2022] DELETE /identity/v3/users/96a45526bcbd48c2a255fb736e8cb94a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:40.746691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.749509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.750000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.771013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1065/2170] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:40 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:40.776185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.778676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:40.802801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915d55-06fe-445f-8948-2548c9783067 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:40.811202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:40.813649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:40.916956 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:40.934249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.934784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.935166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.935476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.936396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.938496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:40.957292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1066/2171] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:40.963276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.989522 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1106/2172] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:41.002811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.005862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.006397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c62b-710c-43f4-a7ba-cf4a9d7fd32b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:41.020394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:41.021335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.021627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.028946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] PATH_INFO: `/v3/projects/724022d6e8d84abf8ed98950dc5f7df1/users/b8acf79566f9421a9235ec259d43e597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.053873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] RBAC: Authorizing `identity:create_grant(project_id=724022d6e8d84abf8ed98950dc5f7df1, user_id=b8acf79566f9421a9235ec259d43e597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:41.057199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.079294 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1067/2173] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:40 2022] PUT /identity/v3/projects/724022d6e8d84abf8ed98950dc5f7df1/users/b8acf79566f9421a9235ec259d43e597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:41.083185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.166132 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:41.200623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250cc8-5bd9-42f5-b60f-ca5beba7cecb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:41.216388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c1f11-51ae-4857-ab37-a468b63e210e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:41.225525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:41.226735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.227264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.227577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.229855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:41.232281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.260603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1068/2174] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:41.264768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.286259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ce75-c170-4908-962d-2e009eb21634 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:41.298043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:41.299780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.301090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.301736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] PATH_INFO: `/v3/projects/724022d6e8d84abf8ed98950dc5f7df1/users/b8acf79566f9421a9235ec259d43e597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.306329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=724022d6e8d84abf8ed98950dc5f7df1, user_id=b8acf79566f9421a9235ec259d43e597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:41.309160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.345773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1069/2175] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:41 2022] PUT /identity/v3/projects/724022d6e8d84abf8ed98950dc5f7df1/users/b8acf79566f9421a9235ec259d43e597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:41.345773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.350314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.360295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:41.361403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.362667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.363185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.404425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:41.420524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126d7d8-a500-4bcb-8428-2f2d0eb80ec8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.459532 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1107/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:41.460984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbe82-09c9-44bf-af37-069161b84b85 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.461276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbe82-09c9-44bf-af37-069161b84b85 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.461555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbe82-09c9-44bf-af37-069161b84b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.515800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892190-594b-44be-b6df-44ef2900b58d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:41.531301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:41.533408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.534017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.534495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] PATH_INFO: `/v3/projects/69a0aac42f6042fa92a841f661d06e3f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.539531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a0aac42f6042fa92a841f661d06e3f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:41.540279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ea4dbe82-09c9-44bf-af37-069161b84b85 None None] MFA Rules not processed for user `b8acf79566f9421a9235ec259d43e597`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:41.542382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea4dbe82-09c9-44bf-af37-069161b84b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.543750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.670164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a0aac42f6042fa92a841f661d06e3f', 'request_id': 'req-b228d41b-cd16-4c5a-8281-a9cc8b70956d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:41.699717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a0aac42f6042fa92a841f661d06e3f', 'request_id': 'req-b228d41b-cd16-4c5a-8281-a9cc8b70956d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:41.720565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a0aac42f6042fa92a841f661d06e3f', 'request_id': 'req-b228d41b-cd16-4c5a-8281-a9cc8b70956d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:41.753304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1108/2177] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:41.763238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] The token cache is being invalidate because project 69a0aac42f6042fa92a841f661d06e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:41.763533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:41.765342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:41.765661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:41.768523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:41.770050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:41.772306 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1070/2178] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:41 2022] DELETE /identity/v3/projects/69a0aac42f6042fa92a841f661d06e3f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:41.776531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.781825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.793637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] MFA Rules not processed for user `7fe15455304f4fe4a990a1d32e0d1c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:41.795819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.880525 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:41.911314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1109/2179] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:41.961383 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:41.978871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:41.980320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:41.996050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228d41b-cd16-4c5a-8281-a9cc8b70956d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:42.006475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:42.007397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.007679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.007950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] PATH_INFO: `/v3/users/7fa78d4aec664a10887217fee117a469` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.010142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa78d4aec664a10887217fee117a469)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:42.012701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:42.089580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa78d4aec664a10887217fee117a469'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.108043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa78d4aec664a10887217fee117a469'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.118675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa78d4aec664a10887217fee117a469'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.139663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa78d4aec664a10887217fee117a469'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.141965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa78d4aec664a10887217fee117a469'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.164308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1071/2180] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:41 2022] DELETE /identity/v3/users/7fa78d4aec664a10887217fee117a469 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:42.173065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:42.177362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:42.211503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda2091-7a7b-48f1-94c0-27da390012c2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:42.334385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13417d-eaff-4dfc-85c2-32ae586318d9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:42.345446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:42.346379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.346870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.347020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] PATH_INFO: `/v3/projects/ae313a73b87e46b8bba18fc93f680fc2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.350597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae313a73b87e46b8bba18fc93f680fc2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:42.357140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:42.393796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:42.394655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.395009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.395352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.400690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:42.470343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae313a73b87e46b8bba18fc93f680fc2', 'request_id': 'req-12049590-d158-4667-b106-3af44a8c86f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.498442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae313a73b87e46b8bba18fc93f680fc2', 'request_id': 'req-12049590-d158-4667-b106-3af44a8c86f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.507764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae313a73b87e46b8bba18fc93f680fc2', 'request_id': 'req-12049590-d158-4667-b106-3af44a8c86f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.524488 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:42.529317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] The token cache is being invalidate because project ae313a73b87e46b8bba18fc93f680fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:42.531753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.532802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.534945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1072/2181] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:42 2022] DELETE /identity/v3/projects/ae313a73b87e46b8bba18fc93f680fc2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:42.539236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:42.541495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:42.564008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:42.569797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:42.593414 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1110/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:42.687275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12049590-d158-4667-b106-3af44a8c86f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:42.698432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:42.699584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.700202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.700559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] PATH_INFO: `/v3/users/e19f1628b0044d99a21c2d70165ca207` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.702261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19f1628b0044d99a21c2d70165ca207)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:42.705351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:42.779965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19f1628b0044d99a21c2d70165ca207'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.790712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19f1628b0044d99a21c2d70165ca207'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.810644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19f1628b0044d99a21c2d70165ca207'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.831573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19f1628b0044d99a21c2d70165ca207'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.832898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d364371-82df-4671-9091-5fce763b62a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19f1628b0044d99a21c2d70165ca207'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:42.842603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1073/2183] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:42 2022] DELETE /identity/v3/users/e19f1628b0044d99a21c2d70165ca207 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:42.984511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:42.986113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:43.003993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37ada-2217-4a51-b4f8-5140180632ae service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:43.055999 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:43.146535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:43.148190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.149194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.149433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] PATH_INFO: `/v3/projects/b34b2b2fc8f345568bea78b9fdc860df` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.154936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34b2b2fc8f345568bea78b9fdc860df)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:43.165843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:43.340655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34b2b2fc8f345568bea78b9fdc860df', 'request_id': 'req-68578769-4bfd-482a-ae69-5d38b6b395c5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:43.357621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34b2b2fc8f345568bea78b9fdc860df', 'request_id': 'req-68578769-4bfd-482a-ae69-5d38b6b395c5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:43.372173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34b2b2fc8f345568bea78b9fdc860df', 'request_id': 'req-68578769-4bfd-482a-ae69-5d38b6b395c5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:43.396391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] The token cache is being invalidate because project b34b2b2fc8f345568bea78b9fdc860df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:43.396700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:43.399883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68578769-4bfd-482a-ae69-5d38b6b395c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:43.407905 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1111/2184] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:42 2022] DELETE /identity/v3/projects/b34b2b2fc8f345568bea78b9fdc860df => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:43.410264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.410824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.411334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.442171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:43.444377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:43.557298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1074/2185] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:43.566724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.566856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.567183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.615240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:43.618688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:43.658767 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1112/2186] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:43.663630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:43.700488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7e9c-0b62-4f0a-a468-0c037cd6e4ec None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:43.740718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:43.742685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.743177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.743632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.745579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:43.745973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:43.755569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:43.797722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1075/2187] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:43.800590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:43.830555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ab17d-a449-476f-9c0a-0a6b5042216e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:43.857017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:43.857729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.858009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.858280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.859003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:43.861005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:43.931769 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1113/2188] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:43 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:43.932477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:43.950679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9886-0a6d-4180-a8f9-e80e1beb74ce admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:43.966078 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:44.088722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.090373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.090373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.090608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.092117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.096397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.146426 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1076/2189] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:43 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:09:44.148283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.168933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbf636-b6f4-4ad7-b813-c3f0011b9bee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.183594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.184729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.184729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.184946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.185560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.188864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.214874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1114/2190] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:44.221358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.237956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e830b-7ec3-429e-854c-9d0b83d92945 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.250228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.252448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.252870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.253519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.255745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.257782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafab6-7d88-483f-bcf7-822a3c160f18 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.307612 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1077/2191] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:44.312556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.328268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ca497-a955-449f-a3d3-9ca39c67a80f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.343211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.344300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.344585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.344872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68/users/d9f4ec16630e42e49763469f7e5db502/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.411004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5049e7661af04d2d930b150c2e04da68, user_id=d9f4ec16630e42e49763469f7e5db502, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.412172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.412751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.414356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.418401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80447b9-2874-45ec-b22e-b2f97c5395cb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.444224 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1115/2192] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:44 2022] PUT /identity/v3/projects/5049e7661af04d2d930b150c2e04da68/users/d9f4ec16630e42e49763469f7e5db502/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:44.449659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] MFA Rules not processed for user `bfd5b02713f54950b7a5fae18bf4d485`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:44.451029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:44.471266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.474246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.474652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.514685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] MFA Rules not processed for user `d9f4ec16630e42e49763469f7e5db502`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:44.516308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:44.558589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1078/2193] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:44.609766 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:44.646978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.649716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:44.678013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1116/2194] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:44.683089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.814009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec227e5-fe48-4b91-a459-d23a4fcdfd4c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.820511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.822843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.825166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.825719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] PATH_INFO: `/v3/projects/ae9b8dfe882846c490521313a74d78da` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.828964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93140bec-9b0d-44ce-b516-13a10dd5626d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.829368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9b8dfe882846c490521313a74d78da)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.835153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.835928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.836286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.836651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.837615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.839940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.842264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.896517 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1117/2195] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:44.900570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.956646 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:44.992814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9b8dfe882846c490521313a74d78da', 'request_id': 'req-83e39259-8bd0-4be5-9411-a2887a22c7f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:45.008857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9b8dfe882846c490521313a74d78da', 'request_id': 'req-83e39259-8bd0-4be5-9411-a2887a22c7f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:45.026457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9b8dfe882846c490521313a74d78da', 'request_id': 'req-83e39259-8bd0-4be5-9411-a2887a22c7f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:45.060327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] The token cache is being invalidate because project ae9b8dfe882846c490521313a74d78da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:45.075100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:45.077705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83e39259-8bd0-4be5-9411-a2887a22c7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:45.084940 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1079/2196] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:44 2022] DELETE /identity/v3/projects/ae9b8dfe882846c490521313a74d78da => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:45.087045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.087902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.096433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d85-b4ee-499f-bef9-0c6aed4474df admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.101191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.133011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:45.134430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:45.259114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.259952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.261321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.261612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.263501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.265528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.296170 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1118/2197] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:44 2022] POST /identity/v3/users => generated 293 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:45.300029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.302983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:45.318648 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:45.331094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b717bf-98a9-4c43-a3ea-4a76bd190526 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.339646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.340606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.341042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.341510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.342616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.344797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88081ec5-84a1-4f17-a23d-c2ed3da8300c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.358695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1080/2198] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:45.359665 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1119/2199] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:45.368561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.370047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.370344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.370541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.384030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995ba1d-7b69-46b6-ac0b-676ba834d836 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.391212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.393512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.394133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.394597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] PATH_INFO: `/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f/users/adf8ba3d40fe49638923ed3fcf33d8c9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.414975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:45.416368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ace106d525e41ca8e6d0fcf593aba6f, user_id=adf8ba3d40fe49638923ed3fcf33d8c9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.416833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:45.419813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.432282 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1120/2200] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:45.433509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.453309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1081/2201] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:45 2022] PUT /identity/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f/users/adf8ba3d40fe49638923ed3fcf33d8c9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:45.453588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a5126-7565-43a6-8587-49d2d2fbc12a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.455091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.562255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e653-e095-45a8-96b0-d848c8f243aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.569225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.570089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.570375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.570651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.572544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.575080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.584299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.585221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.585570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.585956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.586927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:45.590679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.590847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1082/2202] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:45.590956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.593725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.610289 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1121/2203] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:45.617302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.622756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a76c0-6fdf-49e0-b0b6-dcd2bcf8e994 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.630780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.631772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.632045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.632417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] PATH_INFO: `/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f/users/adf8ba3d40fe49638923ed3fcf33d8c9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.632838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62485-9464-415e-acbd-c83951e23a9f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.635367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ace106d525e41ca8e6d0fcf593aba6f, user_id=adf8ba3d40fe49638923ed3fcf33d8c9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.639154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8dc60-6405-442c-8097-1e60fdac8a45 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.639823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.640497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.640785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.641062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.642181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.645062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.663261 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1083/2204] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:45 2022] PUT /identity/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f/users/adf8ba3d40fe49638923ed3fcf33d8c9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:45.665543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.666417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.667034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.694405 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1122/2205] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:45.700588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.709798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] MFA Rules not processed for user `adf8ba3d40fe49638923ed3fcf33d8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:45.711642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:45.728179 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:45.804292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb41e0-620b-4a33-bc70-953c8c2894c9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.824885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.825585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.825891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.826161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.827060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.829175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.855457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1084/2206] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:45.856572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.867040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e8b95-7462-469d-af05-ea464a40251d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.874067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.874764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.875075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.876666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.877251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:45.878172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.880650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.885718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1123/2207] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:45.887910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.900972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841f422-1422-4429-9e7a-0ba940ab978d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.909133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.909482 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1085/2208] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:45.910044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.910321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.910693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.911516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.913733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.916139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.939389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1124/2209] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:45.943312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be477c-705f-4f31-81bc-6de45102ce25 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.944259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:45.950597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.951604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.952003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.953823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.956420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.960367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a4b3-d87e-4bc6-b0eb-8601d1a5ef8a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:45.962138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.971967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:45.972776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:45.973061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:45.973329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:45.974248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:45.976135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:45.994705 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1125/2210] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:45.995706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.021608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0f1ab-210f-47e7-b187-9e8adb4266f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.025367 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1086/2211] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:45 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:46.029925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.060893 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:46.122770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.138888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.140284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.140761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] PATH_INFO: `/v3/projects/bb89abcd306440c0b1e4c803c85ec205/users/8ab14ea4975247678ed6149476a7a5e9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.178439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb89abcd306440c0b1e4c803c85ec205, user_id=8ab14ea4975247678ed6149476a7a5e9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.184908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4300e-6063-41a7-88eb-a086bdc8d691 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.216285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1126/2212] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:45 2022] PUT /identity/v3/projects/bb89abcd306440c0b1e4c803c85ec205/users/8ab14ea4975247678ed6149476a7a5e9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:46.226316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd06a8b-7701-46a0-b27c-8a7225de06e5 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.228597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.229048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.229335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.291880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] MFA Rules not processed for user `8ab14ea4975247678ed6149476a7a5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:46.293452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:46.402608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.403302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.403587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.403864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.404619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:46.404931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.407233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.417656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1127/2213] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:46.423291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.462230 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1087/2214] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:46.470335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.472185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:46.506060 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:46.611586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab4eaa-6a72-40d3-8091-92ef41a9b9c8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.628222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.633065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.633781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.634690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.637766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.656482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.660125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f51b6-d4a0-4673-af57-370264158837 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.669968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.671177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.671668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.672018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.699121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.701049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62373d-9be0-41eb-9425-6d6f9f1c5c93 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.729822 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1128/2215] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:46 2022] POST /identity/v3/projects => generated 373 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:09:46.732075 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1088/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:46.733370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.748669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.749238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.749628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.752456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1089/2217] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:09:46.759240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:46.777500 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:46.846421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c33304-1b9a-416d-ac5a-9375cdfa96f4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.864842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.865684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.866138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.866515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.866839 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 24 01:09:46.867151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.867616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.869979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.914983 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1129/2218] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:46 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:46.919643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:46.959600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67ee7-035a-46ff-8751-f9cd5d16e10f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.973200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d52e-405e-4522-a1f2-09f6e5a1ed76 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:46.986561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.987416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.987735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.988231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/c995ff06771a42d3befd5dc44f5c49fb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.990265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=c995ff06771a42d3befd5dc44f5c49fb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.990873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:46.991628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:46.991964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:46.992245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:46.992981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:46.993156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:46.995723 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1090/2219] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:46 2022] GET /identity/v3/projects/c995ff06771a42d3befd5dc44f5c49fb => generated 369 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:46.996284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:47.018055 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1130/2220] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:47.019619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:47.047771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce8f02-0723-4c6f-b4b6-6728b8438688 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:47.061309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:47.062147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.062623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.062915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] PATH_INFO: `/v3/projects/a261276146c640edaa4332fadb380e3b/users/140ef31e874849489295a2a4c90d3f68/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.104169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a261276146c640edaa4332fadb380e3b, user_id=140ef31e874849489295a2a4c90d3f68, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:47.109249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0755fd-3ad4-4214-9199-6ef1472636c7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:47.153991 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1091/2221] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:47 2022] PUT /identity/v3/projects/a261276146c640edaa4332fadb380e3b/users/140ef31e874849489295a2a4c90d3f68/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:47.155804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:47.171577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82850-5d80-4b15-a968-2cba4fc62db0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:47.194018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.194571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.195115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.198369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1092/2222] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:47.205447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:47.226178 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:47.277862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:47.278558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.278838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.279108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.280553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:47.282315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:47.301075 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1131/2223] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:47.305917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:47.321466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f5a0c-4b37-4ddf-8073-7ccc994e130b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:47.329954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:47.331205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.331656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.331986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] PATH_INFO: `/v3/projects/a261276146c640edaa4332fadb380e3b/users/140ef31e874849489295a2a4c90d3f68/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.335253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a261276146c640edaa4332fadb380e3b, user_id=140ef31e874849489295a2a4c90d3f68, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:47.338665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0902c7-ec51-4cf6-af4f-cd80fbbb46e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:47.354988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1132/2224] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:47 2022] PUT /identity/v3/projects/a261276146c640edaa4332fadb380e3b/users/140ef31e874849489295a2a4c90d3f68/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:47.367676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.367941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.368222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.373351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:47.432616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] MFA Rules not processed for user `140ef31e874849489295a2a4c90d3f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:47.433921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:47.479648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec60b1-4c4f-4a0c-a04b-b7cf5e3b24fe None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:47.597865 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1133/2225] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:47.613342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:47.614340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.614624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.614908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/c995ff06771a42d3befd5dc44f5c49fb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:47.616216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=c995ff06771a42d3befd5dc44f5c49fb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:47.618421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18926150-9f1d-4569-be66-fa17f2d807db tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:47.621273 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1093/2226] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:47 2022] GET /identity/v3/projects/c995ff06771a42d3befd5dc44f5c49fb => generated 369 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:47.757248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:47.761307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:47.804815 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:47.971808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01514d-2f44-4f56-b833-87378d8e29a6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:47.984982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:47.986244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:47.986737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:47.987280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.006591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:48.010746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:48.034926 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1134/2227] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:48.812236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71002-29a7-4c29-9298-98a2a5d66830 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:48.812236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71002-29a7-4c29-9298-98a2a5d66830 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:48.813239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71002-29a7-4c29-9298-98a2a5d66830 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.816622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1094/2228] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:48.852420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:48.888812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:48.934980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc57c-c81b-4c00-bc2f-54e12204c576 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:48.952633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:48.955975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:48.956751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:48.957361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/c995ff06771a42d3befd5dc44f5c49fb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.960277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=c995ff06771a42d3befd5dc44f5c49fb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:48.967055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18d8a1-fb5e-45e6-b9e9-82d27b02963e tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:48.973463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1135/2229] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:48 2022] GET /identity/v3/projects/c995ff06771a42d3befd5dc44f5c49fb => generated 369 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:49.013193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71002-29a7-4c29-9298-98a2a5d66830 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:49.030745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71002-29a7-4c29-9298-98a2a5d66830 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:49.039253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:49.041449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:49.042182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:49.042693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/c995ff06771a42d3befd5dc44f5c49fb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:49.044640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c995ff06771a42d3befd5dc44f5c49fb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:49.049072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:49.132048 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:49.135478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c995ff06771a42d3befd5dc44f5c49fb', 'request_id': 'req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:49.147243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c995ff06771a42d3befd5dc44f5c49fb', 'request_id': 'req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:49.159013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c995ff06771a42d3befd5dc44f5c49fb', 'request_id': 'req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:49.179107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] The token cache is being invalidate because project c995ff06771a42d3befd5dc44f5c49fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:49.180386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:49.181516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:49.183808 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1095/2230] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:49 2022] DELETE /identity/v3/projects/c995ff06771a42d3befd5dc44f5c49fb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:49.563812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b082-67ce-47fb-8505-eeb481a305ac None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:49.564107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b082-67ce-47fb-8505-eeb481a305ac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:49.564384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b082-67ce-47fb-8505-eeb481a305ac None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:49.565856 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1136/2231] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:49.575518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:49.577466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:49.713355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:49.715268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:49.825348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd190d9-cc44-4e6d-bde5-b6bcdf9f7ffa tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:49.830931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:49.832469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:49.833047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:49.833533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:49.836577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=5049e7661af04d2d930b150c2e04da68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:49.839433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:49.841922 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1096/2232] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:49 2022] GET /identity/v3/projects/5049e7661af04d2d930b150c2e04da68 => generated 373 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:49.863258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b082-67ce-47fb-8505-eeb481a305ac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:49.888170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b082-67ce-47fb-8505-eeb481a305ac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:49.897147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:49.898866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:49.899280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:49.900166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:49.901217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:49.901762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:49.904762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:49.924520 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1137/2233] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:49.929760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:49.941640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19724e2-b2ed-48fd-b5e3-f8635cdca5e4 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:49.946545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:49.947754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:49.948191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:49.948485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:49.949394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:49.951375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ee6b-ed48-4e06-afe0-3c387ca5fbce tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:49.996185 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1097/2234] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:49 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:09:50.000650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:50.020061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99a013-7f6a-479b-87ec-95a9f159d0d7 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:50.146328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:50.147366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:50.148008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:50.148390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:50.149878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:50.151195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:50.153429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:50.174901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1138/2235] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:50.907754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110ee5-1757-4809-a282-1b839e885106 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:50.908352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110ee5-1757-4809-a282-1b839e885106 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:50.908606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110ee5-1757-4809-a282-1b839e885106 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:50.910427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1098/2236] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:50.919982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:50.922692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:51.035901 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:51.057747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:51.080627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2c0c-e5ac-44ab-a47b-5a5df2cbdb6c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:51.091887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:51.094830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:51.100655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:51.105867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/0de01a8806a449d38694beeb2b5a2ec6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:51.108618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=0de01a8806a449d38694beeb2b5a2ec6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:51.112522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:51.115508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1139/2237] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:50 2022] GET /identity/v3/projects/0de01a8806a449d38694beeb2b5a2ec6 => generated 371 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:51.817016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0c02-1ae7-4a3b-a654-bff2527d6815 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:51.817303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0c02-1ae7-4a3b-a654-bff2527d6815 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:51.819376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0c02-1ae7-4a3b-a654-bff2527d6815 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:51.821148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1099/2238] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:09:51.827787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:51.856731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:51.872984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a567a-f0e8-4837-acda-9f36b0022428 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:51.880204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:51.880574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:51.880574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:51.881433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/0de01a8806a449d38694beeb2b5a2ec6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:51.882917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=0de01a8806a449d38694beeb2b5a2ec6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:51.885942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:51.888130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1140/2239] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:51 2022] GET /identity/v3/projects/0de01a8806a449d38694beeb2b5a2ec6 => generated 371 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:51.956523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0c02-1ae7-4a3b-a654-bff2527d6815 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:51.972352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0c02-1ae7-4a3b-a654-bff2527d6815 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:51.979261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:51.980274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:51.981416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:51.981817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:51.982816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:51.983417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:51.985207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.006741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1100/2240] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:52.007515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:52.020439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedda62-65e0-40e8-a38f-ec0cfff64107 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:52.029877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:52.030673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.031007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.031357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.032159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:52.035208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.065596 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1141/2241] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:52 2022] POST /identity/v3/users => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:52.069858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:52.080956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f813f1-9faa-4486-bb05-16412d54688a tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:52.085806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:52.086484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.086768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.087050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.087879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:52.088194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:52.089862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6186-7394-4f23-a076-a03a899cce92 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.103716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1101/2242] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:52.292193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:52.294847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:52.381186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6911a1f-f99a-41ce-804d-49564475195b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:52.387745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:52.388889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.389269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.389641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] PATH_INFO: `/v3/users/8ab14ea4975247678ed6149476a7a5e9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.391651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab14ea4975247678ed6149476a7a5e9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:52.394333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.457937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab14ea4975247678ed6149476a7a5e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:52.458650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab14ea4975247678ed6149476a7a5e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:52.484631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.485155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.486451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.489004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1102/2243] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:52.491008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab14ea4975247678ed6149476a7a5e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:52.496825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:52.499467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:52.502686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab14ea4975247678ed6149476a7a5e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:52.523541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:52.526034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1d3e494-8707-48ad-91ba-f3e5a8d0b41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab14ea4975247678ed6149476a7a5e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:52.526210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:52.537393 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1142/2244] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:52 2022] DELETE /identity/v3/users/8ab14ea4975247678ed6149476a7a5e9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:52.543000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379589e6-f87e-4338-8d52-90ff4c16d594 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.543387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379589e6-f87e-4338-8d52-90ff4c16d594 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.543606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379589e6-f87e-4338-8d52-90ff4c16d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.553426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5172-ec6a-4be9-82b7-d88241ebc93a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:52.581167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-379589e6-f87e-4338-8d52-90ff4c16d594 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:52.581167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-379589e6-f87e-4338-8d52-90ff4c16d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:52.622246 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:52.673431 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:52.697661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:52.698607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.698892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.699212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/0de01a8806a449d38694beeb2b5a2ec6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.701648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=0de01a8806a449d38694beeb2b5a2ec6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:52.706926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.708609 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1103/2245] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:52 2022] GET /identity/v3/projects/0de01a8806a449d38694beeb2b5a2ec6 => generated 371 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:52.715174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1143/2246] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:52.730609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:52.733752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:52.863137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2b53-4f30-4422-8cce-6ad472c3c1c9 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:52.868564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:52.870148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:52.870543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:52.870950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:52.884518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:52.886440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:52.899911 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1104/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:53.100024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.101087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.101464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.156613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:53.163475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.190563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1144/2248] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:53.244384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:53.246038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.304633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37074-1f03-4ce1-bd78-a03aba99a872 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:53.325722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:53.326552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.327066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.327350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.359085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:53.360625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:53.386274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1105/2249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:53.511200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:53.513537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.550080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4abbfb-a54d-42b9-85c6-9ca6463c80d0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:53.558292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:53.559316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.559786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.560069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] PATH_INFO: `/v3/projects/bb89abcd306440c0b1e4c803c85ec205` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.561534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb89abcd306440c0b1e4c803c85ec205)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:53.563711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:53.648947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb89abcd306440c0b1e4c803c85ec205', 'request_id': 'req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.658122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb89abcd306440c0b1e4c803c85ec205', 'request_id': 'req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.674222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb89abcd306440c0b1e4c803c85ec205', 'request_id': 'req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.698925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] The token cache is being invalidate because project bb89abcd306440c0b1e4c803c85ec205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:53.699414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.700724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aec7b2b4-2b6d-4af8-86f8-e9cd87eca41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.703618 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1145/2250] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:53 2022] DELETE /identity/v3/projects/bb89abcd306440c0b1e4c803c85ec205 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:53.707719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:53.733253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358f54-ebf6-4d32-a152-4f9077160d93 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:53.766457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.766879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.767264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.769320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1146/2251] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:53.787217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:53.791667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.856556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:53.857612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.857988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.858446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] PATH_INFO: `/v3/users/140ef31e874849489295a2a4c90d3f68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.860131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140ef31e874849489295a2a4c90d3f68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:53.862505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:53.948318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140ef31e874849489295a2a4c90d3f68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.959880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140ef31e874849489295a2a4c90d3f68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:53.961981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:53.975202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:53.977208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.991081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140ef31e874849489295a2a4c90d3f68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.017214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140ef31e874849489295a2a4c90d3f68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.019150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140ef31e874849489295a2a4c90d3f68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.029262 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1106/2252] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:53 2022] DELETE /identity/v3/users/140ef31e874849489295a2a4c90d3f68 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:54.141910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bae8f2-8d9c-4b54-b9a8-90adc64df5b0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:54.150392 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:54.293993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:54.296882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.297409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.297892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/0de01a8806a449d38694beeb2b5a2ec6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:54.303392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=0de01a8806a449d38694beeb2b5a2ec6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:54.313586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:54.333784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1147/2253] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:53 2022] GET /identity/v3/projects/0de01a8806a449d38694beeb2b5a2ec6 => generated 371 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:54.379105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:54.380386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:54.397564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb564de-b72f-415f-9188-db2f91eaf575 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:54.404190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:54.405478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.405963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.406394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/users/5f77412d2e2f483580e8b8cc09ec3c27` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:54.425449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5f77412d2e2f483580e8b8cc09ec3c27)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:54.427802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:54.497239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f77412d2e2f483580e8b8cc09ec3c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.518360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f77412d2e2f483580e8b8cc09ec3c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.519603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:54.523468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:54.534348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f77412d2e2f483580e8b8cc09ec3c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.575262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f77412d2e2f483580e8b8cc09ec3c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.576053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f77412d2e2f483580e8b8cc09ec3c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.586719 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1107/2254] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:54 2022] DELETE /identity/v3/users/5f77412d2e2f483580e8b8cc09ec3c27 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:54.595750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:54.597157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:54.697383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a21821-75db-434c-8805-15d6e4dddd9c tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:54.718538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4b6f-5e47-4c97-839a-744cd337dd46 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:54.724108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:54.725104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.725496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.726139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/0de01a8806a449d38694beeb2b5a2ec6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:54.727435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0de01a8806a449d38694beeb2b5a2ec6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:54.730200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:54.779221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:54.781859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.782121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.782414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] PATH_INFO: `/v3/projects/a261276146c640edaa4332fadb380e3b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:54.784312 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:54.784544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a261276146c640edaa4332fadb380e3b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:54.787196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:54.800493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de01a8806a449d38694beeb2b5a2ec6', 'request_id': 'req-24a8a2e4-85c8-42e1-b92f-618ae86b0523'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.815723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de01a8806a449d38694beeb2b5a2ec6', 'request_id': 'req-24a8a2e4-85c8-42e1-b92f-618ae86b0523'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.867998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de01a8806a449d38694beeb2b5a2ec6', 'request_id': 'req-24a8a2e4-85c8-42e1-b92f-618ae86b0523'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.900629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] The token cache is being invalidate because project 0de01a8806a449d38694beeb2b5a2ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:54.901301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.917935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24a8a2e4-85c8-42e1-b92f-618ae86b0523 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.923911 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1108/2255] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:54 2022] DELETE /identity/v3/projects/0de01a8806a449d38694beeb2b5a2ec6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:54.945765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a261276146c640edaa4332fadb380e3b', 'request_id': 'req-49bd2da7-07ab-42ea-b238-babcdacf9d49'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.955595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a261276146c640edaa4332fadb380e3b', 'request_id': 'req-49bd2da7-07ab-42ea-b238-babcdacf9d49'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.957871 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:54.969393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a261276146c640edaa4332fadb380e3b', 'request_id': 'req-49bd2da7-07ab-42ea-b238-babcdacf9d49'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.987990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] The token cache is being invalidate because project a261276146c640edaa4332fadb380e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:54.988306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.989010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-49bd2da7-07ab-42ea-b238-babcdacf9d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:54.995608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1148/2256] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:54 2022] DELETE /identity/v3/projects/a261276146c640edaa4332fadb380e3b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:54.997027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ab14-5d21-477b-9176-5d21d9267214 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.997388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ab14-5d21-477b-9176-5d21d9267214 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.997690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ab14-5d21-477b-9176-5d21d9267214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.020224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-19c6ab14-5d21-477b-9176-5d21d9267214 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:55.021476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-19c6ab14-5d21-477b-9176-5d21d9267214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.082551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.083261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.083748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.085420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1149/2257] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:09:55.091473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:55.093598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.107367 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1109/2258] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:55.125699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.126237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.126901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.158807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:55.160398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.171369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1110/2259] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:55.177516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.202032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445efa0-aa0e-4fd2-9086-be992eb2f053 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.207101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.207867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.208251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.208534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.209759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:09:55.210077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.213173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.230686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.231846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.241732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1111/2260] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:55.248044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.270964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3697-abe5-4420-b579-9204af29f562 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.281728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.282440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.282730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.283001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.283724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.285700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.351769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1112/2261] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:55.359375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.385654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960040-27c2-476d-b66a-803bd19c48ba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.470115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.470912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.471219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.471482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.472714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=5049e7661af04d2d930b150c2e04da68)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.474831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71496fc3-1327-451a-87a5-925b705355a2 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.486366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1150/2262] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:55 2022] GET /identity/v3/projects/5049e7661af04d2d930b150c2e04da68 => generated 373 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:55.490079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d938bc-51bb-4608-a054-2b9877c75ba7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.506948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.507215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.507495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.507809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.509376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1151/2263] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:55.510579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.511358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.512458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.514966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:55.515232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.519744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.549462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1113/2264] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:55.558472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.574596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8170d04-b8fa-4491-a472-b0bd55a9df68 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.577602 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:55.581553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.582678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.583141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.583619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.585043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.587793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.596998 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:55.615356 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1114/2265] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:55.621106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.635193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a83bed-4511-4206-88f0-73cfa2091f93 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.642367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.643840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.643840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.644098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.645372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.647667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.658464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.662441 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1115/2266] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:55.667458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:55.672150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082339-f534-4f03-a63c-545528ed5156 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.677120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.678086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.678376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.678655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.679944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=5049e7661af04d2d930b150c2e04da68)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.680308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e14632-ccf2-4b6e-b80d-06d33a41b0bc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:55.682782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50264e-e084-42c4-96d8-77e48c2bf93b tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.685125 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1152/2267] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:55 2022] GET /identity/v3/projects/5049e7661af04d2d930b150c2e04da68 => generated 373 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:09:55.687114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:55.688231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.688344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.688624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] PATH_INFO: `/v3/projects/f6320581cd774ce1a81e2e0d8e785cc2/users/7210af5a52a54bd982af517234974761/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.708571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6320581cd774ce1a81e2e0d8e785cc2, user_id=7210af5a52a54bd982af517234974761, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:55.711565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c80cac-cf2b-45a9-b1dc-6aab1345642e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:55.716148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.716459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.716729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.737331 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1116/2268] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:55 2022] PUT /identity/v3/projects/f6320581cd774ce1a81e2e0d8e785cc2/users/7210af5a52a54bd982af517234974761/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:55.740800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] MFA Rules not processed for user `40b5fc3b4b6d43ab9342da568567140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:55.742177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.748292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:55.748526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:55.748775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:55.798925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] MFA Rules not processed for user `7210af5a52a54bd982af517234974761`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:55.800598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:55.861288 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1153/2269] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:55.910065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1117/2270] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:09:55.916145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.002510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad661a-ce50-432f-a9b9-23deec600703 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.009196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.010903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.011190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.011555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.012362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.014661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.050518 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1154/2271] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:09:55 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:56.053232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.070194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d04c5-d96f-4234-95d6-243d16f5db21 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.181375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.182294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.182506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.182733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.183459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.185967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.217785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1118/2272] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:09:56 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:09:56.220238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.231532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5cbea-43d9-4049-8144-89ddf095330d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.236292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.236891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.237175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.237454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.238235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.239847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.251037 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1155/2273] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:09:56.255594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.267052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9b1e-ed36-4385-9154-abb37153ef29 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.271900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.272807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.273087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.273361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] PATH_INFO: `/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa/users/3c7cd3ceda034e3b962966d5df33c18a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.298967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64d3ef1977e4a1f9d5aa2b238fc2afa, user_id=3c7cd3ceda034e3b962966d5df33c18a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.302326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.317923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1119/2274] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:56 2022] PUT /identity/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa/users/3c7cd3ceda034e3b962966d5df33c18a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:56.322910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.336093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f710-8cd9-4190-9421-4fe9ccadeaee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.387331 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:56.411379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.412063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.412350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.412615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.413389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.415160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0465114-9513-40c0-9a2d-6d2f69e6ed7a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.430119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1156/2275] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:09:56.435030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.448585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f97dfc-5161-419e-929e-bef1fa9edb42 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.455580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.456435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.456722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.456997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] PATH_INFO: `/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa/users/3c7cd3ceda034e3b962966d5df33c18a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.459201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64d3ef1977e4a1f9d5aa2b238fc2afa, user_id=3c7cd3ceda034e3b962966d5df33c18a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.462023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79722fe-cc47-427c-b37d-86fcfcb1c619 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.487077 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1120/2276] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:09:56 2022] PUT /identity/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa/users/3c7cd3ceda034e3b962966d5df33c18a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:56.489133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.489480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.489693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.505864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.506382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.506382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.508275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1121/2277] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:09:56.517967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:09:56.519751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:56.532927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] MFA Rules not processed for user `3c7cd3ceda034e3b962966d5df33c18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:56.533619 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:56.534272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:56.637433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1157/2278] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:56.643984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.718682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12d771-7699-46bc-b6ec-34cd2b011035 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.724102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf8ba3d40fe49638923ed3fcf33d8c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ace106d525e41ca8e6d0fcf593aba6f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.724647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.724938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.725191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.726733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorizing `identity:get_project(project_id=5049e7661af04d2d930b150c2e04da68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.729042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623c7b-1113-43eb-a870-a77f8d253225 tempest-QuotasAdminTestJSON-291079118 tempest-QuotasAdminTestJSON-291079118-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.735378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1122/2279] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:09:56 2022] GET /identity/v3/projects/5049e7661af04d2d930b150c2e04da68 => generated 373 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:57.167966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:57.169528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.261051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e208585-3c08-47fc-be62-eaeb474c0fba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:57.266407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:57.269062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:57.269062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:57.269062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] PATH_INFO: `/v3/users/d9f4ec16630e42e49763469f7e5db502` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:57.269353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f4ec16630e42e49763469f7e5db502)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:57.271403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:57.335144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f4ec16630e42e49763469f7e5db502'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:57.335843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f4ec16630e42e49763469f7e5db502'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:57.351566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f4ec16630e42e49763469f7e5db502'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:57.366635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f4ec16630e42e49763469f7e5db502'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:57.370421 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:57.390178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f4ec16630e42e49763469f7e5db502'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:57.401121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1158/2280] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:57 2022] DELETE /identity/v3/users/d9f4ec16630e42e49763469f7e5db502 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:57.404950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:57.405236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:57.405514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:57.425162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:57.426428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.439220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:57.441150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.522842 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1123/2281] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:57.532032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:57.546351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.594117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce4d5-8354-49db-b3eb-7e521ed2855f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:57.601320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:57.602244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:57.602363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:57.602611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:57.605955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.667545 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:57.686713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:57.688408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:57.699039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ded3cc-abbe-479a-9e95-d7e15dc43acf None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:57.702138 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1159/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:57.703269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:57.703674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:57.704470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:57.704682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.704953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:57.706312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:57.724863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd59a9-84f8-4255-b9d1-d856e5936478 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:57.730501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:57.732336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:57.734320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:57.734981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:57.735272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:57.735851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:57.737842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:57.748061 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1124/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:09:57.835382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:57.841430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:57.854426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1160/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:58.676506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:58.678133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:58.701606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778caa3-a3ff-41ae-9bd6-ee176df77ec2 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:58.707478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:58.708446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:58.708808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:58.709162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] PATH_INFO: `/v3/projects/5049e7661af04d2d930b150c2e04da68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:58.710739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5049e7661af04d2d930b150c2e04da68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:58.714571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:58.781360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5049e7661af04d2d930b150c2e04da68', 'request_id': 'req-270edbc8-ec46-4d27-9ce5-06b73c71da70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.789054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5049e7661af04d2d930b150c2e04da68', 'request_id': 'req-270edbc8-ec46-4d27-9ce5-06b73c71da70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.798184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5049e7661af04d2d930b150c2e04da68', 'request_id': 'req-270edbc8-ec46-4d27-9ce5-06b73c71da70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.821970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] The token cache is being invalidate because project 5049e7661af04d2d930b150c2e04da68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:58.822405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.823010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.824850 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1125/2285] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:58 2022] DELETE /identity/v3/projects/5049e7661af04d2d930b150c2e04da68 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:58.828582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:58.841079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab572cb-6df1-4437-be65-c081c9bef6ac service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:58.847040 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:58.923912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:58.924868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:58.925239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:58.925455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] PATH_INFO: `/v3/users/adf8ba3d40fe49638923ed3fcf33d8c9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:58.926866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf8ba3d40fe49638923ed3fcf33d8c9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:58.928850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:58.982431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf8ba3d40fe49638923ed3fcf33d8c9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.983097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf8ba3d40fe49638923ed3fcf33d8c9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:58.992837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf8ba3d40fe49638923ed3fcf33d8c9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.001887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf8ba3d40fe49638923ed3fcf33d8c9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.021521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dd8d0-fa11-475e-8fe0-129624ca1cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf8ba3d40fe49638923ed3fcf33d8c9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.030341 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1161/2286] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:58 2022] DELETE /identity/v3/users/adf8ba3d40fe49638923ed3fcf33d8c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:59.276904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:59.278462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:59.297160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270edbc8-ec46-4d27-9ce5-06b73c71da70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:59.452901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:59.453942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:59.454260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:59.458200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] PATH_INFO: `/v3/users/7210af5a52a54bd982af517234974761` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:59.461590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7210af5a52a54bd982af517234974761)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:59.466527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:59.560932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7210af5a52a54bd982af517234974761'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.576173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7210af5a52a54bd982af517234974761'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.590733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7210af5a52a54bd982af517234974761'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.604296 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:59.625084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7210af5a52a54bd982af517234974761'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.626647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7210af5a52a54bd982af517234974761'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.641228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1126/2287] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:09:59 2022] DELETE /identity/v3/users/7210af5a52a54bd982af517234974761 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:09:59.646145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:59.646439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:59.646711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:59.672394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:59.673938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:59.716806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:59.718222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:59.758607 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1162/2288] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:59.772978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:59.777470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:59.801327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c7cc-6541-4ecc-ac9c-81d311231598 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:59.806747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:59.807677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:59.807959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:59.808228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] PATH_INFO: `/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:59.809450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ace106d525e41ca8e6d0fcf593aba6f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:59.811439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:59.817852 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:59.872456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f70d0-5afc-49bf-a3da-9f4f0b8a2fa8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:59.890913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ace106d525e41ca8e6d0fcf593aba6f', 'request_id': 'req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.898250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ace106d525e41ca8e6d0fcf593aba6f', 'request_id': 'req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.906347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ace106d525e41ca8e6d0fcf593aba6f', 'request_id': 'req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.930954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] The token cache is being invalidate because project 8ace106d525e41ca8e6d0fcf593aba6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:09:59.931465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.937022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6d5b3e3-ba9b-4659-9c98-06d921d49a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:09:59.945855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1127/2289] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:09:59 2022] DELETE /identity/v3/projects/8ace106d525e41ca8e6d0fcf593aba6f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:09:59.957309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0bdb-a60d-4bcd-9ab9-f5038dd41030 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:59.957886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0bdb-a60d-4bcd-9ab9-f5038dd41030 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:59.958367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0bdb-a60d-4bcd-9ab9-f5038dd41030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:59.999213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-029d0bdb-a60d-4bcd-9ab9-f5038dd41030 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:00.001094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-029d0bdb-a60d-4bcd-9ab9-f5038dd41030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:00.015016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.015774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.016284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.016933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.031321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:00.207185 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1128/2290] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:00.217688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.218248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.218836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.241098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.242488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.261813 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1163/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:00.263428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:00.264821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:00.300456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1129/2292] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:00.304950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.319581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f005ed-1803-415d-a2ca-b5c0712740b8 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.329651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.330835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.332172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.332622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.333530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:00.334014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.336592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.356558 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1164/2293] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:00.360034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.370998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a449fb-5d78-412f-9c36-2f9de67282e9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.378914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.379528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.379866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.380147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.381081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.383073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.395206 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:00.429209 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1130/2294] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:00 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:00.430395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.446498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b1a30-b608-4cee-a109-3e54aaf0f641 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.595468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.596943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.597742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.598028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.598878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.605029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.660613 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1165/2295] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:00 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:00.661866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.680800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92bc4d-416b-4cb9-ac73-d539e228a1f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.686321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.688171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.689706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.690306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.691541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.697741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.723491 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1131/2296] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:00.725439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.740450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da8b9-ddc9-42d1-af00-614329013f68 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.759428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.763981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.764634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.765144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.766207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.768073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd81de6-a977-4356-8ab8-d6d2410da851 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.772122 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:00.789794 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1166/2297] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:00.792604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.804056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612b37-a332-41f9-926e-cf6e0c6bf3df admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:00.811588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:00.812541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.812826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.813100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] PATH_INFO: `/v3/projects/221902b3cf044d719cc7dc1fcf7ba33b/users/b96d7edf06d147bb94869c925933a78e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.831792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=221902b3cf044d719cc7dc1fcf7ba33b, user_id=b96d7edf06d147bb94869c925933a78e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:00.834809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:00.850498 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1132/2298] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:00 2022] PUT /identity/v3/projects/221902b3cf044d719cc7dc1fcf7ba33b/users/b96d7edf06d147bb94869c925933a78e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:00.864200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:00.864540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:00.864825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:00.897777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] MFA Rules not processed for user `b96d7edf06d147bb94869c925933a78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:00.899055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:00.976394 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1167/2299] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:00.988306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:00.990061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:01.067841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bd126-6228-4cc4-ae0d-62041e125f4d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:01.073334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:01.074092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:01.074428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:01.075406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:01.093714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:01.096131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:01.111945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1133/2300] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:01.187737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:01.189574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:01.301445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:01.304082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:01.354031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0482d1-025c-46d1-973e-c8221823e652 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:01.377239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:01.379040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:01.379172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:01.379456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:01.383592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:01.495637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18727dd6-58d7-40b3-a005-802e7a84cd8d service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:01.504876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:01.510054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:01.510612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:01.511087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] PATH_INFO: `/v3/projects/f6320581cd774ce1a81e2e0d8e785cc2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:01.513181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6320581cd774ce1a81e2e0d8e785cc2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:01.515320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:01.520686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:01.522742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:01.555354 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1168/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:01.608361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6320581cd774ce1a81e2e0d8e785cc2', 'request_id': 'req-355906aa-920f-4e4f-bb49-4768412d2e26'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.620353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6320581cd774ce1a81e2e0d8e785cc2', 'request_id': 'req-355906aa-920f-4e4f-bb49-4768412d2e26'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.626435 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:01.632939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6320581cd774ce1a81e2e0d8e785cc2', 'request_id': 'req-355906aa-920f-4e4f-bb49-4768412d2e26'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.658613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] The token cache is being invalidate because project f6320581cd774ce1a81e2e0d8e785cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:01.658919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.659531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-355906aa-920f-4e4f-bb49-4768412d2e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.661426 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1134/2302] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:01 2022] DELETE /identity/v3/projects/f6320581cd774ce1a81e2e0d8e785cc2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:01.666814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:01.690242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab090c-37a9-4258-bc00-8c1f5861c5ce service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:01.719880 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:01.795143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1e7b-0632-41d4-ba47-ded8527a05d8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:01.795680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1e7b-0632-41d4-ba47-ded8527a05d8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:01.795680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1e7b-0632-41d4-ba47-ded8527a05d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:01.817635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9fab1e7b-0632-41d4-ba47-ded8527a05d8 None None] MFA Rules not processed for user `1070815bb60c44fcb6a586fd2d1f6e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:01.819024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fab1e7b-0632-41d4-ba47-ded8527a05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:01.826212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:01.827114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:01.827400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:01.827859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] PATH_INFO: `/v3/users/3c7cd3ceda034e3b962966d5df33c18a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:01.829111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7cd3ceda034e3b962966d5df33c18a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:01.833883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:01.886841 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1135/2303] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:01.895889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7cd3ceda034e3b962966d5df33c18a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.896593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7cd3ceda034e3b962966d5df33c18a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.910567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7cd3ceda034e3b962966d5df33c18a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.919531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7cd3ceda034e3b962966d5df33c18a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.940851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7cd3ceda034e3b962966d5df33c18a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:01.952444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1169/2304] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:01 2022] DELETE /identity/v3/users/3c7cd3ceda034e3b962966d5df33c18a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:02.253316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.254063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.254501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.278144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:02.279783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.355310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1136/2305] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:02.406382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:02.407857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.497558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e180ed8-8ce5-4d6e-8841-7caeda09c9a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:02.505827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:02.506510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.507195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.507195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.517195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:02.519406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b1d41-dcd4-443f-8e94-250e2d3169ae service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:02.530580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1170/2306] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:02.532061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:02.534482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.611560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874950-c226-4e6d-9090-f92ad8c7f8f8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.611865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874950-c226-4e6d-9090-f92ad8c7f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.612149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874950-c226-4e6d-9090-f92ad8c7f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.639429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2874950-c226-4e6d-9090-f92ad8c7f8f8 None None] MFA Rules not processed for user `7fe15455304f4fe4a990a1d32e0d1c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:02.640918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2874950-c226-4e6d-9090-f92ad8c7f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.681418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497471da-df1c-46ce-b7e9-13ef83460b53 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:02.687114 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:02.689969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:02.690926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.691215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.691496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] PATH_INFO: `/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.693561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64d3ef1977e4a1f9d5aa2b238fc2afa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:02.696076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:02.737730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1171/2307] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:02.753196 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:02.767778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64d3ef1977e4a1f9d5aa2b238fc2afa', 'request_id': 'req-9781f475-34f7-440a-87a5-041b1685c311'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:02.775123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64d3ef1977e4a1f9d5aa2b238fc2afa', 'request_id': 'req-9781f475-34f7-440a-87a5-041b1685c311'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:02.782309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64d3ef1977e4a1f9d5aa2b238fc2afa', 'request_id': 'req-9781f475-34f7-440a-87a5-041b1685c311'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:02.803116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] The token cache is being invalidate because project c64d3ef1977e4a1f9d5aa2b238fc2afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:02.803742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:02.804160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9781f475-34f7-440a-87a5-041b1685c311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:02.806816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1137/2308] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:02 2022] DELETE /identity/v3/projects/c64d3ef1977e4a1f9d5aa2b238fc2afa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:02.812726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.813090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.813628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.837557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:02.838867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.915854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1172/2309] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:02.923982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.924274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.924557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.945836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:02.947144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:02.955319 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1138/2310] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:02.959595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:02.970112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6d35-0939-43eb-afc6-4594d275dab1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:02.976352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:02.977024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:02.978519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:02.978519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:02.978970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:02.979178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:02.980819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:02.999560 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1173/2311] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:03.000618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.015351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0bb2e-4753-4376-8560-fe8fe10b18dc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.020299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.020978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.021257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.021529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.022422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.024409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.062884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.063973 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1139/2312] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:02 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:03.075531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c868f4-cdb0-46fd-b52f-d23e94eb7b6d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.149157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.151015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.151712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.152196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.153154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.155235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.200104 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1174/2313] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:03 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:10:03.205070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.225648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422da74-eac4-40a5-889d-47e8d822ffcb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.234164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.235423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.236005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.236664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.238176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.241263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.257475 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1140/2314] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:10:03.262613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.279627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eae1c-cba4-491b-a68b-5380c6162ad5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.284966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.285714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.286041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.286362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.287036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.288717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d0a6-2fc6-46a5-8426-088ab9251242 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.313652 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1175/2315] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:03.322028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.335813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94122e61-f772-46b0-bbfb-8ef580811840 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.342439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.343428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.343778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.344124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab/users/931f77e76e1041e096a7051ce0beae4c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.366236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fbf893f8a5440bb48e571eadee05ab, user_id=931f77e76e1041e096a7051ce0beae4c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.372007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.391849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1141/2316] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:03 2022] PUT /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab/users/931f77e76e1041e096a7051ce0beae4c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:03.405220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.405220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.405910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.449023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] MFA Rules not processed for user `931f77e76e1041e096a7051ce0beae4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:03.450727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:03.521163 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:03.586791 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1176/2317] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:03.593294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.771471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8666b8-01ff-46c8-9ce7-b34309be4f5a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:03.778986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:03.780181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:03.780478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:03.781112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:03.782588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:03.785492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:03.843414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:03.843634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1142/2318] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:03 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:03.866248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a29f-8a0a-4706-b3a5-f6e3ea0dd5e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:04.011217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:04.013611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.014202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.017440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.019349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:04.022119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:04.057197 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1177/2319] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:03 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:10:04.059790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:04.078331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ed7-9ca1-4558-967d-6f8afa6819d7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:04.089290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:04.091238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.092091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.093120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.095025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:04.099452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:04.137968 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1143/2320] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:04.145440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:04.161336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6f97e-cf96-48fa-8ef9-523c6e943ce1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:04.167806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:04.168757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.169039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.169319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] PATH_INFO: `/v3/projects/df1c91fe29364303b52fa69b9414bd34/users/20fa0e1a3caf4faa96153db22daa0bbc/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.189593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1c91fe29364303b52fa69b9414bd34, user_id=20fa0e1a3caf4faa96153db22daa0bbc, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:04.192364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:04.213820 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1178/2321] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:04 2022] PUT /identity/v3/projects/df1c91fe29364303b52fa69b9414bd34/users/20fa0e1a3caf4faa96153db22daa0bbc/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:04.217784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:04.241578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a868a3-1c42-444b-8728-1f24dae290da admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:04.389531 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:04.478357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:04.479172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.479472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.479754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.480609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:04.482415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62539-5621-4ba8-ac27-456c9f510923 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:04.515815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1144/2322] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:04.520231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:04.541305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df154f-6fce-4858-8e7d-5c6ff644e21c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:04.558417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:04.559319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.559599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.559868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] PATH_INFO: `/v3/projects/df1c91fe29364303b52fa69b9414bd34/users/20fa0e1a3caf4faa96153db22daa0bbc/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.568458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1c91fe29364303b52fa69b9414bd34, user_id=20fa0e1a3caf4faa96153db22daa0bbc, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:04.574565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:04.588839 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1179/2323] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:04 2022] PUT /identity/v3/projects/df1c91fe29364303b52fa69b9414bd34/users/20fa0e1a3caf4faa96153db22daa0bbc/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:04.600537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de7f6-da69-4fc7-a7fd-b48dd3eb11c0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:04.601084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de7f6-da69-4fc7-a7fd-b48dd3eb11c0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:04.601372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de7f6-da69-4fc7-a7fd-b48dd3eb11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:04.658674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3f7de7f6-da69-4fc7-a7fd-b48dd3eb11c0 None None] MFA Rules not processed for user `20fa0e1a3caf4faa96153db22daa0bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:04.662176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3f7de7f6-da69-4fc7-a7fd-b48dd3eb11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:04.792266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1145/2324] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:05.283663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:05.287780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:05.490236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645b596-64ba-4b45-8da0-c3e0abad4cb4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:05.500009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:05.500680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:05.501054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:05.501242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:05.521704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:05.523674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:05.554199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1180/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:05.565353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:05.565948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:05.566175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:05.567744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1146/2326] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:05.575203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:05.590860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:05.597370 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:05.606549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516549b6-d2c0-40b5-ae9f-82c549dffd94 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:05.616512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:05.617602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:05.618515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:05.618812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:05.620166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:05.622504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eccaa-3160-4648-9610-62b2b2d7d6a5 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:05.639546 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1181/2327] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:05 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:05.735785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:05.737837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:05.768513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e369c30-f0b7-424d-b7ec-865ad718b155 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:05.779252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:05.780262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:05.782369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:05.782887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:05.788219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:05.866119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b3e8-b939-4c97-b82d-3e9e87cd641a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:05.866357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b3e8-b939-4c97-b82d-3e9e87cd641a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:05.866607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5b3e8-b939-4c97-b82d-3e9e87cd641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:05.908441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9ad5b3e8-b939-4c97-b82d-3e9e87cd641a None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:05.912530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:05.914545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:05.916742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ad5b3e8-b939-4c97-b82d-3e9e87cd641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:05.947447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1147/2328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:05.950088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:05.955225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.092361 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1182/2329] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:06.094376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.096093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.096624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.102324 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:06.116755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1183/2330] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:06 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:06.119500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01a10-9f41-4975-b0c1-d7946a410521 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:06.119908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:06.124412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.137204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:06.138476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.138950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.139399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] PATH_INFO: `/v3/users/d9d620962dcc40a8afaf6f97ae605eec` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.142406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d620962dcc40a8afaf6f97ae605eec)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:06.156946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:06.235990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d620962dcc40a8afaf6f97ae605eec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:06.248985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d620962dcc40a8afaf6f97ae605eec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:06.267632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d620962dcc40a8afaf6f97ae605eec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:06.273611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2bc85-b3c8-43e7-840e-f09ed4ba9b25 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:06.280744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:06.282506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.282869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.283217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.296207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d620962dcc40a8afaf6f97ae605eec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:06.297226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d620962dcc40a8afaf6f97ae605eec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:06.298550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:06.301075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee9e28-8d18-4b00-83a0-8e9fa02e72fa service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:06.310133 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1148/2331] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:05 2022] DELETE /identity/v3/users/d9d620962dcc40a8afaf6f97ae605eec => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:06.314544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:06.318357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.322442 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1184/2332] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:06.324742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.325422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.325849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.349551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:06.351400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.445219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1185/2333] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:06.455506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:06.458055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.469200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:06.471570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.533510 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:06.562071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc9103-9662-447b-b60e-0ac90980a2ea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:06.566606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:06.567465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.567749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.568038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.583218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:06.584748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee8946-6d36-4846-9c65-6f0754b24150 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:06.585851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdb6be-67dd-44fa-aee4-04bf6684b288 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:06.594809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:06.595936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.596299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.596634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.598491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:06.599132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1186/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:06.601642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:06.604853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1149/2335] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:06 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:06.687642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.687935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.688210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.719106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] MFA Rules not processed for user `931f77e76e1041e096a7051ce0beae4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:06.720406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.826261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1187/2336] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:06.898946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:06.903577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:06.938303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2395-ace5-4c0f-ab40-77bba4d95f22 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:06.958153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:06.960334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:06.960622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:06.960901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] PATH_INFO: `/v3/projects/3a66209b0c5f43928a52519ee8f5edbf` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:06.962407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a66209b0c5f43928a52519ee8f5edbf)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:06.965230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:06.980228 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:07.067413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:07.075283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a66209b0c5f43928a52519ee8f5edbf', 'request_id': 'req-6685e0fa-f7a5-4f75-8519-58dcd2698be6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.084744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a66209b0c5f43928a52519ee8f5edbf', 'request_id': 'req-6685e0fa-f7a5-4f75-8519-58dcd2698be6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.094904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7fd49-172a-4254-b476-882c7daab7dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:07.101731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a66209b0c5f43928a52519ee8f5edbf', 'request_id': 'req-6685e0fa-f7a5-4f75-8519-58dcd2698be6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.121511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] The token cache is being invalidate because project 3a66209b0c5f43928a52519ee8f5edbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:07.121511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.122699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.127592 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1150/2337] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:06 2022] DELETE /identity/v3/projects/3a66209b0c5f43928a52519ee8f5edbf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:07.128641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:07.134560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:07.224959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:07.226109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:07.226418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:07.226633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:07.239046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:07.249404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e0fa-f7a5-4f75-8519-58dcd2698be6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:07.254558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:07.255997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:07.256361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:07.256849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] PATH_INFO: `/v3/users/a250ab409dd8445b910baf57f2e80b48` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:07.258793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a250ab409dd8445b910baf57f2e80b48)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:07.260875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:07.323737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a250ab409dd8445b910baf57f2e80b48'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.332154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a250ab409dd8445b910baf57f2e80b48'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.332619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:07.334549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:07.341449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a250ab409dd8445b910baf57f2e80b48'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.345337 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1188/2338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:07.355611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a250ab409dd8445b910baf57f2e80b48'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.356365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b95fe8-afd1-4bb5-ade6-f48594d7ede0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a250ab409dd8445b910baf57f2e80b48'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.362829 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1151/2339] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:07 2022] DELETE /identity/v3/users/a250ab409dd8445b910baf57f2e80b48 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:07.749032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:07.761171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92799-ec85-422a-8e33-0e85c0f3e25e service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:07.787663 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:07.848591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:07.848776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:07.848968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:07.849439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:07.849560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:07.849654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] PATH_INFO: `/v3/projects/a09785ffe2da4839a184914bfacfebc3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:07.849774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:07.850561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09785ffe2da4839a184914bfacfebc3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:07.851449 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1152/2340] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:07.853424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:07.859409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:07.861367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:07.878064 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:07.911854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09785ffe2da4839a184914bfacfebc3', 'request_id': 'req-cd8e1ccb-d814-4961-88c8-9d49a4151aef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.917342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09785ffe2da4839a184914bfacfebc3', 'request_id': 'req-cd8e1ccb-d814-4961-88c8-9d49a4151aef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.927430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09785ffe2da4839a184914bfacfebc3', 'request_id': 'req-cd8e1ccb-d814-4961-88c8-9d49a4151aef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.940925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] The token cache is being invalidate because project a09785ffe2da4839a184914bfacfebc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:07.941587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.942604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd8e1ccb-d814-4961-88c8-9d49a4151aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:07.944955 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1189/2341] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:07 2022] DELETE /identity/v3/projects/a09785ffe2da4839a184914bfacfebc3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:07.951256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ab47-331a-41be-a643-a867db8a3404 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:07.951795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ab47-331a-41be-a643-a867db8a3404 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:07.952280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ab47-331a-41be-a643-a867db8a3404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:07.974947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:07.976547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:07.980356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6fc9ab47-331a-41be-a643-a867db8a3404 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:07.981591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6fc9ab47-331a-41be-a643-a867db8a3404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:08.126853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5909c8-df88-4b3a-afff-5f8d037d2265 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.134416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1190/2342] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:08.146965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.147269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.148184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.176240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:08.177758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:08.193708 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1191/2343] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:08.201101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.233811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc50738-0ab1-4bbd-a80e-80e6a7867146 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.255709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.256388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.256667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.256939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.257806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:08.258062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.260984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.295870 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1192/2344] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:08.298030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.300137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.302718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.303355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.303832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.306026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.311081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.316420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636124ee-2929-4d93-aecb-36e2ac10b1f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.329600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1153/2345] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:07 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:10:08.335940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.336940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.337807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.338092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.338830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.340813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.409257 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1193/2346] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:08 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:10:08.413517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.441981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6af79-2da5-4ae0-b132-f6914b1f22fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.549681 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:08.564997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.565767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.566050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.566324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.567086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.569214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.612454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1154/2347] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:08 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:08.616418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.647781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7071e4-6397-4b15-a657-97c5c2c94d94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.664134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.674707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.675039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.675283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.676064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.678375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdb4b7-402a-42e0-99c3-ca2eec3705e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.682462 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:08.695891 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1194/2348] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:08.700397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.717107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff8cb-a456-4984-b0da-622eee5b5e88 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.723318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.724778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.725139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.725599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.726857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.730177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.750352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1155/2349] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:08.751241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.752025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.752236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.752780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.765388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f2e8-ea3b-408d-9402-4a38f46dff12 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:08.771710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:08.772745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.773228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.774805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] PATH_INFO: `/v3/projects/04e5954e848b49e7986b9f72eb5ea64c/users/4f864a97463e4afb960a6c136e65b829/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.782549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:08.784560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:08.798094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e5954e848b49e7986b9f72eb5ea64c, user_id=4f864a97463e4afb960a6c136e65b829, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:08.801336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b93f9a-188b-4840-a685-e01c704dbb3e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:08.824593 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1156/2350] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:08 2022] PUT /identity/v3/projects/04e5954e848b49e7986b9f72eb5ea64c/users/4f864a97463e4afb960a6c136e65b829/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:08.834820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6106-5383-4649-a4c3-99ac0673e5ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:08.835439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6106-5383-4649-a4c3-99ac0673e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:08.835718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6106-5383-4649-a4c3-99ac0673e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:08.904686 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1195/2351] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:08.921382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4f5b6106-5383-4649-a4c3-99ac0673e5ce None None] MFA Rules not processed for user `4f864a97463e4afb960a6c136e65b829`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:08.923453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f5b6106-5383-4649-a4c3-99ac0673e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:08.925473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:08.929769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:09.098637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aee557-7bf3-4d7b-adfe-224b70c7deae None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.174137 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1157/2352] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:09.174137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec88-8121-45b6-8c7d-c0dc2478e006 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.174137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec88-8121-45b6-8c7d-c0dc2478e006 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.174137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec88-8121-45b6-8c7d-c0dc2478e006 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.177768 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1158/2353] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:09.181134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ec88-8121-45b6-8c7d-c0dc2478e006 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.258699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.259551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.259833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.260106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.370347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ec88-8121-45b6-8c7d-c0dc2478e006 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.376677 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:09.379868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.380580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.380866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.381147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.382048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.384463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.407018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.408673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.422196 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1196/2354] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:09.424348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:09.439137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:09.454149 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1159/2355] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:09 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:09.455001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.536777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:09.619043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af19ac-d486-4bd0-8042-eebede11b00e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.630996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.631653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.631994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.632271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.633002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.640030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.644842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.647485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:09.688398 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1160/2356] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:09 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:09.690072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.704101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a693c-bd07-4051-9140-dce6dadb7ba6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.710670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.712019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.712548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.712944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.713904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.716206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.748515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1161/2357] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:09.754217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.772408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1c636-7cda-41f1-9af6-d86a19820af3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.779199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.780263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.780635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.780999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] PATH_INFO: `/v3/projects/9802057829b44d1cb0ad2da97ecfd44d/users/2f0e08c1fbf44b8da2ae8bcb435e7b62/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.806555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043c211-7328-41e7-a26b-a5d359ef7626 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.814368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9802057829b44d1cb0ad2da97ecfd44d, user_id=2f0e08c1fbf44b8da2ae8bcb435e7b62, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.817993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.849346 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1162/2358] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:09 2022] PUT /identity/v3/projects/9802057829b44d1cb0ad2da97ecfd44d/users/2f0e08c1fbf44b8da2ae8bcb435e7b62/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:10:09.851254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.918155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.919133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.919533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.919813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.921403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.923616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.926443 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1197/2359] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:09 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:09.937798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6d018-c7fc-4f6a-b107-c6092bad9504 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.944260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.945376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.945765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.946104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.946856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.953255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03de0cc-3d26-4d68-8297-c1aaf36f7a13 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:09.960187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1163/2360] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:09.964336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:09.975625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d67165-8dcb-4db9-ad8d-591e1e376cf0 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:09.987150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:09.988892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:09.989248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:09.989604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] PATH_INFO: `/v3/projects/9802057829b44d1cb0ad2da97ecfd44d/users/2f0e08c1fbf44b8da2ae8bcb435e7b62/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:09.991944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9802057829b44d1cb0ad2da97ecfd44d, user_id=2f0e08c1fbf44b8da2ae8bcb435e7b62, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:09.994968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b503fd-bbf7-44dd-860e-86fcf17ceb93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:10.018004 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1198/2361] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:09 2022] PUT /identity/v3/projects/9802057829b44d1cb0ad2da97ecfd44d/users/2f0e08c1fbf44b8da2ae8bcb435e7b62/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:10.019923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccedb9-686f-4faa-b24b-8d0ef37e5275 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.020266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccedb9-686f-4faa-b24b-8d0ef37e5275 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.020552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccedb9-686f-4faa-b24b-8d0ef37e5275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.087383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.088459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.089953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.092795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f8ccedb9-686f-4faa-b24b-8d0ef37e5275 None None] MFA Rules not processed for user `2f0e08c1fbf44b8da2ae8bcb435e7b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:10.094400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f8ccedb9-686f-4faa-b24b-8d0ef37e5275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:10.096780 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1199/2362] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:10 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:10.103535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:10.107147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:10.167805 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:10.269429 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1164/2363] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:10.284694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974de9-83cc-4f36-a8b2-689269af637c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.285025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974de9-83cc-4f36-a8b2-689269af637c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.285262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14974de9-83cc-4f36-a8b2-689269af637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.299529 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:10.302588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:10.319712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-14974de9-83cc-4f36-a8b2-689269af637c None None] MFA Rules not processed for user `4f864a97463e4afb960a6c136e65b829`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:10.322734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14974de9-83cc-4f36-a8b2-689269af637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:10.427711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1165/2364] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:10.455249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9c3b0-abb5-4334-8948-bf7240558588 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:10.455823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.456080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.456364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.460944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:10.461980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.462355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.462790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.464942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:10.468751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd32f4c-064d-4201-92a3-e82685ea7338 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:10.471705 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1200/2365] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:10 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:10:10.508182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] MFA Rules not processed for user `b96d7edf06d147bb94869c925933a78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:10.511618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:10.626857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a17018-5fb5-496c-b65f-507266e6f086 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.627161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a17018-5fb5-496c-b65f-507266e6f086 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.627436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a17018-5fb5-496c-b65f-507266e6f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.639151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1166/2366] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:10.653023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-72a17018-5fb5-496c-b65f-507266e6f086 None None] MFA Rules not processed for user `931f77e76e1041e096a7051ce0beae4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:10.654939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-72a17018-5fb5-496c-b65f-507266e6f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:10.723001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:10.723649 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1201/2367] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:10.737879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18e99-bbcd-406f-9413-e4e76e6e7c38 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:10.745252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:10.745955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:10.746241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:10.746548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:10.755082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:10.756685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0079-a603-48d9-b409-6933b89362ec service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:10.767021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1167/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:11.349880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:11.350540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:11.351329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:11.384052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] MFA Rules not processed for user `b96d7edf06d147bb94869c925933a78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:11.388437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:11.402766 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1202/2369] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:12.388358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adfe41-fa37-4969-a6a4-3babab851b99 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:12.389016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adfe41-fa37-4969-a6a4-3babab851b99 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:12.389016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adfe41-fa37-4969-a6a4-3babab851b99 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:12.390315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1168/2370] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:10:12.395471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:12.410779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:12.423133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd28fc-1d8b-4372-9d75-4294e5ad952f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:12.428520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:12.429395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:12.429700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:12.429973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:12.431721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:12.433964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:12.437190 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1203/2371] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:12 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:12.649381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e1d1-d6d2-42cd-ab5d-b8ad618b2781 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:12.650154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e1d1-d6d2-42cd-ab5d-b8ad618b2781 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:12.650154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e1d1-d6d2-42cd-ab5d-b8ad618b2781 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:12.651655 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1169/2372] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:12.656481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:12.673414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:12.684494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395345-f307-4e00-9be6-9c9c9ba562fa tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:12.690027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:12.690938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:12.691398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:12.691934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:12.694040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:12.698307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:12.703023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1204/2373] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:12 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:13.368114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77703ca-765c-49e6-852f-08365b38def5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:13.368435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77703ca-765c-49e6-852f-08365b38def5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:13.369384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77703ca-765c-49e6-852f-08365b38def5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:13.370914 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1170/2374] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:13.378531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:13.401261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:13.434596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5166b7-4d93-4799-b05b-1e3c7d857b2e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:13.443334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:13.444895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:13.448244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:13.448835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:13.450613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:13.452960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2466b-48ed-4b7e-9b6a-76158ec77a46 tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:13.464750 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1205/2375] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:13 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:13.637857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:13.638383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:13.638383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:13.670180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] MFA Rules not processed for user `931f77e76e1041e096a7051ce0beae4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:13.675555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:13.685318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1171/2376] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:15.473431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:15.474188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:15.474626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:15.476376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1206/2377] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:15.482199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:15.495942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:15.505934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa3100-fab0-4883-a101-ce8a865e7277 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:15.510847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20fa0e1a3caf4faa96153db22daa0bbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df1c91fe29364303b52fa69b9414bd34', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:15.511733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:15.511996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:15.512269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:15.513454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:15.515562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150735a-ac59-44db-9768-98c8d304001e tempest-QuotasAdminNegativeTest-1324395571 tempest-QuotasAdminNegativeTest-1324395571-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:15.517885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1172/2378] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:15 2022] GET /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 381 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:16.140041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:16.140041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:16.174257 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:16.247051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20bea5-cac9-4638-b3d6-c346154c752d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:16.263123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:16.264758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:16.265336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:16.266549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] PATH_INFO: `/v3/users/931f77e76e1041e096a7051ce0beae4c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:16.269964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931f77e76e1041e096a7051ce0beae4c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:16.274633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:16.356142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931f77e76e1041e096a7051ce0beae4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:16.357020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931f77e76e1041e096a7051ce0beae4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:16.365453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931f77e76e1041e096a7051ce0beae4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:16.373785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931f77e76e1041e096a7051ce0beae4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:16.388823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931f77e76e1041e096a7051ce0beae4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:16.396219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1207/2379] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:16 2022] DELETE /identity/v3/users/931f77e76e1041e096a7051ce0beae4c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:16.402013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:16.402302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:16.402582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:16.423774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:16.425072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:16.501948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1173/2380] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:16.509597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:16.511131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:16.587404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f3ef0-bbfc-4964-bf6f-ebd118fd5275 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:16.591817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:16.592659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:16.592974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:16.593210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:16.604661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:16.606569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:16.618221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1208/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:17.592045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:17.605516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:17.644844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3e236-db8f-4347-9215-b2f56516d8f2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:17.667103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:17.671917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:17.672609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:17.673086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] PATH_INFO: `/v3/projects/c6fbf893f8a5440bb48e571eadee05ab` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:17.677556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6fbf893f8a5440bb48e571eadee05ab)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:17.693418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:17.725546 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:17.775810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6fbf893f8a5440bb48e571eadee05ab', 'request_id': 'req-fd144964-91dd-4c95-9f4f-23fdf299d3e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:17.783899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6fbf893f8a5440bb48e571eadee05ab', 'request_id': 'req-fd144964-91dd-4c95-9f4f-23fdf299d3e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:17.794069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6fbf893f8a5440bb48e571eadee05ab', 'request_id': 'req-fd144964-91dd-4c95-9f4f-23fdf299d3e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:17.811694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] The token cache is being invalidate because project c6fbf893f8a5440bb48e571eadee05ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:17.811897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:17.813608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:17.815898 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1174/2382] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:17 2022] DELETE /identity/v3/projects/c6fbf893f8a5440bb48e571eadee05ab => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:17.823643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:17.842061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6f678-ce62-40cf-9455-c701647db055 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:17.935890 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:17.958674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:17.959597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:17.959875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:17.960145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] PATH_INFO: `/v3/users/20fa0e1a3caf4faa96153db22daa0bbc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:17.961554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fa0e1a3caf4faa96153db22daa0bbc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:17.964386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:18.032822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fa0e1a3caf4faa96153db22daa0bbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.033572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fa0e1a3caf4faa96153db22daa0bbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.043537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fa0e1a3caf4faa96153db22daa0bbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.053808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fa0e1a3caf4faa96153db22daa0bbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.073711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6fa8aa30-bcaf-4120-bb8c-8d327764f71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fa0e1a3caf4faa96153db22daa0bbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.080924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1209/2383] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:17 2022] DELETE /identity/v3/users/20fa0e1a3caf4faa96153db22daa0bbc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:18.492480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:18.494259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:18.519393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd144964-91dd-4c95-9f4f-23fdf299d3e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:18.617074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:18.619007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:18.619502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:18.619994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] PATH_INFO: `/v3/projects/df1c91fe29364303b52fa69b9414bd34` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:18.622271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1c91fe29364303b52fa69b9414bd34)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:18.627439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:18.701349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1c91fe29364303b52fa69b9414bd34', 'request_id': 'req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.709236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1c91fe29364303b52fa69b9414bd34', 'request_id': 'req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.720857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1c91fe29364303b52fa69b9414bd34', 'request_id': 'req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.754532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] The token cache is being invalidate because project df1c91fe29364303b52fa69b9414bd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:18.754721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.755754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85f9b163-f6b9-47c6-9de7-ebb8a7c22fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:18.763378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1175/2384] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:18 2022] DELETE /identity/v3/projects/df1c91fe29364303b52fa69b9414bd34 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:18.765000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:18.765377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:18.765564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:18.809544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:18.812907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:18.891408 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1210/2385] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:18.900498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:18.900779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:18.901312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:18.946676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:18.951262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:18.993751 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1176/2386] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:18.998114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.009639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5c98-5411-4e17-980f-fd97c5da6a73 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.019614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.021389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.021983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.022579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.023731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:19.024053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.025926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.049715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.057306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1211/2387] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:19.064341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cbe06-3c84-4c0f-8b91-e2411c8684db None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.070059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.071057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.071504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.071999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.073103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.075879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.145928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1177/2388] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:19 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:10:19.151812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.167973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941600-217b-45fb-9869-aa9200ae9f31 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.284877 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:19.301305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.302478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.302936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.303366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.304402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.307575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.349896 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1212/2389] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:19 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:19.352454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.391103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc510fe-0023-450d-88ff-d9694da985c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.406272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.407042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.407328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.407609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.408384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.410188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.413234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:19.426412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1178/2390] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:10:19.430519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.444708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e515b-1141-43af-845d-08c397f707c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.454985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.455700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.455982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.456257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.457231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.462050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3b511-11f1-46b2-8cdf-b6ee5ffd0c6a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.476348 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1213/2391] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:10:19.481896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.494852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359071-5421-4c9f-9d82-513ff79c0634 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.500469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.501763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.501971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.502277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] PATH_INFO: `/v3/projects/6c9db762e4c14d538ea1c9de1b204c95/users/01b0f82f73ea4c14a51c5481e78d4493/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.521302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9db762e4c14d538ea1c9de1b204c95, user_id=01b0f82f73ea4c14a51c5481e78d4493, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.524392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.542470 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1179/2392] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:19 2022] PUT /identity/v3/projects/6c9db762e4c14d538ea1c9de1b204c95/users/01b0f82f73ea4c14a51c5481e78d4493/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:10:19.548783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2383bd-18a4-4240-87b6-30d93e51f204 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.549221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2383bd-18a4-4240-87b6-30d93e51f204 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.549578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2383bd-18a4-4240-87b6-30d93e51f204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.572210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9f2383bd-18a4-4240-87b6-30d93e51f204 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:19.573577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9f2383bd-18a4-4240-87b6-30d93e51f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:19.684748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1214/2393] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:19.699367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:19.703047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:19.901411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cd9e1-971b-4f6f-9961-cf849afe6298 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:19.908847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:19.910059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:19.910503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:19.910986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:19.938144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:19.954496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ef51-95e0-4061-8264-3f2077a014b9 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:19.977572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1180/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:23.509160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:23.509771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:23.510088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:23.512097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1215/2395] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:10:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:23.518653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a7ff-5864-465b-b1ee-8d099c52fe25 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:23.519151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a7ff-5864-465b-b1ee-8d099c52fe25 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:23.519337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742a7ff-5864-465b-b1ee-8d099c52fe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:23.541368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2742a7ff-5864-465b-b1ee-8d099c52fe25 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:23.542861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2742a7ff-5864-465b-b1ee-8d099c52fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:23.661374 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1181/2396] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:23.683200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:23.685479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:23.715973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ec4a0-65fd-4003-a9c8-50d3c9ca8aac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:23.725423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:23.726567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:23.727382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:23.727782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:23.738677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:23.740673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826d8f3-546f-4b39-83ef-1a2d4614470e service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:23.781068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1216/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:25.030466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:25.031469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:25.031942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:25.061759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] MFA Rules not processed for user `b3861659794d4aa699ca3e984999a1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:25.064028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:25.144695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1182/2398] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:31.674771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:31.675324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:31.675324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:31.748936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] MFA Rules not processed for user `01b0f82f73ea4c14a51c5481e78d4493`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:31.750458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:31.812850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:31.814412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:31.843594 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:31.960093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1217/2399] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:31.964443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:31.991823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066871b-36f1-4260-adfe-9f2712047121 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.011425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.012156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.012401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.012684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.013411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.015416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.017645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ea38f-fabd-4cfe-a5ff-0d20fee6a274 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.082556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.088940 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1218/2400] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:31 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:32.089830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.090133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.091025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:32.095572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.109296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:32.224848 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:32.314863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fcce9-27bf-43fc-8fcf-0f8e9b4241f4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.329537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.334333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.334629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.334913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.339454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.352960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.354871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.362835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.386119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1219/2401] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:32 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:32.387445 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1183/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:32.392904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:32.443528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea5e3d-73b8-48fd-84ed-54c2232d4ac0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.461702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.462539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.462824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.463096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.463856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.469161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.499621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1220/2403] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:32.503636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:32.552881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c920-f1ba-4a8f-a958-b95fdbd9990a service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.568834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.570577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.570870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.571201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] PATH_INFO: `/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311/users/a79c6bb21f4d4b8a89acbe6c70b539e6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.646767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9b63fe4a5a49b79a5172f01e8c8311, user_id=a79c6bb21f4d4b8a89acbe6c70b539e6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.651906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.690146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:32.691087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1184/2404] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:32 2022] PUT /identity/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311/users/a79c6bb21f4d4b8a89acbe6c70b539e6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:32.709796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dc15-c4f5-4768-ad15-9009accb97f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.813711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.814614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.814870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.815243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.816087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.817841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.829976 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1221/2405] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:32.834235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:32.884576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c104aac-b634-4dce-b36f-884c70cad53f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:32.904130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:32.906584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:32.906880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:32.908335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] PATH_INFO: `/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311/users/a79c6bb21f4d4b8a89acbe6c70b539e6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:32.918920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9b63fe4a5a49b79a5172f01e8c8311, user_id=a79c6bb21f4d4b8a89acbe6c70b539e6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:32.925554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93c779-369a-4dbe-9b28-887c926384e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:32.956918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1185/2406] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:32 2022] PUT /identity/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311/users/a79c6bb21f4d4b8a89acbe6c70b539e6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:38.558540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:38.560675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:38.583953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4b5ed-5552-4d9b-8612-e7eb0e5c3ffe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:38.830089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:38.831138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:38.831428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:38.831700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] PATH_INFO: `/v3/users/1070815bb60c44fcb6a586fd2d1f6e71` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:38.836135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1070815bb60c44fcb6a586fd2d1f6e71)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:38.852858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:38.962576 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:38.965526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1070815bb60c44fcb6a586fd2d1f6e71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:38.967808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1070815bb60c44fcb6a586fd2d1f6e71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:38.991233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1070815bb60c44fcb6a586fd2d1f6e71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:39.015504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1070815bb60c44fcb6a586fd2d1f6e71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:39.082473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1070815bb60c44fcb6a586fd2d1f6e71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:39.114133 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1222/2407] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:38 2022] DELETE /identity/v3/users/1070815bb60c44fcb6a586fd2d1f6e71 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:39.119958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c300-c641-4ecd-bf6f-652200a5a70c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:39.120505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c300-c641-4ecd-bf6f-652200a5a70c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:39.120505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c300-c641-4ecd-bf6f-652200a5a70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:39.170907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7bb7c300-c641-4ecd-bf6f-652200a5a70c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:39.172171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bb7c300-c641-4ecd-bf6f-652200a5a70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:39.348385 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1186/2408] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:39.368156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:39.369935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:39.505818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084a758-22d7-402d-9f04-e79410061f45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:39.512062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:39.512661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:39.512946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:39.513226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:39.541268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:39.542420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:39.566884 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1223/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:40.250784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:40.252191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:40.252645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:40.310981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:40.324298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] MFA Rules not processed for user `a79c6bb21f4d4b8a89acbe6c70b539e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:40.325629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:40.463727 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1187/2410] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:40.479675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:40.481534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:40.533068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:40.534621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:40.555681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51af2-9f37-4947-8ec8-7dca0c68b80a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:40.562443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:40.563511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:40.563628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:40.563880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] PATH_INFO: `/v3/projects/7a228611da9b47f785568447a4caa0eb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:40.565330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a228611da9b47f785568447a4caa0eb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:40.567457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:40.567744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0cbb-8f59-42a5-8cc1-7bceb275ff21 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:40.574710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:40.576934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:40.577602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:40.578325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:40.597275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:40.601789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:40.633989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1224/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:40.790754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a228611da9b47f785568447a4caa0eb', 'request_id': 'req-25e13745-3841-45d7-bcb6-4e393301d388'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:40.809250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a228611da9b47f785568447a4caa0eb', 'request_id': 'req-25e13745-3841-45d7-bcb6-4e393301d388'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:40.836828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a228611da9b47f785568447a4caa0eb', 'request_id': 'req-25e13745-3841-45d7-bcb6-4e393301d388'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:40.856199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] The token cache is being invalidate because project 7a228611da9b47f785568447a4caa0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:40.856550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:40.857188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:40.859064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1188/2412] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:40 2022] DELETE /identity/v3/projects/7a228611da9b47f785568447a4caa0eb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:40.863293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:40.927206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a949d-f1ec-45d5-bd89-031ae182332e service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:41.089549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:41.092308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:41.097355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:41.097776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] PATH_INFO: `/v3/users/29186ffc84d64ac29b1d2b66e7e31cd9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:41.099228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29186ffc84d64ac29b1d2b66e7e31cd9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:41.105307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:41.144221 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:41.284263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29186ffc84d64ac29b1d2b66e7e31cd9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:41.294234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29186ffc84d64ac29b1d2b66e7e31cd9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:41.310290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29186ffc84d64ac29b1d2b66e7e31cd9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:41.322766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29186ffc84d64ac29b1d2b66e7e31cd9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:41.345946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0a8cf97-17b1-4cfb-8b64-a4c77bc8cc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29186ffc84d64ac29b1d2b66e7e31cd9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:41.364210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1225/2413] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:40 2022] DELETE /identity/v3/users/29186ffc84d64ac29b1d2b66e7e31cd9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:42.103955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:42.108110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:42.176269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13745-3841-45d7-bcb6-4e393301d388 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:42.498741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:42.500074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:42.503229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:42.505696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] PATH_INFO: `/v3/projects/930f37d3579f4c2a8166fd439bcc56da` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:42.511518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=930f37d3579f4c2a8166fd439bcc56da)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:42.517643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:42.614183 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:42.700652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930f37d3579f4c2a8166fd439bcc56da', 'request_id': 'req-653058fd-6eae-4756-990a-88c023b95dbc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:42.711645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930f37d3579f4c2a8166fd439bcc56da', 'request_id': 'req-653058fd-6eae-4756-990a-88c023b95dbc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:42.722807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930f37d3579f4c2a8166fd439bcc56da', 'request_id': 'req-653058fd-6eae-4756-990a-88c023b95dbc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:42.768252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] The token cache is being invalidate because project 930f37d3579f4c2a8166fd439bcc56da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:42.768874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:42.770571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-653058fd-6eae-4756-990a-88c023b95dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:42.779667 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1189/2414] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:42 2022] DELETE /identity/v3/projects/930f37d3579f4c2a8166fd439bcc56da => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:42.782259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f0e8-5f19-4eee-9a8d-f38c68ab9544 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:42.783113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f0e8-5f19-4eee-9a8d-f38c68ab9544 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:42.783562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f0e8-5f19-4eee-9a8d-f38c68ab9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:42.832052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5e76f0e8-5f19-4eee-9a8d-f38c68ab9544 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:42.838658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5e76f0e8-5f19-4eee-9a8d-f38c68ab9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:42.967459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:42.967981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:42.968508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:42.996066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:42.998313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:43.071494 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1226/2415] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:43.073012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.073309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.073589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.102866 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1190/2416] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:43.104096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.105801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:43.146924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:43.148719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:43.175216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1227/2417] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:43.186804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.206289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a558a-2c80-400e-a729-a18f3770c159 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.207982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7455-ac3f-4ac6-b4f0-6b1b2ecd0eb1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.214839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.215893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.216244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.216582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.235341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.235854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.236113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.236415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.237113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:43.237424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.239102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.251366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.254330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.277445 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1191/2418] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:43.284753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.291331 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1228/2419] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:43.308890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fbb74-de24-4710-95ce-851b4272dd47 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.326125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.326851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.327137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.327415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.328136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.330415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.476847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.488722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1192/2420] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:43 2022] POST /identity/v3/projects => generated 395 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:43.498624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4be0-bca2-49ed-83aa-5e2094e9f37b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.672197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.674540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:43.711628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.713127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.713587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.714041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.714912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.717039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.765033 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:43.793527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1229/2421] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:43 2022] POST /identity/v3/users => generated 298 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:43.795694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.819309 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:43.850965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b304eb-adc0-4c30-82ba-e3a26149f93f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.874368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.877639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.881129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.881718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.891769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.897165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.948179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1230/2422] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:43.948437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bc66-b525-4640-ac4f-fc60e60911b0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:43.949578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:43.955697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:43.959515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:43.960080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:43.960623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] PATH_INFO: `/v3/users/4f864a97463e4afb960a6c136e65b829` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:43.962820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f864a97463e4afb960a6c136e65b829)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:43.965164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:43.983957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5c1d-2cd9-4461-babc-cf1a199d35db admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:44.005866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:44.006649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:44.006924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:44.007260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:44.010883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:44.018648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:44.058471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f864a97463e4afb960a6c136e65b829'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:44.070713 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1231/2423] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:44.071729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:44.080021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f864a97463e4afb960a6c136e65b829'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:44.118685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f864a97463e4afb960a6c136e65b829'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:44.120876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ff58b-aa2d-4ae7-81f2-e907e556ac5c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:44.143486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:44.147027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:44.148608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:44.149061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c/users/bc58047717b243ce9e59242f8275acff/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:44.173850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f864a97463e4afb960a6c136e65b829'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:44.177290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a54ccd5-7539-4403-9069-50d180144cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f864a97463e4afb960a6c136e65b829'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:44.209940 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1193/2424] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:43 2022] DELETE /identity/v3/users/4f864a97463e4afb960a6c136e65b829 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:44.212601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:44.213627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c, user_id=bc58047717b243ce9e59242f8275acff, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:44.214110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:44.214567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:44.221992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128eeda-c209-4f55-8e82-ae6e3193c8e3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:44.264641 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1232/2425] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:44 2022] PUT /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c/users/bc58047717b243ce9e59242f8275acff/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:44.287776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:44.289053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:44.289316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:44.296886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:44.304037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:44.458434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] MFA Rules not processed for user `bc58047717b243ce9e59242f8275acff`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:44.460562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:44.763492 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1194/2426] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:44.783115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:44.784541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:44.790479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1233/2427] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:44.791584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:44.795954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:44.846628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01813f26-9567-4761-8e6e-574c2978df8a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:44.857205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:44.857933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:44.858218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:44.858650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:44.859579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:44.864895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:44.929612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1234/2428] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:44 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:44.929612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:45.036682 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:45.087762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ac3f6-63d2-4a0a-a861-5fa0fb48b89d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:45.091975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb418b-b4f8-432b-99db-832d060a9e30 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:45.103665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:45.104381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:45.104668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:45.104945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:45.105651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:45.107637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:45.157080 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1235/2429] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:44 2022] POST /identity/v3/users => generated 303 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:45.158162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:45.182619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f457f-b372-4fc2-b631-2e7d1e626c94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:45.204365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:45.205756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:45.206046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:45.206314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:45.207071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:45.208728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:45.214761 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:45.239159 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1236/2430] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:45.240134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:45.267013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394563-e99c-4606-ad0c-9265ab7cf301 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:45.283051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:45.283976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:45.284456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:45.284773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] PATH_INFO: `/v3/projects/293506e56f5148a2a635e914a25e71d3/users/4327bc6f292c43f780d905a55502ed4c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:45.359172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293506e56f5148a2a635e914a25e71d3, user_id=4327bc6f292c43f780d905a55502ed4c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:45.366476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:45.423412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1237/2431] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:45 2022] PUT /identity/v3/projects/293506e56f5148a2a635e914a25e71d3/users/4327bc6f292c43f780d905a55502ed4c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:45.429190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:45.436483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:45.439682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:45.440138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:45.440585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:45.483135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:45.494190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:45.566777 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1195/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:45.866424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae57b5-9247-4fea-aec7-56e4925e1063 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:45.900194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:45.901387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:45.906137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:45.906435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:45.907224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:45.908868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969507cb-2046-410e-bf2f-22bb796a847f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:45.982316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:46.021080 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1238/2433] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:46.022241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228464-e48d-48cd-a014-bfcb717f12ce service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:46.051761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:46.052777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:46.053162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:46.053620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] PATH_INFO: `/v3/projects/293506e56f5148a2a635e914a25e71d3/users/4327bc6f292c43f780d905a55502ed4c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:46.065376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293506e56f5148a2a635e914a25e71d3, user_id=4327bc6f292c43f780d905a55502ed4c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:46.074235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:46.145929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:46.146604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:46.147130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:46.147589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1196/2434] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:45 2022] PUT /identity/v3/projects/293506e56f5148a2a635e914a25e71d3/users/4327bc6f292c43f780d905a55502ed4c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:10:46.266707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] MFA Rules not processed for user `4327bc6f292c43f780d905a55502ed4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:46.272088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:46.620226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:46.643707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1239/2435] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:46.761921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e17d-a4db-4309-9775-40d15f302596 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:46.780341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:46.781026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:46.781304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:46.781577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:46.782320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:46.784434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:46.852660 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1197/2436] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:46 2022] POST /identity/v3/projects => generated 393 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:10:46.857963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:46.874759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3851d-508f-4e79-87c1-ca2b8c6d83dd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:46.997061 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:47.021572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:47.023201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.023517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.023792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.025927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:47.030861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:47.100503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:47.111655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1240/2437] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:46 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:47.124902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:47.127766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:47.130936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08d3c4-0963-402a-899b-6f348eeb6b1e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:47.170176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:47.171065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.172472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.172916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.174897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:47.179869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:47.183902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fcbbe-e825-4202-a980-5450b94035d8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:47.209691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:47.220917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.221209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.244908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] PATH_INFO: `/v3/projects/04e5954e848b49e7986b9f72eb5ea64c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.248284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e5954e848b49e7986b9f72eb5ea64c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:47.252700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1198/2438] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:47.253738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:47.265237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:47.341227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a20b9b-f49a-4b8d-a9b6-f3060c217a7f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:47.394940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:47.395631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.395913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.396185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.396996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:47.422041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:47.518780 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1199/2439] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:47.520002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:47.577239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e5954e848b49e7986b9f72eb5ea64c', 'request_id': 'req-95985db7-f7da-4ef5-b7ce-d18aced02da0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:47.580022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2946f-4c22-4e6f-9230-fd292cda4b8d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:47.597094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e5954e848b49e7986b9f72eb5ea64c', 'request_id': 'req-95985db7-f7da-4ef5-b7ce-d18aced02da0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:47.641549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e5954e848b49e7986b9f72eb5ea64c', 'request_id': 'req-95985db7-f7da-4ef5-b7ce-d18aced02da0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:47.690702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] The token cache is being invalidate because project 04e5954e848b49e7986b9f72eb5ea64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:47.690931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:47.707022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:47.718814 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1241/2440] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:47 2022] DELETE /identity/v3/projects/04e5954e848b49e7986b9f72eb5ea64c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:10:47.727673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:47.735875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:47.797530 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:47.813951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:47.815747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.816554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.817156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] PATH_INFO: `/v3/projects/8294ba72d7624d8baf9148c515f61005/users/7c23ce3af4304d6cb614fd40c25a38d0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.853715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8294ba72d7624d8baf9148c515f61005, user_id=7c23ce3af4304d6cb614fd40c25a38d0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:47.858957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48cb9b-82ed-4888-91f3-0652530e50ec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:47.907416 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1200/2441] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:47 2022] PUT /identity/v3/projects/8294ba72d7624d8baf9148c515f61005/users/7c23ce3af4304d6cb614fd40c25a38d0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:47.939540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:47.940853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:47.941358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:47.993961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985db7-f7da-4ef5-b7ce-d18aced02da0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:48.039762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] MFA Rules not processed for user `7c23ce3af4304d6cb614fd40c25a38d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:48.041889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:48.195093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:48.203469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:48.204295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:48.205859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] PATH_INFO: `/v3/users/2f0e08c1fbf44b8da2ae8bcb435e7b62` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:48.208169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0e08c1fbf44b8da2ae8bcb435e7b62)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:48.212156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:48.264453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1201/2442] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:48.274846 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:48.447029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:48.448959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:48.458900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0e08c1fbf44b8da2ae8bcb435e7b62'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:48.459866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0e08c1fbf44b8da2ae8bcb435e7b62'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:48.480661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0e08c1fbf44b8da2ae8bcb435e7b62'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:48.530616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0e08c1fbf44b8da2ae8bcb435e7b62'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:48.596010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ae6221e-1efb-44b4-905b-9fc092232e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0e08c1fbf44b8da2ae8bcb435e7b62'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:48.623673 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1242/2443] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:47 2022] DELETE /identity/v3/users/2f0e08c1fbf44b8da2ae8bcb435e7b62 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:48.649374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32f53-b2b5-4f8a-9008-0be2f22ce603 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:48.762076 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:48.779541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:48.780042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:48.780583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:48.780991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:48.783825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:48.881153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:48.885459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:48.899982 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1202/2444] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:49.440708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:49.441300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:49.442172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:49.446620 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1243/2445] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:49.453204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:49.456326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:49.486512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:49.498006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfa845-0b4d-4cdd-bc35-34f1351aacbf service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:49.503699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:49.504722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:49.505107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:49.505639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:49.509419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:49.511865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bf86-7f21-484f-80c1-9a06130ec75c tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:49.541943 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1203/2446] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:49 2022] GET /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 395 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:49.684055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:49.687761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:49.905150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41601c-4b13-44f0-8877-4d872de25a84 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:49.909792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:49.911309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:49.911695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:49.912168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] PATH_INFO: `/v3/projects/9802057829b44d1cb0ad2da97ecfd44d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:49.915585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9802057829b44d1cb0ad2da97ecfd44d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:49.921315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:50.059982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9802057829b44d1cb0ad2da97ecfd44d', 'request_id': 'req-ce3689be-5611-4117-80a5-50582d47b160'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:50.076057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9802057829b44d1cb0ad2da97ecfd44d', 'request_id': 'req-ce3689be-5611-4117-80a5-50582d47b160'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:50.093489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9802057829b44d1cb0ad2da97ecfd44d', 'request_id': 'req-ce3689be-5611-4117-80a5-50582d47b160'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:50.137530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] The token cache is being invalidate because project 9802057829b44d1cb0ad2da97ecfd44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:10:50.138271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:50.139653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce3689be-5611-4117-80a5-50582d47b160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:50.147479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1244/2447] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:10:49 2022] DELETE /identity/v3/projects/9802057829b44d1cb0ad2da97ecfd44d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:50.148941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.149449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.149553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.214447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:50.215863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:50.624798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.625451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.625604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.637325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1204/2448] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:50.686066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:50.692515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:50.761003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:50.774756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e80a2d-429b-4f1d-8d9e-3d2dfcc6bb1b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:50.777821 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1245/2449] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:50.809345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:50.813535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.816519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.817564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.824174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:10:50.828344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:50.835107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7f952-e12b-447c-8a7d-dbe35567c623 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:50.896631 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1205/2450] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:50.896886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:50.903856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bf347-f9bb-4c5a-93a6-7869717d43bd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:50.927188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.927697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.928082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.931355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1206/2451] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:50.932016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:50.935950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:50.939356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:50.940579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:50.942621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:50.943080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:50.948019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:50.954215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.035064 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:51.098975 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1246/2452] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:10:50 2022] POST /identity/v3/projects => generated 395 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:51.100518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:51.367601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b8b9f-fb7a-4e6c-b635-8df321e12bc9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:51.368448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:51.376295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:51.399562 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:51.421540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:51.425452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.427080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.427383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:51.430470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:51.438464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.531425 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1247/2453] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:10:51 2022] POST /identity/v3/users => generated 298 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:10:51.532413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:51.577952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799e7b-8952-4521-97a0-1e98dfdec88e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:51.595379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:51.596074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.596416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.596703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:51.597502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:51.601360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.635707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670060d7-0f8c-46b6-bb02-698229bbc11e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:51.660777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1248/2454] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:51.664760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:51.716063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062e6e1-ea48-4091-81cf-b7a59ab42241 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:51.738927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:51.744473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.744710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.744811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:51.752605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:51.759518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.811546 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1249/2455] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:10:51.813810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:51.840565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea73-0ee0-45f5-b0a9-1726e43c9704 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:51.861363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:51.863233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.863525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.863814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] PATH_INFO: `/v3/projects/aa4e8e174a104e60a0c40a83bd2235fa/users/23333c1ebbdf4ddab9d21d5b8b7139e6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:51.883263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:51.884160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.884449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.884734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:51.899677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:51.899677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07cf84-237d-4d68-a3cd-f27b9e6079df tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.913760 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1207/2456] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:50 2022] GET /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 395 bytes in 973 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:51.916448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4e8e174a104e60a0c40a83bd2235fa, user_id=23333c1ebbdf4ddab9d21d5b8b7139e6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:51.924812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:51.993369 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1250/2457] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:10:51 2022] PUT /identity/v3/projects/aa4e8e174a104e60a0c40a83bd2235fa/users/23333c1ebbdf4ddab9d21d5b8b7139e6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:51.994992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958dd-17d9-4b21-bb6a-ede3476feb7c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:51.995305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958dd-17d9-4b21-bb6a-ede3476feb7c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:51.995591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958dd-17d9-4b21-bb6a-ede3476feb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:52.042751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-de7958dd-17d9-4b21-bb6a-ede3476feb7c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:52.044158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de7958dd-17d9-4b21-bb6a-ede3476feb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:52.382567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:52.382857 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1208/2458] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:52.384676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:52.550675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8152d90-05e9-4ac8-8180-bd4e2f34950e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:52.584032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:52.585817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:52.586553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:52.587071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:52.638807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:52.640576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:52.671890 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1251/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:53.125516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:53.126141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:53.126580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:53.128798 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1209/2460] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:53.137096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:53.137096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:53.253574 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:53.356648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:53.584026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22c66a-2c69-40a9-9d2c-f9d3252fddbc service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:53.633073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:53.634025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:53.640130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:53.640429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:53.674053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:53.680854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe14fd1-9278-4f41-b5f1-fd4cb7604b81 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:53.686249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1252/2461] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:53 2022] GET /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 395 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:10:54.260761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:54.262775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:54.563467 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:54.593168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173c3c9-3c61-479b-bb98-a2dbd6700fa5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:54.625656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:54.627087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:54.627595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:54.628040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:54.636401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:54.754660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:54.756297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:54.867557 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1210/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:55.646583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:55.647119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:55.653484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:55.727446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:55.732801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:55.889163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1253/2463] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:10:55.905443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:55.911835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:56.071806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7f5aa-fdce-4c54-b96b-8c774f485308 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:56.085906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:56.086680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:56.086965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:56.087247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:56.133704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:56.140803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:56.167691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1211/2464] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:10:58.501177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:58.504115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:58.537071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d79f4-2607-492c-be75-74c12b3ef8b1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:58.558525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:58.559443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:58.559725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:58.570021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] PATH_INFO: `/v3/users/7fe15455304f4fe4a990a1d32e0d1c28` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:58.575715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe15455304f4fe4a990a1d32e0d1c28)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:58.581862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:58.718519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:58.756097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18c6f-caee-4001-be0e-27040ca82d87 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:58.771682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:58.772439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe15455304f4fe4a990a1d32e0d1c28'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:58.774151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:58.774675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe15455304f4fe4a990a1d32e0d1c28'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:58.776781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:58.779469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:58.785330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:58.798900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe15455304f4fe4a990a1d32e0d1c28'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:58.818048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe15455304f4fe4a990a1d32e0d1c28'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:58.846984 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:58.856325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-55e26eb3-485e-4e50-89c1-a6a96faf932b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe15455304f4fe4a990a1d32e0d1c28'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:10:58.879740 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1254/2465] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:10:58 2022] DELETE /identity/v3/users/7fe15455304f4fe4a990a1d32e0d1c28 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:10:58.884198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca5f-dbd3-4e68-bf35-78be3c9c1670 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:58.884737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca5f-dbd3-4e68-bf35-78be3c9c1670 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:58.885166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca5f-dbd3-4e68-bf35-78be3c9c1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:58.941854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a008ca5f-dbd3-4e68-bf35-78be3c9c1670 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:10:58.946542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a008ca5f-dbd3-4e68-bf35-78be3c9c1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:58.954692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:58.958874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:58.993290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1212/2466] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:10:59.072663 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1255/2467] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:10:59.130541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:59.132306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:59.170666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997b9a9-d836-49c7-948d-cff46751f18e service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:59.313218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:59.314547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:59.315102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:59.317766 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1256/2468] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:10:59.325018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:10:59.325952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:59.326753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:59.327115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:59.327523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:59.327960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:59.372629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:59.374355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:59.420647 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1213/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:59.464076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:10:59.465660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:10:59.620132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534b33-92b2-4e7c-9b90-5f1797d0b56c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:10:59.629729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:10:59.630645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:10:59.630925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:10:59.631195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:10:59.638743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:10:59.641151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:10:59.643088 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1257/2470] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:10:59 2022] GET /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 395 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:00.855547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:00.858616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:00.897158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d7158-934d-496f-a771-9907ebb28149 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:00.919825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:00.922093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:00.937783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:00.940631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] PATH_INFO: `/v3/projects/aa9af5838d3645b2acad12161d65b6bc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:00.946102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9af5838d3645b2acad12161d65b6bc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:00.952301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:01.007851 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:01.128925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9af5838d3645b2acad12161d65b6bc', 'request_id': 'req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.146618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9af5838d3645b2acad12161d65b6bc', 'request_id': 'req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.168634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9af5838d3645b2acad12161d65b6bc', 'request_id': 'req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.198393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] The token cache is being invalidate because project aa9af5838d3645b2acad12161d65b6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:01.198393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.199023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d28e73eb-cc49-43fd-84d9-c3e78ed48ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.201981 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1214/2471] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:00 2022] DELETE /identity/v3/projects/aa9af5838d3645b2acad12161d65b6bc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:01.206259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:01.208350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:01.246117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6676d-d328-4b6c-a23c-6ab4026cf58d tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:01.362063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:01.362479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:01.362676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:01.364499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1215/2472] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:11:01.369047 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:01.384932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:01.386616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:01.510670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:01.513052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:01.513345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:01.513628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] PATH_INFO: `/v3/users/b8acf79566f9421a9235ec259d43e597` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:01.521488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8acf79566f9421a9235ec259d43e597)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:01.524749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:01.649761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:01.651474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:01.698506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8acf79566f9421a9235ec259d43e597'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.699388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8acf79566f9421a9235ec259d43e597'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.721819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8acf79566f9421a9235ec259d43e597'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.744249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8acf79566f9421a9235ec259d43e597'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.796906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8acf79566f9421a9235ec259d43e597'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:01.821973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1258/2473] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:01 2022] DELETE /identity/v3/users/b8acf79566f9421a9235ec259d43e597 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:01.872198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706520a-337e-42e7-8aee-0ce7b5eecd63 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:01.959297 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:02.003436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:02.004888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:02.005859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:02.007668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:02.012119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:02.017979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ebdad-8d8b-4178-be41-e3d764a16622 tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:02.030148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1216/2474] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:01 2022] GET /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 395 bytes in 646 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:02.260289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:02.261835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:02.563513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f6ff1-5ad9-455f-b830-1123275d0dbe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:02.588100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:02.589324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:02.589873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:02.590265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] PATH_INFO: `/v3/projects/724022d6e8d84abf8ed98950dc5f7df1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:02.591692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=724022d6e8d84abf8ed98950dc5f7df1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:02.594843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:02.682132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61833-c21f-45b7-ae2e-7950b3795083 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:02.682420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61833-c21f-45b7-ae2e-7950b3795083 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:02.682703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61833-c21f-45b7-ae2e-7950b3795083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:02.725511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4ed61833-c21f-45b7-ae2e-7950b3795083 None None] MFA Rules not processed for user `40b5fc3b4b6d43ab9342da568567140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:02.727077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ed61833-c21f-45b7-ae2e-7950b3795083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:02.785307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724022d6e8d84abf8ed98950dc5f7df1', 'request_id': 'req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:02.799418 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:02.814355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724022d6e8d84abf8ed98950dc5f7df1', 'request_id': 'req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:02.832804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724022d6e8d84abf8ed98950dc5f7df1', 'request_id': 'req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:02.859075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] The token cache is being invalidate because project 724022d6e8d84abf8ed98950dc5f7df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:02.859438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:02.864688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a29779c5-2d46-44c1-8eb0-b3a3311e2eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:02.868650 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1259/2475] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:02 2022] DELETE /identity/v3/projects/724022d6e8d84abf8ed98950dc5f7df1 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:02.874834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:02.875209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:02.875408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:02.931376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:02.932309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:02.939975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1217/2476] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:03.083002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1260/2477] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:03.090457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.090796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.091006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.130065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:03.132133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:03.173555 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1218/2478] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:03.177964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.200501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336d1d-9b2b-4ad4-905a-186ca136ea1a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.210884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.211848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.212127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.212443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.213160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:03.213468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.215441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.264105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.276803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be32ce7-85c0-4259-a489-3d0e32d37678 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.284070 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1261/2479] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:03.296125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.296822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.297104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.297378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.298205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.301033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.390646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1219/2480] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:03 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:03.393355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.409875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d566b-3629-447d-97ca-67b618b0953b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.559787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.560408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.560687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.560965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.573935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.576917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.615414 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1262/2481] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:03 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:03.620036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.638368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a09a7-4dc7-42d5-bf29-5d9450a56eaa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.658936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.660132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.660581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.660994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.661958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.664610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.696452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.697443 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1220/2482] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:03.712101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288f772-925f-4fda-b694-474573e6dee6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.736346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.739777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.741601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.743584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.746937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.754488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f2e5f-060b-4ec1-a1f8-10fb78f29e0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.791034 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1263/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:03.794062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:03.808218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc0c9-acf6-43a1-b7d4-3bcd2e99cf5f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:03.837270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:03.838655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.839120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.839546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] PATH_INFO: `/v3/projects/8268ffb274ee474eb5e1fc0e48436546/users/e380ec9a7fd34e8385f29eb76b55d5a1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:03.911248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8268ffb274ee474eb5e1fc0e48436546, user_id=e380ec9a7fd34e8385f29eb76b55d5a1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:03.916143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:03.955695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1221/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:03 2022] PUT /identity/v3/projects/8268ffb274ee474eb5e1fc0e48436546/users/e380ec9a7fd34e8385f29eb76b55d5a1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:03.966010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:03.966478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:03.966879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:04.035985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] MFA Rules not processed for user `e380ec9a7fd34e8385f29eb76b55d5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:04.037427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:04.186127 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:04.297392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1264/2485] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:04.301167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:04.534035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad38d2-c17f-43bc-bd26-0caf884af6dc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:04.572746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:04.573698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:04.574144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:04.574583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:04.575439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:04.577819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:04.652069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1222/2486] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:04.656709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:04.678719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e2e0b-2bac-447e-b7a1-a95b226b1c90 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:04.908107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:04.908779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:04.909069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:04.909358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:04.910105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:04.915475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:04.964729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1265/2487] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:04 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:04.968166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:05.010833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691900a-e559-4dd8-bf94-ac58922f23a1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:05.034812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:05.038585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.038984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.039289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.040258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:05.048445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:05.105170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1223/2488] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:05.110125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:05.134806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d373-8599-4b44-a2a7-27a1ee89ee47 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:05.157552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:05.159209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.159459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.159699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] PATH_INFO: `/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14/users/b85113f86f0a4c38abd7a37944a3b9e4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.207731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff48bb5df284b80b9ca4c3f606b3f14, user_id=b85113f86f0a4c38abd7a37944a3b9e4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:05.212088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:05.238681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1266/2489] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:05 2022] PUT /identity/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14/users/b85113f86f0a4c38abd7a37944a3b9e4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:05.243792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:05.266354 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:05.286829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7c279-0546-416e-b007-56927c575b14 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:05.465356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:05.466355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.467685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.468210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.469130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:05.472799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4608-7d40-4dfa-af25-4f47996a637c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:05.501373 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1224/2490] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:05.505256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:05.526100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977d5c1-6aab-4e8a-94cc-a5d3ee486d3c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:05.549041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:05.552982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.555766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.556723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] PATH_INFO: `/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14/users/b85113f86f0a4c38abd7a37944a3b9e4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.565505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff48bb5df284b80b9ca4c3f606b3f14, user_id=b85113f86f0a4c38abd7a37944a3b9e4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:05.578536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:05.612646 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1267/2491] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:05 2022] PUT /identity/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14/users/b85113f86f0a4c38abd7a37944a3b9e4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:05.636140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.636937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.637431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.727453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] MFA Rules not processed for user `b85113f86f0a4c38abd7a37944a3b9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:05.728956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:05.915763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1225/2492] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 24 01:11:05.918609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:05.937934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a813741-d56c-4009-88ab-d3a3256e4796 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:05.952860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:05.954680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:05.955223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:05.955962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:05.958580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:05.960240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:05.966781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:06.009360 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1268/2493] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:06.014896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:06.032744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7ac25-7e6c-4286-99f0-81cead10de19 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:06.074010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:06.074010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:06.074010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:06.074499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:06.074499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:06.074499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae95a9-6e4b-4749-8794-6d6ef7da1e8a tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:06.162113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:06.177644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d374f-1ecb-482b-b729-c2358ce5b3df tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:06.182123 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1226/2494] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:06 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:06.282958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:06.283639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:06.283925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:06.284207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:06.285318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:06.285652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:06.302243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1db4d-5b44-4782-a1c3-1647eb224643 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:06.355248 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1269/2495] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:07.827419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:07.827876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:07.829715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:07.927274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] MFA Rules not processed for user `23333c1ebbdf4ddab9d21d5b8b7139e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:07.929223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:08.039468 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:08.077844 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1227/2496] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:08.152808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18aa0-0cd4-413a-b10d-969dc4b9074c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:08.153340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18aa0-0cd4-413a-b10d-969dc4b9074c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:08.153450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf18aa0-0cd4-413a-b10d-969dc4b9074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:08.187000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dcf18aa0-0cd4-413a-b10d-969dc4b9074c None None] MFA Rules not processed for user `23333c1ebbdf4ddab9d21d5b8b7139e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:08.195489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dcf18aa0-0cd4-413a-b10d-969dc4b9074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:08.215893 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1270/2497] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:09.564005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:09.566351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:09.668631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56b4c-672b-47e2-b444-278aa034f815 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:09.676023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:09.676862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:09.677149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:09.677421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:09.687040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:09.688880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:09.715546 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1228/2498] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:09.720529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b03a-0406-4df2-b551-c49c3f34ed28 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:09.721481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b03a-0406-4df2-b551-c49c3f34ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:09.721960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b03a-0406-4df2-b551-c49c3f34ed28 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:09.723756 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1271/2499] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:09.735174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:09.760388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:09.781245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9269-915a-44fc-ba5a-f8e219765d09 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:09.791349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:09.793303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:09.793595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:09.793906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects/243b5970fb764475bae2ef144a49cf90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:09.796495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:get_project(project_id=243b5970fb764475bae2ef144a49cf90)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:09.798637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a9cae-a748-4b31-a5e9-cf4b0bff724f tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:09.801807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1229/2500] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:09 2022] GET /identity/v3/projects/243b5970fb764475bae2ef144a49cf90 => generated 371 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:09.902464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b03a-0406-4df2-b551-c49c3f34ed28 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:09.916760 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:09.930112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b03a-0406-4df2-b551-c49c3f34ed28 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:09.941597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:09.942851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:09.943329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:09.944358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:09.961136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:09.963872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:09.976950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1272/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:10.171265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4bd14-3607-402c-b55c-db783b894b7c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.171476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4bd14-3607-402c-b55c-db783b894b7c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.171737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4bd14-3607-402c-b55c-db783b894b7c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.174255 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1230/2502] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:10.180654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:10.182675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:10.200254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.201941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:10.343660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fea-2745-4583-884e-c49fa46850fa service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.366215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4327bc6f292c43f780d905a55502ed4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '293506e56f5148a2a635e914a25e71d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.367890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.367890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.369887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] PATH_INFO: `/v3/projects/8294ba72d7624d8baf9148c515f61005` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.373933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorizing `identity:get_project(project_id=8294ba72d7624d8baf9148c515f61005)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.377268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.379904 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1273/2503] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:10 2022] GET /identity/v3/projects/8294ba72d7624d8baf9148c515f61005 => generated 393 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:10.424517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd912c1-c9ea-4373-a802-08cd69164e9d None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.425029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd912c1-c9ea-4373-a802-08cd69164e9d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.425459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd912c1-c9ea-4373-a802-08cd69164e9d None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.427320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1231/2504] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:10.432814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:10.461654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.492877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754718e-9c9c-4a08-9ab3-d045f8fd65ea tempest-FlavorsAccessNegativeTestJSON-808867611 tempest-FlavorsAccessNegativeTestJSON-808867611-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.511294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.512843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.515024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.515408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects/243b5970fb764475bae2ef144a49cf90` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.518555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:get_project(project_id=243b5970fb764475bae2ef144a49cf90)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.525993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.528291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1274/2505] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:10 2022] GET /identity/v3/projects/243b5970fb764475bae2ef144a49cf90 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:10.623620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd912c1-c9ea-4373-a802-08cd69164e9d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.646819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd912c1-c9ea-4373-a802-08cd69164e9d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.660844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.662054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.662605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.663223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.664274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:10.665354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.668865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.710645 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1232/2506] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:10.711668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.730443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2cf32-b9c5-4dae-a64d-45e72390c392 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.751480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.752920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.753384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.753854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.755707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.759776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def68ab-f8de-42f5-8f97-4be2f8f24ce4 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.805210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1275/2507] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:10 2022] POST /identity/v3/users => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:10.811163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:10.830204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35afdd9-380b-4666-b71f-27688fd25005 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:10.840912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:10.841574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:10.842100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:10.842544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:10.843474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:10.843936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:10.851178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:10.880903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1233/2508] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:11.293652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:11.294002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:11.294292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:11.295700 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1276/2509] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:11.314583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:11.330671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:11.359058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abfc9-ffc7-4b27-b424-92407f621e62 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:11.372419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:11.373584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:11.374059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:11.375074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects/243b5970fb764475bae2ef144a49cf90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:11.376533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:get_project(project_id=243b5970fb764475bae2ef144a49cf90)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:11.378818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abe417-e8e3-4d83-aada-660dff838a07 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:11.400124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1234/2510] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:11 2022] GET /identity/v3/projects/243b5970fb764475bae2ef144a49cf90 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:12.067891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:12.070832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:12.082205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:12.083169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:12.083629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:12.085836 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1235/2511] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:11:12.091538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:12.162985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:12.226210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532de4-fbd4-45d3-a171-1f007ed67488 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:12.249465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:12.253411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:12.253854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:12.254210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects/243b5970fb764475bae2ef144a49cf90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:12.265426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:get_project(project_id=243b5970fb764475bae2ef144a49cf90)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:12.269448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:12.283407 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1236/2512] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:12 2022] GET /identity/v3/projects/243b5970fb764475bae2ef144a49cf90 => generated 371 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:12.361187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357968-f22d-49a6-92a4-35e7ed2d3f09 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:12.369216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:12.385164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941dbc3-4597-476f-b88d-deea3c5b8f61 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:12.386761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:12.389655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:12.390617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:12.390899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] PATH_INFO: `/v3/users/bc58047717b243ce9e59242f8275acff` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:12.393959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc58047717b243ce9e59242f8275acff)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:12.396622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:12.401085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:12.402006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:12.402286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:12.402556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/users/00df0c633f274fef9e555422ed3a8eb6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:12.483940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:delete_user(user_id=00df0c633f274fef9e555422ed3a8eb6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:12.492414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:12.713857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00df0c633f274fef9e555422ed3a8eb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.728015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00df0c633f274fef9e555422ed3a8eb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.769544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00df0c633f274fef9e555422ed3a8eb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.802471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc58047717b243ce9e59242f8275acff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.806680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc58047717b243ce9e59242f8275acff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.829496 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:12.833693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc58047717b243ce9e59242f8275acff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.846827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc58047717b243ce9e59242f8275acff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.848368 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:12.867303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00df0c633f274fef9e555422ed3a8eb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.868320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00df0c633f274fef9e555422ed3a8eb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.893312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1237/2513] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:12 2022] DELETE /identity/v3/users/00df0c633f274fef9e555422ed3a8eb6 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:12.893544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f86590e8-d6d0-4169-8ff5-e44f84b6ecec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc58047717b243ce9e59242f8275acff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:12.895046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:12.898756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:12.915830 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1277/2514] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:12 2022] DELETE /identity/v3/users/bc58047717b243ce9e59242f8275acff => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:12.918980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:12.919371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:12.919717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:12.955877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:12.958656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:13.136744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1278/2515] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:13.146416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72921a-9432-4ac4-8677-1a8c3790f042 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:13.250741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:13.252539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:13.346907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b85113f86f0a4c38abd7a37944a3b9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff48bb5df284b80b9ca4c3f606b3f14', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:13.348238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:13.348712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:13.349219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] PATH_INFO: `/v3/projects/243b5970fb764475bae2ef144a49cf90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:13.352616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorizing `identity:delete_project(project_id=243b5970fb764475bae2ef144a49cf90)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:13.356595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:13.420307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dee569-a58c-4d9e-8739-04753721f62d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:13.430625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:13.431570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:13.431994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:13.432407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:13.460988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:13.462504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:13.478816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243b5970fb764475bae2ef144a49cf90', 'request_id': 'req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.489907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243b5970fb764475bae2ef144a49cf90', 'request_id': 'req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.491945 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1279/2516] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:13.521274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243b5970fb764475bae2ef144a49cf90', 'request_id': 'req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.555175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] The token cache is being invalidate because project 243b5970fb764475bae2ef144a49cf90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:13.556505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.557653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a310d-b0b4-43d3-a93d-4a000cd3e442 tempest-QuotasAdminTestV236-1108138082 tempest-QuotasAdminTestV236-1108138082-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.562180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1238/2517] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:12 2022] DELETE /identity/v3/projects/243b5970fb764475bae2ef144a49cf90 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:13.568192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:13.570587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:13.595929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50160e5-8e7f-486b-844a-79dd8160136d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:13.701624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:13.702975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:13.703608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:13.704315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] PATH_INFO: `/v3/users/e380ec9a7fd34e8385f29eb76b55d5a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:13.705931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e380ec9a7fd34e8385f29eb76b55d5a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:13.708447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:13.801474 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:13.833019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e380ec9a7fd34e8385f29eb76b55d5a1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.833793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e380ec9a7fd34e8385f29eb76b55d5a1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.846264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e380ec9a7fd34e8385f29eb76b55d5a1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.857761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e380ec9a7fd34e8385f29eb76b55d5a1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.875609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e380ec9a7fd34e8385f29eb76b55d5a1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:13.885807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1280/2518] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:13 2022] DELETE /identity/v3/users/e380ec9a7fd34e8385f29eb76b55d5a1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:13.890779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:13.891273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:13.891653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:13.978535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:13.980071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:14.019740 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:14.153328 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1239/2519] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:14.165834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:14.167576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:14.323890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286157a1-cf46-4fd5-974a-6a28688a936e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:14.337495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:14.340590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:14.341106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:14.341499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:14.366377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:14.367954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:14.384065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1281/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:14.754209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:14.755965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:14.918119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed9e75-c241-4041-9c9a-f04318abb06d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:14.928451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:14.929142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:14.929467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:14.929794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:14.931834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:15.035149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:15.036752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:15.054143 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1240/2521] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:15.137517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:15.139206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:15.164831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbc32-a4c5-4285-aa6d-7156969c8111 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:15.177836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:15.185327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:15.185628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:15.185931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] PATH_INFO: `/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:15.191606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf45e2aa05f4f2aa444be7fd3195e7c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:15.195730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:15.278376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf45e2aa05f4f2aa444be7fd3195e7c', 'request_id': 'req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.296209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf45e2aa05f4f2aa444be7fd3195e7c', 'request_id': 'req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.313798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf45e2aa05f4f2aa444be7fd3195e7c', 'request_id': 'req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.337528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] The token cache is being invalidate because project 9bf45e2aa05f4f2aa444be7fd3195e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:15.338098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.339561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.345853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1282/2522] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:15 2022] DELETE /identity/v3/projects/9bf45e2aa05f4f2aa444be7fd3195e7c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:15.346577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:15.367666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5176e8-219e-4603-a2e2-9fa9accd82fb service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:15.454824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:15.455968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:15.456350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:15.456832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] PATH_INFO: `/v3/users/4327bc6f292c43f780d905a55502ed4c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:15.458261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4327bc6f292c43f780d905a55502ed4c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:15.461343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:15.466806 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:15.549250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4327bc6f292c43f780d905a55502ed4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.559822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4327bc6f292c43f780d905a55502ed4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.572550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4327bc6f292c43f780d905a55502ed4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.590023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4327bc6f292c43f780d905a55502ed4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.591774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4327bc6f292c43f780d905a55502ed4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:15.606274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1241/2523] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:15 2022] DELETE /identity/v3/users/4327bc6f292c43f780d905a55502ed4c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:16.109012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:16.112205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:16.171588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f72d5-bdb7-4b0b-9587-74559a59bfb3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:16.185141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:16.187408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:16.235796 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:16.289870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:16.290948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:16.291344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:16.291735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] PATH_INFO: `/v3/projects/8268ffb274ee474eb5e1fc0e48436546` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:16.293156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8268ffb274ee474eb5e1fc0e48436546)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:16.295263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:16.330446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923f98-5af7-47f9-aeb4-09c1d913e84e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:16.337503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:16.338512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:16.339190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:16.339551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:16.342482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:16.359394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:16.360955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:16.382139 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1242/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:16.391702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8268ffb274ee474eb5e1fc0e48436546', 'request_id': 'req-263ddefe-ccec-4689-a7f7-97a89a232cf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.399697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8268ffb274ee474eb5e1fc0e48436546', 'request_id': 'req-263ddefe-ccec-4689-a7f7-97a89a232cf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.414977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8268ffb274ee474eb5e1fc0e48436546', 'request_id': 'req-263ddefe-ccec-4689-a7f7-97a89a232cf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.441850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] The token cache is being invalidate because project 8268ffb274ee474eb5e1fc0e48436546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:16.442125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.443540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.447527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1283/2525] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:16 2022] DELETE /identity/v3/projects/8268ffb274ee474eb5e1fc0e48436546 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:16.452230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:16.454181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:16.471121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ccc0-17a8-478a-93d1-4bc514d409e5 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:16.652509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:16.654453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:16.654887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:16.655310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] PATH_INFO: `/v3/users/b85113f86f0a4c38abd7a37944a3b9e4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:16.657951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85113f86f0a4c38abd7a37944a3b9e4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:16.660684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:16.690567 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:16.803424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85113f86f0a4c38abd7a37944a3b9e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.827401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85113f86f0a4c38abd7a37944a3b9e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.860487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85113f86f0a4c38abd7a37944a3b9e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.937827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85113f86f0a4c38abd7a37944a3b9e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.941648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85113f86f0a4c38abd7a37944a3b9e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:16.959224 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1243/2526] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:16 2022] DELETE /identity/v3/users/b85113f86f0a4c38abd7a37944a3b9e4 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:16.985245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:16.989092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:17.043390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ddefe-ccec-4689-a7f7-97a89a232cf9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:17.180986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:17.184574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:17.185788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:17.187116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] PATH_INFO: `/v3/projects/293506e56f5148a2a635e914a25e71d3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:17.192364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293506e56f5148a2a635e914a25e71d3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:17.195034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:17.277231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293506e56f5148a2a635e914a25e71d3', 'request_id': 'req-840fb6fc-b446-43f4-9711-80cb53a447f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.287989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293506e56f5148a2a635e914a25e71d3', 'request_id': 'req-840fb6fc-b446-43f4-9711-80cb53a447f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.290911 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:17.303519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293506e56f5148a2a635e914a25e71d3', 'request_id': 'req-840fb6fc-b446-43f4-9711-80cb53a447f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.336698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] The token cache is being invalidate because project 293506e56f5148a2a635e914a25e71d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:17.336978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.337911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.344418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:17.346138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:17.347952 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1284/2527] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:16 2022] DELETE /identity/v3/projects/293506e56f5148a2a635e914a25e71d3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:17.384025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccd3c3-b886-4a21-89ff-e24c22273760 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:17.525552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:17.526748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:17.527215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:17.527649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] PATH_INFO: `/v3/users/7c23ce3af4304d6cb614fd40c25a38d0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:17.530628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c23ce3af4304d6cb614fd40c25a38d0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:17.534959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:17.629710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c23ce3af4304d6cb614fd40c25a38d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.650892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c23ce3af4304d6cb614fd40c25a38d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.674229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c23ce3af4304d6cb614fd40c25a38d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.696823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c23ce3af4304d6cb614fd40c25a38d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.698437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04643e05-227e-474c-b621-4c7088c8b13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c23ce3af4304d6cb614fd40c25a38d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:17.707805 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1244/2528] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:17 2022] DELETE /identity/v3/users/7c23ce3af4304d6cb614fd40c25a38d0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:18.158517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:18.160321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:18.184985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fb6fc-b446-43f4-9711-80cb53a447f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:18.323061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:18.324890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:18.325350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:18.326472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] PATH_INFO: `/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:18.328565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff48bb5df284b80b9ca4c3f606b3f14)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:18.332468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:18.480846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff48bb5df284b80b9ca4c3f606b3f14', 'request_id': 'req-0787ec7c-003c-4a29-b722-0067505974b3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:18.496158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff48bb5df284b80b9ca4c3f606b3f14', 'request_id': 'req-0787ec7c-003c-4a29-b722-0067505974b3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:18.510291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff48bb5df284b80b9ca4c3f606b3f14', 'request_id': 'req-0787ec7c-003c-4a29-b722-0067505974b3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:18.531494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] The token cache is being invalidate because project cff48bb5df284b80b9ca4c3f606b3f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:18.531834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:18.532819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0787ec7c-003c-4a29-b722-0067505974b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:18.537698 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1285/2529] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:18 2022] DELETE /identity/v3/projects/cff48bb5df284b80b9ca4c3f606b3f14 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:18.542306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:18.543391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:18.543835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:18.564527 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:18.576274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:18.578218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:18.732882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1245/2530] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:18.741271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:18.742071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:18.742567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:18.769594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:18.771852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:18.785284 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1286/2531] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:18.789987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:18.802038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8716ba-564d-4fc5-b92c-38c3bd4319ef None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:18.808093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:18.808788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:18.809074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:18.809430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:18.810274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:18.810735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:18.812414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:18.831634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1246/2532] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:18.838602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:18.860465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8a4c-e4b4-4557-85d9-efce3832677f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:18.874525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:18.875230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:18.875511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:18.875786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:18.876495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:18.878466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:18.910962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1287/2533] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:18.915129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:18.927334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2c6fc-72e7-46cb-9a6b-3737d2f8d935 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.041165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.041988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.042344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.042696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.045092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.045576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.047654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.062483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.070986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9afd16-8489-4bc5-9ab0-abf77d72e8dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.085479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.086841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.087200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.087937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] PATH_INFO: `/v3/projects/8294ba72d7624d8baf9148c515f61005` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.091963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8294ba72d7624d8baf9148c515f61005)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.096006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.105729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1247/2534] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:18 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:19.106876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.124724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe037ac7-6638-41a7-9d99-e7a1a5339ac4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.137302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.138116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.141867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.142283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.143197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.145189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.169792 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1248/2535] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:19.177477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.191476 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:19.195200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf48e-ebe2-465f-a164-c51ad99a3fac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.202022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8294ba72d7624d8baf9148c515f61005', 'request_id': 'req-51058a6d-45ee-4a32-abcb-1d37899ba607'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:19.218128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8294ba72d7624d8baf9148c515f61005', 'request_id': 'req-51058a6d-45ee-4a32-abcb-1d37899ba607'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:19.231914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8294ba72d7624d8baf9148c515f61005', 'request_id': 'req-51058a6d-45ee-4a32-abcb-1d37899ba607'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:19.251587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] The token cache is being invalidate because project 8294ba72d7624d8baf9148c515f61005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:19.251918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:19.252718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51058a6d-45ee-4a32-abcb-1d37899ba607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:19.257150 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1288/2536] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:19 2022] DELETE /identity/v3/projects/8294ba72d7624d8baf9148c515f61005 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:19.264025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.264311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.264967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.283366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.284684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.285317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.285818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.287972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.289471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:19.290280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999449-c7a1-44a0-870c-24ad80eb390d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.290936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.301879 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1289/2537] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:19.304595 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1249/2538] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:19.311483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.314115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.314410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.314688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.316475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.338104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:19.338716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2540d3-7748-4dbe-8123-1f5cdc6c079d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.339490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.345459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.347112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.347924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.348892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] PATH_INFO: `/v3/projects/55fc9bffeab040f2b571cf851796dae3/users/356ab4339b904591906daef6976acb1b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.358294 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1250/2539] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:19.359239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.363804 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:19.372237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fc9bffeab040f2b571cf851796dae3, user_id=356ab4339b904591906daef6976acb1b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.374851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92bc11-0751-438c-8c50-7e2ef8201da3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.376561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcf73b-349d-4013-8f6c-b924682f02dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.380925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.381480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.382219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.382407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.383418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:19.383818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.386745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.406564 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1251/2540] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:19.409482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.415517 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1290/2541] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:19 2022] PUT /identity/v3/projects/55fc9bffeab040f2b571cf851796dae3/users/356ab4339b904591906daef6976acb1b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:19.424489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632aaa0-af8a-49ae-a31a-b51931026988 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.428495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.429406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.429406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.460228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] MFA Rules not processed for user `356ab4339b904591906daef6976acb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:19.462329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.496755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.497534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.498155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.498359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.499128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.501205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a296b-875b-41c5-866d-d2b1e8b264d7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.534051 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1252/2542] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:19.535428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.535721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.535995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.554980 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1291/2543] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:19.555828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.555938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] MFA Rules not processed for user `01b0f82f73ea4c14a51c5481e78d4493`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:19.557089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:19.567482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597096-14e9-419e-8f0e-e9060f69d5d2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.621250 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1253/2544] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:19.622191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.639401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.640199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.640580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.640857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.641555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.644363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.678831 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1292/2545] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:19.687883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.704530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311304-a2da-47b2-8441-602eb0b5539f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.706974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe5f2-b9e5-40e0-a261-ffca4cf29e5d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.711206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.712738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.712879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.713020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.713020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.713202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.713202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.713365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.713931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.714229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.716027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.716196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.733964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1293/2546] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:19.737771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.748784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8201-8381-4d0c-8c35-85c36f58e5ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.751000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1254/2547] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:19.754398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.761749 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:19.768086 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:19.830292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.830967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.831247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.831527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.832303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.834799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.847270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1294/2548] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:19.851729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.856316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62962d88-c7a1-4fd0-902f-257d37ba5edf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.863141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.863345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b76f-6966-4b06-816d-b12c418c8877 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.864282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.864827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.865782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.866718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.868674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.868899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:19.869783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.870115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.870443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] PATH_INFO: `/v3/projects/7e0fab112a3444e499d79a7d40041696/users/d623623ab02748f3ad3c5e953f6d43ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.898909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0fab112a3444e499d79a7d40041696, user_id=d623623ab02748f3ad3c5e953f6d43ed, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:19.902469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237dd93-70ed-485e-9eec-07953c4a4cdc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:19.916033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1255/2549] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:19.920134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:19.933819 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1295/2550] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:19 2022] PUT /identity/v3/projects/7e0fab112a3444e499d79a7d40041696/users/d623623ab02748f3ad3c5e953f6d43ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:19.945556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:19.947215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:19.947712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:19.959797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276c504-2cef-40f7-be5c-69bfb5e086b6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:19.984551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] MFA Rules not processed for user `d623623ab02748f3ad3c5e953f6d43ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:19.985941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:20.045382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.046206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.046567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.046919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.047749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.050603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.066158 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1256/2551] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:20.071662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.085941 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1296/2552] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:20.090380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.102417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd67fbe-927c-4af4-9fb3-f9195edf2b8d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.103660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35c4c-f712-48ee-b9cd-4acd9080e9c8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.112123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.112900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.113252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.113596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.121393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.123155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.124097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.124391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.124674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] PATH_INFO: `/v3/projects/4d4e270519d1479c8458629e9ce4e91c/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.131377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.159082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e270519d1479c8458629e9ce4e91c, user_id=3cf12cd9f3ab47f48eb0e9fa1ce112d0, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.163293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.181537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1257/2553] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:20 2022] PUT /identity/v3/projects/4d4e270519d1479c8458629e9ce4e91c/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:20.182304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1297/2554] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:20 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:20.186437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.186899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.312503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c778d5f-e0f5-4556-8f06-3731fc9dbe4c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.320334 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:20.339394 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:20.348122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e96086-c1b5-4ca6-929c-94aa35f347fb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.356633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.357809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.358823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.359275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.360172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.363828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.399748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1298/2555] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:20 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:20.404078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.415310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073cce1-c7d6-4c9f-97fa-e54507f880e7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.418103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.419472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.419909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.420358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.420867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.421552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.421769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.422119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.422491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.423327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.424680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.425107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.440644 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1258/2556] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:20.447418 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1299/2557] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:20.448261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.448880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.461330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471a2-9f31-42d6-a427-8a8d84d22bd9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.465992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc92b0-bfaf-4577-83b6-1b3fd98b5008 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.466510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.467762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.468204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.468611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] PATH_INFO: `/v3/projects/1aa34b9c8cbf436a9da77b745894c691/users/a0edce0a9df74286926bd5c9be13327d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.477038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.478503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.479042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.479473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] PATH_INFO: `/v3/projects/4d4e270519d1479c8458629e9ce4e91c/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.483906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e270519d1479c8458629e9ce4e91c, user_id=3cf12cd9f3ab47f48eb0e9fa1ce112d0, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.487997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3a447-5371-4753-b159-601f93b59c49 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.504835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa34b9c8cbf436a9da77b745894c691, user_id=a0edce0a9df74286926bd5c9be13327d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.506151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1259/2558] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:20 2022] PUT /identity/v3/projects/4d4e270519d1479c8458629e9ce4e91c/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:20.520285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.523756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.526230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.526230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.539322 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1300/2559] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:20 2022] PUT /identity/v3/projects/1aa34b9c8cbf436a9da77b745894c691/users/a0edce0a9df74286926bd5c9be13327d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:20.544314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.594190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] MFA Rules not processed for user `3cf12cd9f3ab47f48eb0e9fa1ce112d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:20.604195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:20.650579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-3471-4250-8691-5f0426aa9900 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.656644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.657597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.658072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.658530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.659687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.670517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.699090 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1301/2560] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:20.703966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.723175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfe5ee-729e-4f36-8323-2be9b486d45c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.730648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.731210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.731611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.731964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] PATH_INFO: `/v3/projects/1aa34b9c8cbf436a9da77b745894c691/users/a0edce0a9df74286926bd5c9be13327d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.734531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa34b9c8cbf436a9da77b745894c691, user_id=a0edce0a9df74286926bd5c9be13327d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.738703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8e43-2974-4400-864e-7664c857ac96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.751819 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1260/2561] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:20.758395 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1302/2562] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:20 2022] PUT /identity/v3/projects/1aa34b9c8cbf436a9da77b745894c691/users/a0edce0a9df74286926bd5c9be13327d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:20.764064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:20.775519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.775811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.776092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.788922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf4ab4-2b5b-4c28-921c-c7ac51466e37 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:20.824787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] MFA Rules not processed for user `a0edce0a9df74286926bd5c9be13327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:20.826474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:20.931097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:20.931801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:20.932152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:20.932459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:20.933456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:20.933832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:20.935710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:20.979658 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1261/2563] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:20.986145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.013730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1303/2564] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:21.019976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa94abb-4318-4cec-9256-c49d2d2ce1ef tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.027648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.028349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.028641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.028936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.032810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.040888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.065081 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:21.085788 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1262/2565] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:20 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:21.087745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.101876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b03d75-cabc-47bc-946d-6041cdf9eeec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.137437 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:21.197146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.201425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:21.261661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.262284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.262633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.263291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.264139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:21.264139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.265574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.305718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1304/2566] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:21.374622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef3f1-9ea5-4738-95ca-be80344a62cf tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.390415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.391110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.391476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.391755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.504905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.508151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.523053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1263/2567] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:21.551859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.555550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:21.576661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.584667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041183c-b7ab-461a-96e9-06854cf824d2 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.591755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.592535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.592690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.592973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.594075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b74101-26dd-4d4b-a4db-89aebb511b0e service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.603376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.604099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.604529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.605028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.605531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.606371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c251824-36cd-4922-af06-88461a26ee11 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.630126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1305/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:21.635653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.635963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.636185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.637732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1306/2569] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:21.643007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:21.660892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.675369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c133b-b60f-41ef-87c6-677d0f163d11 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.683615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.684727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.685767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.686172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects/0555e26bdd4c43baba80de66453e6853` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.687924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:get_project(project_id=0555e26bdd4c43baba80de66453e6853)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.690460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b006ea-f550-40e8-9560-f6c2e115b798 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.701830 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1307/2570] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/projects/0555e26bdd4c43baba80de66453e6853 => generated 369 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:21.734651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:21.736305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:21.747654 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1264/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:21.959865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9a48-0db8-435e-a4c8-e1113677b460 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.960133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9a48-0db8-435e-a4c8-e1113677b460 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.960393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b9a48-0db8-435e-a4c8-e1113677b460 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:21.961904 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1308/2572] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:21.967273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:21.980967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:21.993571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3a3a-6ad6-4dee-bc9d-d6e9cd0ea896 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:21.998542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:21.999437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:21.999717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:21.999989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects/0555e26bdd4c43baba80de66453e6853` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.001268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:get_project(project_id=0555e26bdd4c43baba80de66453e6853)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.003448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.005378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1265/2573] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:21 2022] GET /identity/v3/projects/0555e26bdd4c43baba80de66453e6853 => generated 369 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:22.068130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b9a48-0db8-435e-a4c8-e1113677b460 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.083062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b9a48-0db8-435e-a4c8-e1113677b460 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:22.089089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:22.090094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.090536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.090975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.092530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:22.093093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.095675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.132402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1309/2574] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:22.133227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.148480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391cb2-0b60-4b93-8f5d-f53e02746a32 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:22.154037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:22.154832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.155120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.155401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.156128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.158364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245361-d773-4665-9242-ee233cdfc98b tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.177345 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:22.196024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1266/2575] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:22 2022] POST /identity/v3/users => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:22.201057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.219568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddee389-9e60-45c5-8df2-44cc43801388 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:22.226794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:22.228444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.229021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.229417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.230715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:22.231171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.234230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.258440 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1310/2576] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:22.274781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.275788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.276350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.277654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.282106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1267/2577] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:22.290901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:22.323020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.356294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9f3c-c17d-46cc-a57d-91ab02a82236 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:22.373176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:22.374178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.374534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.375140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects/0555e26bdd4c43baba80de66453e6853` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.379115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:get_project(project_id=0555e26bdd4c43baba80de66453e6853)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.383338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accd84c-6b7a-460d-931c-ea1914a40959 tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.385977 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1268/2578] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:22 2022] GET /identity/v3/projects/0555e26bdd4c43baba80de66453e6853 => generated 369 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:22.434626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254b6db-a7ad-402a-b89b-2f29aef5f17c tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:22.440427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:22.441488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.441906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.442281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] PATH_INFO: `/v3/users/d623623ab02748f3ad3c5e953f6d43ed` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.444050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d623623ab02748f3ad3c5e953f6d43ed)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:22.446735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:22.540275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd623623ab02748f3ad3c5e953f6d43ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:22.540888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd623623ab02748f3ad3c5e953f6d43ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:22.553823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd623623ab02748f3ad3c5e953f6d43ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:22.561383 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:22.564115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd623623ab02748f3ad3c5e953f6d43ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:22.589105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6393b03-86dc-4f00-893b-6b9dd0191bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd623623ab02748f3ad3c5e953f6d43ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:22.606383 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1311/2579] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:22 2022] DELETE /identity/v3/users/d623623ab02748f3ad3c5e953f6d43ed => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:22.607775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.608492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.608492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.636592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:22.637887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:22.671655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:22.675242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:22.675874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:22.685509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1312/2580] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:11:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:22.691463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:11:22.699323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:22.806547 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1269/2581] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:22.825379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.828105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:22.943555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:22.947197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.010277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6988-b963-4736-836a-2d65ecb640da None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.025985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.026645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.026925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.027191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.046320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.047826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.091644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb6c68-bb01-4b54-b2d0-01fa3ed3895f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.092493 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1270/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:23.098971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.101079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.101079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.101079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects/0555e26bdd4c43baba80de66453e6853` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.103158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:get_project(project_id=0555e26bdd4c43baba80de66453e6853)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.105154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dcf6f-39e0-4df5-89f6-03b304908cee tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.108096 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1313/2583] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:11:22 2022] GET /identity/v3/projects/0555e26bdd4c43baba80de66453e6853 => generated 369 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:11:23.151028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.165410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eaa59-99ec-412c-a598-b97c8a7431b6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.172136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.173106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.173455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.173805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/users/7e0bd6160f4b4b4a8b8d4cbb304effbe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.192316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e0bd6160f4b4b4a8b8d4cbb304effbe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.195276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.238603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.238992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.239485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.275012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:23.276382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.315745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0bd6160f4b4b4a8b8d4cbb304effbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.347144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0bd6160f4b4b4a8b8d4cbb304effbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.359643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0bd6160f4b4b4a8b8d4cbb304effbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.375866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:23.379837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0bd6160f4b4b4a8b8d4cbb304effbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.382116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0bd6160f4b4b4a8b8d4cbb304effbe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.393194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1271/2584] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:23 2022] DELETE /identity/v3/users/7e0bd6160f4b4b4a8b8d4cbb304effbe => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:23.401958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.404100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.423171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1314/2585] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:23.444859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.446501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.481376 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:23.530303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c81d-aa89-4956-be2d-b247fa7a5f6d tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.535749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cf12cd9f3ab47f48eb0e9fa1ce112d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d4e270519d1479c8458629e9ce4e91c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.536640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.537015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.537313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] PATH_INFO: `/v3/projects/0555e26bdd4c43baba80de66453e6853` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.539251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0555e26bdd4c43baba80de66453e6853)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.541953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.570054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aa6d1-34b3-4e57-84ad-b96979b4cb61 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.651436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0555e26bdd4c43baba80de66453e6853', 'request_id': 'req-4ddba136-4c3f-4add-a562-abf7571e5e6f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.662751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0555e26bdd4c43baba80de66453e6853', 'request_id': 'req-4ddba136-4c3f-4add-a562-abf7571e5e6f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.671999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0555e26bdd4c43baba80de66453e6853', 'request_id': 'req-4ddba136-4c3f-4add-a562-abf7571e5e6f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.709320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] The token cache is being invalidate because project 0555e26bdd4c43baba80de66453e6853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:23.709643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.710784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:23.713418 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1272/2586] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:23 2022] DELETE /identity/v3/projects/0555e26bdd4c43baba80de66453e6853 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:23.719366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.719620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.720434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.720871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.721335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.723617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.725296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.844610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.848055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.870219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1315/2587] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:11:23.872576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:23.875725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:23.895070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddba136-4c3f-4add-a562-abf7571e5e6f tempest-QuotasAdminTestV257-1111673498 tempest-QuotasAdminTestV257-1111673498-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:23.917776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:23.917776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:23.917776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:23.917776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] PATH_INFO: `/v3/users/356ab4339b904591906daef6976acb1b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:23.924036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356ab4339b904591906daef6976acb1b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:23.926702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:23.992578 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:24.046048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2d3ca-9131-4143-9edd-79a348dacd45 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:24.047824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356ab4339b904591906daef6976acb1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.067837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:24.069278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356ab4339b904591906daef6976acb1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.072167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:24.073649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:24.075809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] PATH_INFO: `/v3/projects/7e0fab112a3444e499d79a7d40041696` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:24.081972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0fab112a3444e499d79a7d40041696)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:24.088567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:24.104564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356ab4339b904591906daef6976acb1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.137840 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:24.176244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356ab4339b904591906daef6976acb1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.181616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0f08fc7-e039-4867-b6c7-d7b991250a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356ab4339b904591906daef6976acb1b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.197781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1273/2588] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:23 2022] DELETE /identity/v3/users/356ab4339b904591906daef6976acb1b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:24.203310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:24.203641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:24.204742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:24.237045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0fab112a3444e499d79a7d40041696', 'request_id': 'req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.237300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:24.238758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:24.264461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0fab112a3444e499d79a7d40041696', 'request_id': 'req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.282397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0fab112a3444e499d79a7d40041696', 'request_id': 'req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.312758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] The token cache is being invalidate because project 7e0fab112a3444e499d79a7d40041696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:24.312910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.313666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.315777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1316/2589] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:23 2022] DELETE /identity/v3/projects/7e0fab112a3444e499d79a7d40041696 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:24.320603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:24.328185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:24.451851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1274/2590] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:24.483622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:24.485189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:24.508296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c3d8f-72ac-4cd9-81c5-ca3a59795551 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:24.534741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:24.535983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:24.536463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:24.537488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] PATH_INFO: `/v3/users/a0edce0a9df74286926bd5c9be13327d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:24.542211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0edce0a9df74286926bd5c9be13327d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:24.550334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:24.620122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad4bd4-5ff8-43a8-a275-88806a5aa95e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:24.630539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:24.631452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:24.631790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:24.632075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:24.657465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:24.664849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:24.695331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0edce0a9df74286926bd5c9be13327d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.696194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0edce0a9df74286926bd5c9be13327d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.705001 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1275/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:24.713169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0edce0a9df74286926bd5c9be13327d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.724475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0edce0a9df74286926bd5c9be13327d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.756921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0edce0a9df74286926bd5c9be13327d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:24.775259 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1317/2592] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:24 2022] DELETE /identity/v3/users/a0edce0a9df74286926bd5c9be13327d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:25.444080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:25.451828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:25.507946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf9b22-8410-471f-8168-60c1b97d97f6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:25.613489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:25.615060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:25.649433 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:25.652123 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:25.687560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:25.690182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:25.690657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:25.691328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] PATH_INFO: `/v3/projects/55fc9bffeab040f2b571cf851796dae3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:25.698752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fc9bffeab040f2b571cf851796dae3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:25.701088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:25.758411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc928e44-3f22-4a52-98ca-5e5c844ae26e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:25.767632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:25.769266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:25.775410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:25.775739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] PATH_INFO: `/v3/projects/1aa34b9c8cbf436a9da77b745894c691` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:25.778197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa34b9c8cbf436a9da77b745894c691)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:25.780137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:25.812461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fc9bffeab040f2b571cf851796dae3', 'request_id': 'req-e14fc9a6-e873-4f1b-b982-db38095b27ee'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.824667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fc9bffeab040f2b571cf851796dae3', 'request_id': 'req-e14fc9a6-e873-4f1b-b982-db38095b27ee'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.839550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fc9bffeab040f2b571cf851796dae3', 'request_id': 'req-e14fc9a6-e873-4f1b-b982-db38095b27ee'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.861357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] The token cache is being invalidate because project 55fc9bffeab040f2b571cf851796dae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:25.862090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.863647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.867309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1276/2593] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:25 2022] DELETE /identity/v3/projects/55fc9bffeab040f2b571cf851796dae3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:25.871018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:25.875555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:25.891506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa34b9c8cbf436a9da77b745894c691', 'request_id': 'req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.903269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa34b9c8cbf436a9da77b745894c691', 'request_id': 'req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.921192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa34b9c8cbf436a9da77b745894c691', 'request_id': 'req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.948410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] The token cache is being invalidate because project 1aa34b9c8cbf436a9da77b745894c691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:25.950049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.952548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c09ca89d-1ea3-4826-b316-5ddaafcf4d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:25.958079 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1318/2594] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:25 2022] DELETE /identity/v3/projects/1aa34b9c8cbf436a9da77b745894c691 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:25.965204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb792a-7a58-49e9-8e7c-92fe95fa3d12 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:25.965883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb792a-7a58-49e9-8e7c-92fe95fa3d12 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:25.967330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb792a-7a58-49e9-8e7c-92fe95fa3d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.018084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-80fb792a-7a58-49e9-8e7c-92fe95fa3d12 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:26.019738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80fb792a-7a58-49e9-8e7c-92fe95fa3d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:26.188150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fc9a6-e873-4f1b-b982-db38095b27ee admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:26.249185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1319/2595] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:26.251639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5896-0240-4590-a496-b3373776e55c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.252124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5896-0240-4590-a496-b3373776e55c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.252649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5896-0240-4590-a496-b3373776e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.321715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-49ef5896-0240-4590-a496-b3373776e55c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:26.332090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-49ef5896-0240-4590-a496-b3373776e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:26.371240 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1320/2596] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:26.372327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5896-0240-4590-a496-b3373776e55c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:26.379102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:26.380021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.380902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.381649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] PATH_INFO: `/v3/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.384435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf12cd9f3ab47f48eb0e9fa1ce112d0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:26.387593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:26.404981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5896-0240-4590-a496-b3373776e55c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:26.429288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:26.430406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.430807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.431186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.434121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:26.435089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:26.439260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:26.449023 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:26.472815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1321/2597] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:26.474663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:26.486740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc8c4-32ae-4a44-9ab9-62bb879ed1e2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:26.507492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:26.511224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.511874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.512378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.513272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:26.518270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e79eb-1226-4699-ac3a-52f4b9870c34 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:26.518799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf12cd9f3ab47f48eb0e9fa1ce112d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:26.535975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf12cd9f3ab47f48eb0e9fa1ce112d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:26.560189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf12cd9f3ab47f48eb0e9fa1ce112d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:26.626947 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1322/2598] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:26 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:26.629201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.629525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.630113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.642132 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:26.650494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf12cd9f3ab47f48eb0e9fa1ce112d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:26.651548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf12cd9f3ab47f48eb0e9fa1ce112d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:26.670184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:26.671673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:26.671975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1277/2599] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:25 2022] DELETE /identity/v3/users/3cf12cd9f3ab47f48eb0e9fa1ce112d0 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:26.673260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:26.677018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:26.836512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dbf3c-4831-47cc-a154-89bfb9831504 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:26.847742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:26.848743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.854826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.855334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.856433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:26.858755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:26.874213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1323/2600] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:26.902679 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1278/2601] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:26 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:26.908633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:26.919373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:26.922311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:26.933596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfafe4-2e2d-4fb9-b9b0-b21a61a456ad None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:26.950925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:26.951746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:26.952157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:26.952494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:26.953637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:26.955857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:26.971601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1324/2602] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:26.976755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:27.012478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ac190-fd99-46d2-9448-206c112d3e46 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.040288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:27.042668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.044596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.045317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.050898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:27.058021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:27.092767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbace1-444c-4d41-8e70-50c8edaedb2b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.092985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1325/2603] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:27.097348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:27.113426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:27.114420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.115528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.115997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.127739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a568-0ec0-43cb-862a-57549453bff7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.144532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:27.148273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.150436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:27.150678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.151474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] PATH_INFO: `/v3/projects/df7dbb463a2d4bfd9c43b388f13f092c/users/3348865b6fe845cc90a597ae48dff70e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.152322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b96c37-7169-4b4e-880c-65fc5d7d60d1 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:27.188676 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1279/2604] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:11:27.207198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7dbb463a2d4bfd9c43b388f13f092c, user_id=3348865b6fe845cc90a597ae48dff70e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:27.223787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:27.270208 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1326/2605] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:27 2022] PUT /identity/v3/projects/df7dbb463a2d4bfd9c43b388f13f092c/users/3348865b6fe845cc90a597ae48dff70e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:27.288679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.289121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.289448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.363450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] MFA Rules not processed for user `3348865b6fe845cc90a597ae48dff70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:27.365780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:27.393236 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:27.514910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:27.516844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:27.551829 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1280/2606] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:27.557201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:27.750220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcc900-2b90-4640-8121-339f7036507a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.762355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337265ef-9adc-46b8-ae48-9e8796bba051 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.762571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:27.764373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.764896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.765294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.766168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:27.773292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:27.774446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:27.774703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:27.774988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] PATH_INFO: `/v3/projects/4d4e270519d1479c8458629e9ce4e91c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:27.775888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:27.776469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4e270519d1479c8458629e9ce4e91c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:27.778663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:27.823160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1281/2607] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:27 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:27.824369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:27.921640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4e270519d1479c8458629e9ce4e91c', 'request_id': 'req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:27.923981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7488b-b5fe-4bbc-8964-4c541ecc1fe5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:27.939233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4e270519d1479c8458629e9ce4e91c', 'request_id': 'req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:27.946106 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:27.957002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4e270519d1479c8458629e9ce4e91c', 'request_id': 'req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:27.984451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] The token cache is being invalidate because project 4d4e270519d1479c8458629e9ce4e91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:27.984451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:27.985751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65902a8d-88f3-4ce9-a372-94ee2b6b7f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:27.997737 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:28.009280 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1327/2608] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:27 2022] DELETE /identity/v3/projects/4d4e270519d1479c8458629e9ce4e91c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:28.013255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717b8-3bb6-4581-bfac-997b0a2183cc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.014913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717b8-3bb6-4581-bfac-997b0a2183cc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.016552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717b8-3bb6-4581-bfac-997b0a2183cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.058962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.061599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.063704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.064183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.065780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.073173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.078137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fd1717b8-3bb6-4581-bfac-997b0a2183cc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:28.081382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fd1717b8-3bb6-4581-bfac-997b0a2183cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:28.112621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1328/2609] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:28.116592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.116914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.117210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.161383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:28.167486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:28.172229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1282/2610] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:27 2022] POST /identity/v3/users => generated 298 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:28.174258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.186526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:28.214429 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1329/2611] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:28.218659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.249299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab4f74-b690-4ad1-b7cf-c4dc0dcc9415 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.249809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c425-02d8-4bfe-9c4b-544e278a832a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.270511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.272409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.273124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.273413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.273714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.277665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.278121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.278309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.280639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.285549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:28.286646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.288964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.293520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.350004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1283/2612] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:28.351787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.369136 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1330/2613] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:28.371102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.403685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183e6d-7b2c-4c9b-84d7-b4113ce6a4a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.403929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc1a73-d858-4936-8619-a709f9fc4764 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.420724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.422419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.422908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.423257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.423542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.424097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.424396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.426695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] PATH_INFO: `/v3/projects/dd11c313d4484e54814218f3a5a8003f/users/8b542c5fc4a44956b1db53d0b29bc61c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.434133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.438872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.456863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd11c313d4484e54814218f3a5a8003f, user_id=8b542c5fc4a44956b1db53d0b29bc61c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.460257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.505979 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1284/2614] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:28 2022] PUT /identity/v3/projects/dd11c313d4484e54814218f3a5a8003f/users/8b542c5fc4a44956b1db53d0b29bc61c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:28.509448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1331/2615] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:28 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:28.511305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.511433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.704122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a53ef-6ed1-4f5e-9cb7-e690161dfc28 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.714111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.716600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.716959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.718278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.720334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.722326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.733571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8a45f-39f7-4e63-a66f-b2d58224c0b1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.770796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.772582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.773157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.776036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.778100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.784966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.808271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1285/2616] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:28.809895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1332/2617] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:28 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:28.810902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.811583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.829070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5128c3e-36d1-4f23-9905-37d94dda017b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.857715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.859788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.865764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdc386-478f-41e7-bf11-8ffd43a52f4e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.867204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.867839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] PATH_INFO: `/v3/projects/dd11c313d4484e54814218f3a5a8003f/users/8b542c5fc4a44956b1db53d0b29bc61c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.871645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd11c313d4484e54814218f3a5a8003f, user_id=8b542c5fc4a44956b1db53d0b29bc61c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.876609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ba57b-da95-4ae2-9ce0-cd99c0ddc90c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.897442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1286/2618] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:28 2022] PUT /identity/v3/projects/dd11c313d4484e54814218f3a5a8003f/users/8b542c5fc4a44956b1db53d0b29bc61c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:28.898597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:28.899347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.899630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.899908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.900670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:28.902353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:28.909367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d6a0-abad-42c0-ade5-37607e9c63b6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:28.913839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d6a0-abad-42c0-ade5-37607e9c63b6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:28.914724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d6a0-abad-42c0-ade5-37607e9c63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:28.955458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1333/2619] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:28.956434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:28.969461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930d8d2-4fcc-4418-8104-d6bb0b5e44c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:28.973665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b367d6a0-abad-42c0-ade5-37607e9c63b6 None None] MFA Rules not processed for user `8b542c5fc4a44956b1db53d0b29bc61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:28.980684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b367d6a0-abad-42c0-ade5-37607e9c63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:29.081779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:29.082465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:29.082769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:29.083063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:29.084310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:29.089870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:29.113720 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1334/2620] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:29.119083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:29.149720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa84af-440b-47d2-97e1-2cf618f00300 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:29.169605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:29.170981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:29.171467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:29.171926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] PATH_INFO: `/v3/projects/398c03dd81d44131b50d466f22c4001c/users/1303cf4bd9f84cb1802e4d3b6ccbafa2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:29.213026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1287/2621] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:29.229645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398c03dd81d44131b50d466f22c4001c, user_id=1303cf4bd9f84cb1802e4d3b6ccbafa2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:29.235371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:29.240729 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:29.293276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1335/2622] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:29 2022] PUT /identity/v3/projects/398c03dd81d44131b50d466f22c4001c/users/1303cf4bd9f84cb1802e4d3b6ccbafa2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:29.308998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:29.309473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:29.309923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:29.337574 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:29.406242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] MFA Rules not processed for user `1303cf4bd9f84cb1802e4d3b6ccbafa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:29.408887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:29.586720 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1288/2623] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:29.591285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:29.714921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30657-47d1-4f8f-a4a5-4a9cf5620567 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:29.723355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:29.724784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:29.725169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:29.726123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:29.727083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:29.730087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:29.772607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:29.785012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1336/2624] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:29 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:29.798929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51d82a-d08d-4473-b376-e31ee4abadd4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:29.888997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:29.889903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:29.890286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:29.890666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:29.891504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:29.894429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:29.928046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1289/2625] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:29 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:29.931300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:29.976992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a21f-a50c-4deb-b81d-8699e1630893 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:30.003820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:30.004541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.004831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.005112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.016461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:30.034919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:30.074754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1337/2626] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:30.079194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:30.101297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca29e61-c5d3-4546-ac82-4fa93cf097c0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:30.107576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:30.108637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.108921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.109293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] PATH_INFO: `/v3/projects/2dd31cba32094159a710da639bebe303/users/1fb2cd0aa24a43798966a858b99c9712/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.126192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:30.131187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd31cba32094159a710da639bebe303, user_id=1fb2cd0aa24a43798966a858b99c9712, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:30.132434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:30.138014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:30.168946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1290/2627] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:30 2022] PUT /identity/v3/projects/2dd31cba32094159a710da639bebe303/users/1fb2cd0aa24a43798966a858b99c9712/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:30.173876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:30.258313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83adf-b250-4d37-ba42-7e415d6c2be7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:30.283021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3965a-0a54-4cb0-be0a-4ba563da7df0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:30.290304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:30.291163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.291448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.291724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.292969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:30.295120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:30.300307 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:30.317359 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1291/2628] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:30.318493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:30.334169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50002c-de4d-4cec-aff6-0330763bdc78 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:30.339467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:30.340554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.340939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.341318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] PATH_INFO: `/v3/projects/2dd31cba32094159a710da639bebe303/users/1fb2cd0aa24a43798966a858b99c9712/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.343514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd31cba32094159a710da639bebe303, user_id=1fb2cd0aa24a43798966a858b99c9712, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:30.346323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907c67-72f6-412b-8841-47bc0a4c1959 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:30.352985 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:30.362511 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1292/2629] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:30 2022] PUT /identity/v3/projects/2dd31cba32094159a710da639bebe303/users/1fb2cd0aa24a43798966a858b99c9712/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:30.365277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:30.366540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.366961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.367395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.441706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.442039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.442286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.491696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:30.493316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c392a-03d8-4d1b-b56f-ad889b17ef65 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:30.502476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] MFA Rules not processed for user `1fb2cd0aa24a43798966a858b99c9712`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:30.503737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:30.515179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1338/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:30.654859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1293/2631] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:30.668378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016409-8185-4a58-bc8f-87f324a24c68 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:30.668871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016409-8185-4a58-bc8f-87f324a24c68 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:30.669361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016409-8185-4a58-bc8f-87f324a24c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:30.708063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a2016409-8185-4a58-bc8f-87f324a24c68 None None] MFA Rules not processed for user `1303cf4bd9f84cb1802e4d3b6ccbafa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:30.717084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a2016409-8185-4a58-bc8f-87f324a24c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:30.884188 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1339/2632] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:31.889912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:32.078362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6507f-0e6c-45f0-8461-8f6e16ac8645 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:32.106600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:32.107388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:32.107735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:32.108015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:32.176319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:32.178049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:32.221606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1294/2633] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:39.541800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c1c2-841f-4cfc-8c3f-359c3af758ae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.542328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c1c2-841f-4cfc-8c3f-359c3af758ae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.542328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c1c2-841f-4cfc-8c3f-359c3af758ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.563546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6ed3c1c2-841f-4cfc-8c3f-359c3af758ae None None] MFA Rules not processed for user `23333c1ebbdf4ddab9d21d5b8b7139e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:39.564797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ed3c1c2-841f-4cfc-8c3f-359c3af758ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:39.675348 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1340/2634] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:39.906116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.976890 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:39.983604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5cfe-7c06-4acb-beb6-aa3c0223dbd5 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.992261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.993315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.993651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.993950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] PATH_INFO: `/v3/users/3348865b6fe845cc90a597ae48dff70e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.995460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3348865b6fe845cc90a597ae48dff70e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.997471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.056043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3348865b6fe845cc90a597ae48dff70e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:40.064778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3348865b6fe845cc90a597ae48dff70e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:40.091090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3348865b6fe845cc90a597ae48dff70e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:40.130495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3348865b6fe845cc90a597ae48dff70e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:40.136031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3348865b6fe845cc90a597ae48dff70e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:40.169247 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1295/2635] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:39 2022] DELETE /identity/v3/users/3348865b6fe845cc90a597ae48dff70e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:40.174606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.181396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.181973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.248080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:40.249536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:40.369274 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:40.400070 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1341/2636] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:40.410613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:40.412261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:40.543686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462db51-67be-4c9b-ab61-4ebe6f4626bf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:40.557156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:40.557880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.558170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.558452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.591012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:40.592881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.618170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1296/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:41.375219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:41.381644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.399758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc246900-5ad8-444a-b37b-2a1fa570ec89 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:41.406916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:41.408421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.408927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.409441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] PATH_INFO: `/v3/projects/df7dbb463a2d4bfd9c43b388f13f092c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.411515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7dbb463a2d4bfd9c43b388f13f092c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:41.414147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:41.574545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7dbb463a2d4bfd9c43b388f13f092c', 'request_id': 'req-08bf6b33-effa-4030-8136-0ee33b139c3f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.610287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7dbb463a2d4bfd9c43b388f13f092c', 'request_id': 'req-08bf6b33-effa-4030-8136-0ee33b139c3f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.644368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7dbb463a2d4bfd9c43b388f13f092c', 'request_id': 'req-08bf6b33-effa-4030-8136-0ee33b139c3f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.676192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] The token cache is being invalidate because project df7dbb463a2d4bfd9c43b388f13f092c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:41.678266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.679720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.684693 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1342/2638] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:41 2022] DELETE /identity/v3/projects/df7dbb463a2d4bfd9c43b388f13f092c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:41.688820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:41.708500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a1695-2f86-4eda-a50d-df1446682a31 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:41.848087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:41.849110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.849444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.849713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] PATH_INFO: `/v3/users/8b542c5fc4a44956b1db53d0b29bc61c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.851408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b542c5fc4a44956b1db53d0b29bc61c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:41.853315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:41.905835 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:41.955402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b542c5fc4a44956b1db53d0b29bc61c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.966262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b542c5fc4a44956b1db53d0b29bc61c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.977375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b542c5fc4a44956b1db53d0b29bc61c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.006199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b542c5fc4a44956b1db53d0b29bc61c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.006978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c099a7ee-c1ba-47be-910e-77d5b330259b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b542c5fc4a44956b1db53d0b29bc61c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.016712 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1297/2639] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:41 2022] DELETE /identity/v3/users/8b542c5fc4a44956b1db53d0b29bc61c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:42.668566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:42.672039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:42.701287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6b33-effa-4030-8136-0ee33b139c3f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:42.868636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:42.869531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:42.869857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:42.874769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] PATH_INFO: `/v3/projects/dd11c313d4484e54814218f3a5a8003f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:42.877933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd11c313d4484e54814218f3a5a8003f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:42.880099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:42.986196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd11c313d4484e54814218f3a5a8003f', 'request_id': 'req-b4454bb2-b3d9-44bb-8256-98ad031f9170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.010847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd11c313d4484e54814218f3a5a8003f', 'request_id': 'req-b4454bb2-b3d9-44bb-8256-98ad031f9170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.033358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd11c313d4484e54814218f3a5a8003f', 'request_id': 'req-b4454bb2-b3d9-44bb-8256-98ad031f9170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.048607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] The token cache is being invalidate because project dd11c313d4484e54814218f3a5a8003f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:43.049033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.050014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b4454bb2-b3d9-44bb-8256-98ad031f9170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.058024 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1343/2640] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:42 2022] DELETE /identity/v3/projects/dd11c313d4484e54814218f3a5a8003f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:43.059728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.060190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.060287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.082987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:43.084457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:43.185600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1298/2641] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:43.197264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.197695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.198045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.205379 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:43.224854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:43.227251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:43.237724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1344/2642] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:43.242800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.253199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ccdc-1871-4774-aea7-8a4b1565cb15 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.258505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.259202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.259682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.259955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.260700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:43.261011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.262649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.286703 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1299/2643] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:43.299860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.310633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65846c-0c4e-4ea7-895b-8e87084997ed None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.315660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.316422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.316810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.317180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.318169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.320216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.347722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1345/2644] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:43.353272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.363531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595eb8f-7cf1-4ece-8ae0-c26d12683b11 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.422882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.423588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.423869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.424146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.424851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.427541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.449473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1300/2645] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:43.453519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.472404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87957054-5a3b-47af-9a8e-05a1594e8f08 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.478358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.479182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.479528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.479869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.480673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.482407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.499575 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1346/2646] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:43.501629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.515655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1dd8-4453-44d7-b61d-4ce763f86523 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.521402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.522276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.522660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.523035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.524954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.527208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de227e-6fa7-4d4d-a9df-3c074e870081 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.539664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1301/2647] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:43.543923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.555654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d2b8-3356-4523-8035-faa76d379bdc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.561176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.563643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.564171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.564455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] PATH_INFO: `/v3/projects/c856aaa862324dd88e36969970ca7a1e/users/5a5fecdfc09a40659bfd81d7633c2874/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.583832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c856aaa862324dd88e36969970ca7a1e, user_id=5a5fecdfc09a40659bfd81d7633c2874, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.586751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.607455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1347/2648] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:43 2022] PUT /identity/v3/projects/c856aaa862324dd88e36969970ca7a1e/users/5a5fecdfc09a40659bfd81d7633c2874/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:43.619322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.619595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.619926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.629261 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:43.661009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] MFA Rules not processed for user `5a5fecdfc09a40659bfd81d7633c2874`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:43.664032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:43.761527 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1302/2649] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:43.762145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.899376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5cae7-fb35-4762-9bc6-b340fab1ac4f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.907142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.908003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.908392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.908772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.909610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.912281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.945411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1348/2650] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:43.947002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:43.965327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf98b3-da3d-4549-a199-625966875fbc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.045076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.045905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.046192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.046619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.047444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.049999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.086258 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1303/2651] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:43 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:44.087682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.102821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007efeed-bbbb-4fbc-8954-f6238c3dc6e1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.109472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.110247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.110739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.111072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.112767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.115211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.132326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1349/2652] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:44.134183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.146144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4e99-ce9a-4503-80dc-8255494eabea admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.152295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.153534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.153841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.154172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] PATH_INFO: `/v3/projects/512b851da66345eab40491218f42fadf/users/bf202affc2144f85aa19b86ff7c185bd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.173475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=512b851da66345eab40491218f42fadf, user_id=bf202affc2144f85aa19b86ff7c185bd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.176212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.193996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1304/2653] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:44 2022] PUT /identity/v3/projects/512b851da66345eab40491218f42fadf/users/bf202affc2144f85aa19b86ff7c185bd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:44.198352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.209595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703d57-e68d-4bd6-b2fa-f40b37f2f584 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.307519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.308193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.308471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.308743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.309473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.311133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c0c1-fe03-4e89-87cc-7e25b5c6dda7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.326437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1350/2654] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:44.328333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.340613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4b4d-28a0-4cfc-9d89-824d2915bf1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.347540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.349431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.349431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.349431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] PATH_INFO: `/v3/projects/512b851da66345eab40491218f42fadf/users/bf202affc2144f85aa19b86ff7c185bd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.351875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=512b851da66345eab40491218f42fadf, user_id=bf202affc2144f85aa19b86ff7c185bd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.354579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.370138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1305/2655] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:44 2022] PUT /identity/v3/projects/512b851da66345eab40491218f42fadf/users/bf202affc2144f85aa19b86ff7c185bd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:44.444483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.444822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.445064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.467803 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:44.481712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] MFA Rules not processed for user `bf202affc2144f85aa19b86ff7c185bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:44.484073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:44.613715 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1351/2656] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:44.751656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.753846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:44.830696 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:44.873398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904b5b0-d7d9-43b9-bea2-ba5cc6a4b3bc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.882286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.883110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.883497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.883873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.985405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.987225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd862b-9b55-4b8d-b67e-1a3ab07745f9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:45.000599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1306/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:47.623335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.643310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094797b4-4118-4aa0-ab90-f0095cfcd9be None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.649623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.688243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.690768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.691499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.727199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.729056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.752581 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1352/2658] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:48.412318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.412817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.412910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.464442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:48.465713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.571080 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1307/2659] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:48.587940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.591552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.706768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba093-6c3c-45ae-92e4-794e468cfdab service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.722224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.723893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.725059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.725910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.741605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.743052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3095-4eec-4065-ad1b-f4ab8846aef1 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.753284 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1353/2660] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:11:48.780505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.781470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.883065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457ace-7546-4919-a135-30b6aace29fb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.889219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.890408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.890997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.891793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] PATH_INFO: `/v3/users/bfd5b02713f54950b7a5fae18bf4d485` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.893265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd5b02713f54950b7a5fae18bf4d485)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.896804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.945261 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:48.981357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd5b02713f54950b7a5fae18bf4d485'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.992888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd5b02713f54950b7a5fae18bf4d485'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.005242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd5b02713f54950b7a5fae18bf4d485'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.022389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd5b02713f54950b7a5fae18bf4d485'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.024317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd5b02713f54950b7a5fae18bf4d485'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.040998 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1308/2661] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:48 2022] DELETE /identity/v3/users/bfd5b02713f54950b7a5fae18bf4d485 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:49.042738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.043194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.043484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.072173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:49.074209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.212702 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1354/2662] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:49.237557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:49.237557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.327723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e24851-3324-46ea-82bb-07d6d94417fe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:49.333572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:49.334412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.334702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.334979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.349978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:49.351726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:49.364587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1309/2663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:49.627467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:49.628985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.661541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6078e-b467-4e78-9382-7160d75aeec4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:49.684470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:49.685360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.685639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.686554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] PATH_INFO: `/v3/projects/c028787727e34a489f5a99f937538b6f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.689150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c028787727e34a489f5a99f937538b6f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:49.691113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:49.710173 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:49.806180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c028787727e34a489f5a99f937538b6f', 'request_id': 'req-4ee914e7-8261-497f-8872-866d7bce6710'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.819439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c028787727e34a489f5a99f937538b6f', 'request_id': 'req-4ee914e7-8261-497f-8872-866d7bce6710'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.836572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c028787727e34a489f5a99f937538b6f', 'request_id': 'req-4ee914e7-8261-497f-8872-866d7bce6710'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.869911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] The token cache is being invalidate because project c028787727e34a489f5a99f937538b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:49.870343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.871158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.879295 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1355/2664] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:49 2022] DELETE /identity/v3/projects/c028787727e34a489f5a99f937538b6f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:49.884668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:49.897590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55671f-4d62-47f1-af94-cd5d44b7734f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:49.972373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:49.973315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.974303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.974934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] PATH_INFO: `/v3/users/b21288bea81c460291ad43b26f517457` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.976165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21288bea81c460291ad43b26f517457)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:49.982347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.073480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21288bea81c460291ad43b26f517457'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.078826 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:50.088537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21288bea81c460291ad43b26f517457'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.116994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21288bea81c460291ad43b26f517457'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.134980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21288bea81c460291ad43b26f517457'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.136006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62b8f896-705a-47dc-aaad-5c1f67f34d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21288bea81c460291ad43b26f517457'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.146458 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1310/2665] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:49 2022] DELETE /identity/v3/users/b21288bea81c460291ad43b26f517457 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:50.440650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.442228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:50.472418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee914e7-8261-497f-8872-866d7bce6710 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.642340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.643998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.644390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.644769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] PATH_INFO: `/v3/projects/8a01e29df907490aaa30e9b7f77ee406` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.647663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a01e29df907490aaa30e9b7f77ee406)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.650612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.778974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a01e29df907490aaa30e9b7f77ee406', 'request_id': 'req-a781f2a3-64b2-4930-aeb2-092d775e8dbf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.797947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a01e29df907490aaa30e9b7f77ee406', 'request_id': 'req-a781f2a3-64b2-4930-aeb2-092d775e8dbf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.815504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a01e29df907490aaa30e9b7f77ee406', 'request_id': 'req-a781f2a3-64b2-4930-aeb2-092d775e8dbf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.846198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] The token cache is being invalidate because project 8a01e29df907490aaa30e9b7f77ee406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:50.846660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.849589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a781f2a3-64b2-4930-aeb2-092d775e8dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:50.852077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1356/2666] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:50 2022] DELETE /identity/v3/projects/8a01e29df907490aaa30e9b7f77ee406 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:50.859434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.859923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.860322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.906972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:50.908244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.059607 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1311/2667] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:51.068483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.068866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.069206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.110783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:51.112446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.141874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1357/2668] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:51.147106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.164737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a540-0eb8-4e2a-8326-cc6cfc0569b9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.185562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.186937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.187108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.187391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.188151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:51.188456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.191137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.233716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1312/2669] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:51.238759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.263894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041d4a-4dba-4e54-afcc-219b0b0ff7d7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.273900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.275316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.276035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.276718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.278251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.284160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.311655 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:51.352170 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1358/2670] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:51.356725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.399390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecea6d-b4fe-4887-938a-bb5d30c5cd18 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.550792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.551815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.552254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.552969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.553630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.555926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.589728 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1313/2671] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:51.593227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.606820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b3eac-9d2c-46d2-8c5d-fa363fc7539d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.613093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.614537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.615203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.615582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.617721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.618640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.637330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.644437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1359/2672] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:51.650144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d27ef6-d6a8-4a6f-909d-128411ce774f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.655822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.656864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.657401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.657821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.658748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.662412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ca5bf-fd88-4f46-896c-880df1e657d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.690789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1314/2673] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:51.692462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.704834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cb39-b554-452a-8c6f-72e92a078b43 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.718141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.719252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.719641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.719985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] PATH_INFO: `/v3/projects/e67380ef5ad54bc9b978142f9f9eaa8e/users/e053b08200e941c09cbfceca57fcf7f2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.741891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67380ef5ad54bc9b978142f9f9eaa8e, user_id=e053b08200e941c09cbfceca57fcf7f2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.745324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.783962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1360/2674] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:51 2022] PUT /identity/v3/projects/e67380ef5ad54bc9b978142f9f9eaa8e/users/e053b08200e941c09cbfceca57fcf7f2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:51.851943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.852243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.852523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.915758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] MFA Rules not processed for user `e053b08200e941c09cbfceca57fcf7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:51.916932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.985764 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:52.121971 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1315/2675] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:52.360751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.363454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.510071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac979-2f7b-4b0d-9e64-360074053a84 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.516420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.517235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.517638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.523700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.540353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.542228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ad2a0-8370-4704-9f8a-e8b46ef72a9c service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.554260 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1361/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:52.664392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.826007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d5a36-4f58-4471-bf0a-62b2e30fb5ef None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.830890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.831796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.832080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.832387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] PATH_INFO: `/v3/users/e053b08200e941c09cbfceca57fcf7f2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.834906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e053b08200e941c09cbfceca57fcf7f2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.837944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.939229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e053b08200e941c09cbfceca57fcf7f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:52.955399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e053b08200e941c09cbfceca57fcf7f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:52.968848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e053b08200e941c09cbfceca57fcf7f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:52.999960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e053b08200e941c09cbfceca57fcf7f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:53.000902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e053b08200e941c09cbfceca57fcf7f2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:53.018935 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1316/2677] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:52 2022] DELETE /identity/v3/users/e053b08200e941c09cbfceca57fcf7f2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:53.024789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.025314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.025399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.062861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:53.065347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.236844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1362/2678] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:53.237060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.238729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.339234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:53.366344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30cbe6-d665-426e-812a-77e9f34c839f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.371586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.372361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.372716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.373087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.402368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.403921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ce64f-e911-435a-9696-9faa05b7d5f1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.431148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1317/2679] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:54.010237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.014402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.038040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da969a-fcc8-4b4c-9faa-e784e88d4fe7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.049714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.052881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.053435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.055871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] PATH_INFO: `/v3/projects/e67380ef5ad54bc9b978142f9f9eaa8e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.060298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67380ef5ad54bc9b978142f9f9eaa8e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.063129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.212053 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:54.225048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67380ef5ad54bc9b978142f9f9eaa8e', 'request_id': 'req-995defc3-d1ab-4468-9613-83281c716f8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:54.233793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67380ef5ad54bc9b978142f9f9eaa8e', 'request_id': 'req-995defc3-d1ab-4468-9613-83281c716f8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:54.257994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67380ef5ad54bc9b978142f9f9eaa8e', 'request_id': 'req-995defc3-d1ab-4468-9613-83281c716f8d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:54.277523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] The token cache is being invalidate because project e67380ef5ad54bc9b978142f9f9eaa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:54.277897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:54.279597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-995defc3-d1ab-4468-9613-83281c716f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:54.281889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1363/2680] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:54 2022] DELETE /identity/v3/projects/e67380ef5ad54bc9b978142f9f9eaa8e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:54.287015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.287979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.288420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.333826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:54.335847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.453429 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1318/2681] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:54.463254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.464215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.464765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.493663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:54.497414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.519035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1364/2682] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:54.525101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.541351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377552a8-f94b-413c-859a-9b66d18a421d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.549644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.550547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.550934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.551954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.553457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:54.554080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.556922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.589961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1319/2683] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:54.593955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.613473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689baacd-8cb7-492f-86ab-36a30e90967f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.617911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.620622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.620979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.621326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.622157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.624381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.673807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1365/2684] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/projects => generated 397 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:54.677875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.689644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413e7e-2f18-4a50-aa0b-9d42088988ae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.807272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.808247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.808620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.808967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.809859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.811946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.851028 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1320/2685] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:54.851243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.862791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12bd11-92a1-4564-94e5-ceea53dc3e45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.868413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.869278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.869565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.869863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.870611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.872449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.887780 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1366/2686] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:54.891851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.932232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e393d3e-cd7f-4fc6-97cc-3e96ad9cac5a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.943548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.944317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.944702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.945030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.946475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.949068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79206ea-096d-4476-9d17-462bc5aafec9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.976178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.976397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1321/2687] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:54.989230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594275-ed5a-4755-98a7-4ccc745da564 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.997988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.999996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.000593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.001183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] PATH_INFO: `/v3/projects/9a6fa94d0cab4efea6cd924459d20656/users/f0c7356c8a6b4618b7f8acc88eefc6b1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.049137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6fa94d0cab4efea6cd924459d20656, user_id=f0c7356c8a6b4618b7f8acc88eefc6b1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.052060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.081776 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1367/2688] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:54 2022] PUT /identity/v3/projects/9a6fa94d0cab4efea6cd924459d20656/users/f0c7356c8a6b4618b7f8acc88eefc6b1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:55.088465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.089310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.089310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.136189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:55.137651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.229001 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:55.249149 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1322/2689] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:55.260512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.267236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.414398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946bd7-981c-474f-a49f-431751052e68 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:55.419176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.419988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.420343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.420694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.436668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.439477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea817-a2f0-4627-a95c-e58602bb2dd8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.453193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1368/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:56.742066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.749881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.785547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5debff-87ec-4143-989c-0a03ebeb8410 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.796242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.797649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.798180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.798678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] PATH_INFO: `/v3/users/5a5fecdfc09a40659bfd81d7633c2874` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.800151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5fecdfc09a40659bfd81d7633c2874)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.802564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.907264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5fecdfc09a40659bfd81d7633c2874'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:56.922166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5fecdfc09a40659bfd81d7633c2874'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:56.939073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5fecdfc09a40659bfd81d7633c2874'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:56.989723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5fecdfc09a40659bfd81d7633c2874'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:56.991972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5fecdfc09a40659bfd81d7633c2874'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:57.013589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1323/2691] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:56 2022] DELETE /identity/v3/users/5a5fecdfc09a40659bfd81d7633c2874 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:57.016353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.016868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.016977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.060466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:57.062243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:57.211119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1369/2692] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:57.225450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.227670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:57.321973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35520f-baf4-4f2c-9d5b-20a30e4b7ec3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:57.326650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:57.327648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.328152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.328632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.340052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.342031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.354915 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1324/2693] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:57.752814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.754030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:57.812154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6de353-e62b-41b5-b2ff-5fd58d25533c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:57.855954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:57.856873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.857162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.857440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] PATH_INFO: `/v3/projects/c856aaa862324dd88e36969970ca7a1e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.867668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c856aaa862324dd88e36969970ca7a1e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.871880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.888653 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:58.029363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c856aaa862324dd88e36969970ca7a1e', 'request_id': 'req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.048108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c856aaa862324dd88e36969970ca7a1e', 'request_id': 'req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.066290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c856aaa862324dd88e36969970ca7a1e', 'request_id': 'req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.094179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] The token cache is being invalidate because project c856aaa862324dd88e36969970ca7a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:58.094829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.095978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.102389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1370/2694] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:57 2022] DELETE /identity/v3/projects/c856aaa862324dd88e36969970ca7a1e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:58.106574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.124501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec2df0-9745-401d-801a-9d6ca2fc9b74 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.264569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.266187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.266471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.266748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] PATH_INFO: `/v3/users/bf202affc2144f85aa19b86ff7c185bd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.268857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf202affc2144f85aa19b86ff7c185bd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.274890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.283083 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:58.373371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf202affc2144f85aa19b86ff7c185bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.389535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf202affc2144f85aa19b86ff7c185bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.406465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf202affc2144f85aa19b86ff7c185bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.432658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf202affc2144f85aa19b86ff7c185bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.433398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a8419a11-42c1-4168-9e99-8d111d379368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf202affc2144f85aa19b86ff7c185bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:58.444740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1325/2695] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:58 2022] DELETE /identity/v3/users/bf202affc2144f85aa19b86ff7c185bd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:00.237381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:00.240522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.273014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdcfc-4bee-4d79-a870-2c933efcb46a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:00.430088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:00.430987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.431273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.431697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] PATH_INFO: `/v3/projects/512b851da66345eab40491218f42fadf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.434592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512b851da66345eab40491218f42fadf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:00.440322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:00.566453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512b851da66345eab40491218f42fadf', 'request_id': 'req-1af47d7d-838b-46cd-acc4-a6da03fa27f5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.579503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512b851da66345eab40491218f42fadf', 'request_id': 'req-1af47d7d-838b-46cd-acc4-a6da03fa27f5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.590694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512b851da66345eab40491218f42fadf', 'request_id': 'req-1af47d7d-838b-46cd-acc4-a6da03fa27f5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.620103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] The token cache is being invalidate because project 512b851da66345eab40491218f42fadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:00.620727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.621758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1af47d7d-838b-46cd-acc4-a6da03fa27f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.639924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1371/2696] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:00 2022] DELETE /identity/v3/projects/512b851da66345eab40491218f42fadf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:00.642495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.643038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.643451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.689110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:00.690478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.861431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1326/2697] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:00.865557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.866172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.867360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.920627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:00.922281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.953518 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1372/2698] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:00.954807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:00.985805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6bcc-f66d-40c0-8a02-5cde0129fe75 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.004507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.005213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.005500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.005851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.007034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:01.007361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.016314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.071383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1327/2699] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:01.072867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.091216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856b46d-1969-4fda-9a18-0bc50ec90373 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.126628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.131002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.131606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.134418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.141038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.143629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.182165 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:01.211217 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1373/2700] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:01.212554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.230360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8bf7-583f-4831-b238-ea6feaaba4b8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.368905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.369604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.369930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.370198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.372956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.374979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.432795 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1328/2701] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:01 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:01.437461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.457354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f145c4-75b5-48ed-acd4-5989192ef48c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.477426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.478151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.478435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.478711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.479513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.481141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.504225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1374/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:01.508549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.514184 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:01.535404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892bbda-9bad-4b0c-88b4-647e57999c3f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.551122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.552661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.554076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.554758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.558171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.561899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2dd15-5b29-45a6-b010-24036b38a7a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.586868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1329/2703] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:01.591070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.607670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2368d1-1c1f-49b4-ad07-3cde21cc5f97 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.619758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.620685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.620968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.621245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] PATH_INFO: `/v3/projects/6dc5a0a6cd7f48bc8c41a790c3f82cc6/users/3c39d06504644aa29428fc9b130e73ea/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.669501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5a0a6cd7f48bc8c41a790c3f82cc6, user_id=3c39d06504644aa29428fc9b130e73ea, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.672914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.707083 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1375/2704] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:01 2022] PUT /identity/v3/projects/6dc5a0a6cd7f48bc8c41a790c3f82cc6/users/3c39d06504644aa29428fc9b130e73ea/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:01.718637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c685f-b998-4509-b290-74c5d1857533 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.719545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c685f-b998-4509-b290-74c5d1857533 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.719832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c685f-b998-4509-b290-74c5d1857533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.780744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-069c685f-b998-4509-b290-74c5d1857533 None None] MFA Rules not processed for user `3c39d06504644aa29428fc9b130e73ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:01.782094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-069c685f-b998-4509-b290-74c5d1857533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:02.080707 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1330/2705] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:02.085725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:02.353069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68c8a7-6897-4d20-b4be-2409498fc2a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:02.369206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:02.369973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.370257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.370535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:02.371267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:02.386795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:02.457058 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1376/2706] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:02 2022] POST /identity/v3/projects => generated 375 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:02.461695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c685f-b998-4509-b290-74c5d1857533 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:02.479421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c685f-b998-4509-b290-74c5d1857533 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:02.711876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:02.713319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.714189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.715362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:02.718588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:02.727148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:02.808826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:02.821562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9579f-69f7-4616-abd3-d0a043781003 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:02.826684 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1331/2707] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:02 2022] POST /identity/v3/users => generated 294 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:02.851598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:02.854771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.855316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.857030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:02.858258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:02.863444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117310-92d4-4e9b-862c-f31255f01e7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:02.922563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1377/2708] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:02.923790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:02.956418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0b214-ea65-4ca0-9020-ef3bb1cab85f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:02.981588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:02.983150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.983440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.983721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] PATH_INFO: `/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf/users/92d10926d17f46009589656326529d94/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.033932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad2e4b4b5ab478a85ba7b44dd581faf, user_id=92d10926d17f46009589656326529d94, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.037446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.073635 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1332/2709] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:02 2022] PUT /identity/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf/users/92d10926d17f46009589656326529d94/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:03.074590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.074893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.075013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.075175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.142185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] MFA Rules not processed for user `f0c7356c8a6b4618b7f8acc88eefc6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:03.143463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.199966 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:03.246493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa288f-5a8a-49d7-a81c-984ce8ab79a9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:03.261198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:03.261939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.262222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.262502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.263262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.268951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.308205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1378/2710] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:03.315733 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1333/2711] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:03.316961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.318045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.319390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.345548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240bf8-8295-4abc-9dd7-5f97f0565d64 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:03.359329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:03.359966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.360250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.360524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] PATH_INFO: `/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf/users/92d10926d17f46009589656326529d94/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.363112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad2e4b4b5ab478a85ba7b44dd581faf, user_id=92d10926d17f46009589656326529d94, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.366112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e162daf-afcd-43e5-b026-3fb9e76de577 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.380197 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:03.402964 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1334/2712] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:03 2022] PUT /identity/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf/users/92d10926d17f46009589656326529d94/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:03.415456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4d94-98d0-4215-8fb1-6592caefd089 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.415807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4d94-98d0-4215-8fb1-6592caefd089 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.416039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4d94-98d0-4215-8fb1-6592caefd089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.466869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-44fc4d94-98d0-4215-8fb1-6592caefd089 None None] MFA Rules not processed for user `92d10926d17f46009589656326529d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:03.468649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-44fc4d94-98d0-4215-8fb1-6592caefd089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.495355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e35770-b285-41be-aedb-428fbc0ca403 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:03.575268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1335/2713] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:03.576777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.577063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.577339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.613119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:03.614863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] MFA Rules not processed for user `3c39d06504644aa29428fc9b130e73ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:03.617462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.618658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.619035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.619439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.745065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1336/2714] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:03.756379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.758508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.773067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1379/2715] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:04.157236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:04.160714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:04.310283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:04.332650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3eff7b-6733-459e-b660-8e02f5dd6aae service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:04.364822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:04.366058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.366800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.367269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.388059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a137e-93aa-41a0-8204-ca117fd9ec6f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:04.405617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:04.408549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc794fa-566d-46a6-92b9-abd4418545d6 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:04.410828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:04.412465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.413719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.413719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] PATH_INFO: `/v3/users/1303cf4bd9f84cb1802e4d3b6ccbafa2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.419244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1303cf4bd9f84cb1802e4d3b6ccbafa2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:04.428285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:04.431014 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:04.439640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1380/2716] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:04.583881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1303cf4bd9f84cb1802e4d3b6ccbafa2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.599273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1303cf4bd9f84cb1802e4d3b6ccbafa2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.618695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1303cf4bd9f84cb1802e4d3b6ccbafa2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.646837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1303cf4bd9f84cb1802e4d3b6ccbafa2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.648073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1303cf4bd9f84cb1802e4d3b6ccbafa2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.663462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1337/2717] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:04 2022] DELETE /identity/v3/users/1303cf4bd9f84cb1802e4d3b6ccbafa2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:04.668527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.669543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.670085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.733485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:04.739093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:04.869923 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:04.940718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1381/2718] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:04.958670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:04.961981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:05.086651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200afd-5a5a-41a1-ba0b-c85854100877 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.092093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.099803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.107956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.108473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.153745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.162631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:05.210853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1338/2719] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:05.641846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.643360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:05.672169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956d72-45e9-4122-82d1-825b6c9deddf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.689368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.693846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.697203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.697753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] PATH_INFO: `/v3/projects/398c03dd81d44131b50d466f22c4001c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.701539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398c03dd81d44131b50d466f22c4001c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.708498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:05.893410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398c03dd81d44131b50d466f22c4001c', 'request_id': 'req-33b21204-b23e-45e1-9fe5-4f58944b3cd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.908698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398c03dd81d44131b50d466f22c4001c', 'request_id': 'req-33b21204-b23e-45e1-9fe5-4f58944b3cd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.926372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398c03dd81d44131b50d466f22c4001c', 'request_id': 'req-33b21204-b23e-45e1-9fe5-4f58944b3cd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.960809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] The token cache is being invalidate because project 398c03dd81d44131b50d466f22c4001c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:05.961343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.962534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.967204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1382/2720] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:05 2022] DELETE /identity/v3/projects/398c03dd81d44131b50d466f22c4001c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:05.971162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.993123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea312f9-3491-4de0-8912-4fb5d7df23da service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.188603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.189503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.192849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.193197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] PATH_INFO: `/v3/users/1fb2cd0aa24a43798966a858b99c9712` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.196574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb2cd0aa24a43798966a858b99c9712)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.198678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.305313 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:06.351436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb2cd0aa24a43798966a858b99c9712'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:06.484032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb2cd0aa24a43798966a858b99c9712'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:06.537460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb2cd0aa24a43798966a858b99c9712'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:06.615260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb2cd0aa24a43798966a858b99c9712'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:06.637953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eeacaf66-eac3-4f66-84ce-9d80ea56f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb2cd0aa24a43798966a858b99c9712'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:06.649081 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1339/2721] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:05 2022] DELETE /identity/v3/users/1fb2cd0aa24a43798966a858b99c9712 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:07.405803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.407455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:07.439720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21204-b23e-45e1-9fe5-4f58944b3cd6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.667288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.669536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.670581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.671119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] PATH_INFO: `/v3/projects/2dd31cba32094159a710da639bebe303` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.673430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd31cba32094159a710da639bebe303)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.677809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.873175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd31cba32094159a710da639bebe303', 'request_id': 'req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:07.891104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd31cba32094159a710da639bebe303', 'request_id': 'req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:07.923716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd31cba32094159a710da639bebe303', 'request_id': 'req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:07.936390 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:07.945381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] The token cache is being invalidate because project 2dd31cba32094159a710da639bebe303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:07.947735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:07.949862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-48b8a0f2-8e3c-4854-954e-9d1438b1dcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:07.952045 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1383/2722] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:07 2022] DELETE /identity/v3/projects/2dd31cba32094159a710da639bebe303 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:07.956845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.958003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.958384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.990123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:07.991705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.223597 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1340/2723] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:08.231997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.232286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.232563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.260262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:08.261703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.274084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1384/2724] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:08.276472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.293315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828594d-b62a-4596-b081-51db36d7dc29 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.299881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.300623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.300922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.301211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.302021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:08.302343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.305619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.340069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1341/2725] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:08.342903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.363366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0e23f-e443-4f69-9ecd-d1ba14876d3c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.405883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.405883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.405883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.405883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.406824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.406824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.484955 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1385/2726] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:08.490531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.513993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4181ee3-8cd5-4457-8729-1db7fad22e9c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.755174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.756888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.756888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.761810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.762668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.764705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.845882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1342/2727] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/users => generated 297 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:08.851331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.875390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c9463-9cca-4f83-bb55-550718f41a67 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.881126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.881873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.882323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.882627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.883445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.885153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.898906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1386/2728] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:08.903078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.930979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a650f-6fa2-4508-a4a0-c023d7836009 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.943528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.944704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.945210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.946445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.947499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.953356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebc9cb-a2f1-40a9-ac2b-0a2a19b1a58b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.980707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.994961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1343/2729] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:08.996710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f312c-eb81-4c47-992c-bcd6c69c5d75 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.012124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.013088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.013371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.014039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] PATH_INFO: `/v3/projects/6b4e20f1d7a14a8280e2d1f115f3b674/users/a2915eb3357b41549733e3574f38bdd2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.043091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4e20f1d7a14a8280e2d1f115f3b674, user_id=a2915eb3357b41549733e3574f38bdd2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.046229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.079626 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1387/2730] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:08 2022] PUT /identity/v3/projects/6b4e20f1d7a14a8280e2d1f115f3b674/users/a2915eb3357b41549733e3574f38bdd2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:09.096265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.096933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.097360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.125023 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:09.174088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] MFA Rules not processed for user `a2915eb3357b41549733e3574f38bdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:09.175778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:09.329793 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1344/2731] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:09.331214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.499312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd5d0-07c2-4db6-8037-8c20466e77b9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.510696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.512141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.512630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.513121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.514244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.516516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.577313 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1388/2732] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/projects => generated 395 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:09.579673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.599283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e8190-6192-4f7d-bd55-f9703a43577a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.780812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.782102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.782391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.782664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.783385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.785531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.830617 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1345/2733] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/users => generated 304 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:09.835447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.854148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb599ff-627f-40ca-bac8-d8059b60b726 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.862303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.863992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.864499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.864996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.866163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.868554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.883387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1389/2734] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:09.887855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.906604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd18755-f6e7-4ccb-b8d0-3c0f51585817 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.920601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.921975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.922725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.923056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] PATH_INFO: `/v3/projects/b74c1a464c8f43eab97fa23a628f8085/users/7d11079acdc04eedb997f4f33d871b85/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.970943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74c1a464c8f43eab97fa23a628f8085, user_id=7d11079acdc04eedb997f4f33d871b85, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.982778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.023531 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1346/2735] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:09 2022] PUT /identity/v3/projects/b74c1a464c8f43eab97fa23a628f8085/users/7d11079acdc04eedb997f4f33d871b85/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:10.025598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.036747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de9a6-3d32-45b8-a577-cd39f5834c5e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.169041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.169833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.170002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.170282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.171050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.172764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bde8ab-12be-4312-8ba7-34781434c212 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.195708 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1390/2736] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:10.200828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.218621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84982b8-4760-44e9-8a9d-bf44a9a37943 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.226012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.228137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.228137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.228369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] PATH_INFO: `/v3/projects/b74c1a464c8f43eab97fa23a628f8085/users/7d11079acdc04eedb997f4f33d871b85/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.232115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74c1a464c8f43eab97fa23a628f8085, user_id=7d11079acdc04eedb997f4f33d871b85, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.242638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.261065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1347/2737] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:10 2022] PUT /identity/v3/projects/b74c1a464c8f43eab97fa23a628f8085/users/7d11079acdc04eedb997f4f33d871b85/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:10.272750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.273074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.273365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.281177 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:10.328663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] MFA Rules not processed for user `7d11079acdc04eedb997f4f33d871b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:10.329968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:10.495386 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1391/2738] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:10.542291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.546869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:10.674196 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:10.748775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4e8a-834b-4d3b-804e-aad934cf26c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.755347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.756081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.756371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.756653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.769906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.772315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.787766 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1348/2739] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:13.076600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:13.102771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9fd02-2228-4250-a2df-23a7b16385b9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:13.131109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:13.132779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.134083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.134560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.273771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:13.276315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c394ef6-efd7-44af-9d18-b6a345be0c07 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:13.294206 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1392/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:13.315762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:13.494091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903877-a930-4f2d-a17a-344c9bcdcc90 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:13.512149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:13.513519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.513846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.514119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] PATH_INFO: `/v3/users/a2915eb3357b41549733e3574f38bdd2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.516367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2915eb3357b41549733e3574f38bdd2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:13.518428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:13.615913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2915eb3357b41549733e3574f38bdd2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:13.627814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2915eb3357b41549733e3574f38bdd2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:13.659015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2915eb3357b41549733e3574f38bdd2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:13.710928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2915eb3357b41549733e3574f38bdd2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:13.711746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2915eb3357b41549733e3574f38bdd2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:13.721315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1349/2741] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:13 2022] DELETE /identity/v3/users/a2915eb3357b41549733e3574f38bdd2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:13.726037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.726720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.727103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.755993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:13.758158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:13.901644 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1393/2742] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:14.203964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:14.206623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:14.286730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:14.289745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:14.311032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c50a00-a5b6-411f-b3ff-cc53abd5467a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:14.321348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:14.322549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:14.323186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:14.323666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] PATH_INFO: `/v3/users/f0c7356c8a6b4618b7f8acc88eefc6b1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:14.325566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c7356c8a6b4618b7f8acc88eefc6b1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:14.328619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:14.359036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38e6ea-910e-4d53-b69b-4780f8d7c330 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:14.368108 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.370543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:14.372743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:14.374165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:14.374576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:14.397576 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:14.402343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:14.405945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:14.433824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c7356c8a6b4618b7f8acc88eefc6b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:14.435812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c7356c8a6b4618b7f8acc88eefc6b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:14.438458 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1350/2743] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:14.450764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c7356c8a6b4618b7f8acc88eefc6b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:14.471086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c7356c8a6b4618b7f8acc88eefc6b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:14.511496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6449efd-b5c6-4980-8970-4d3e3ce52354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c7356c8a6b4618b7f8acc88eefc6b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:14.522325 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1394/2744] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:14 2022] DELETE /identity/v3/users/f0c7356c8a6b4618b7f8acc88eefc6b1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:14.779705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:14.827288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2a12-c525-4bde-a863-bbdd2e1dd9f0 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:14.929045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:14.930354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:14.930854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:14.931419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] PATH_INFO: `/v3/projects/9a6fa94d0cab4efea6cd924459d20656` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:14.933499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6fa94d0cab4efea6cd924459d20656)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:14.936729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.061002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6fa94d0cab4efea6cd924459d20656', 'request_id': 'req-df16a616-b78c-47ec-8b57-5d88d925f1fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.074642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6fa94d0cab4efea6cd924459d20656', 'request_id': 'req-df16a616-b78c-47ec-8b57-5d88d925f1fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.086437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6fa94d0cab4efea6cd924459d20656', 'request_id': 'req-df16a616-b78c-47ec-8b57-5d88d925f1fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.118863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] The token cache is being invalidate because project 9a6fa94d0cab4efea6cd924459d20656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:15.119289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.120167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.126116 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1351/2745] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:14 2022] DELETE /identity/v3/projects/9a6fa94d0cab4efea6cd924459d20656 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:15.132677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b05eb-9e99-4d0a-a4b0-df5cdb73fb61 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.132968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b05eb-9e99-4d0a-a4b0-df5cdb73fb61 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.133544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b05eb-9e99-4d0a-a4b0-df5cdb73fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.151065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.153039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.176481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8c4b05eb-9e99-4d0a-a4b0-df5cdb73fb61 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:15.178113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8c4b05eb-9e99-4d0a-a4b0-df5cdb73fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.307657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16a616-b78c-47ec-8b57-5d88d925f1fe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.327005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.328877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.329539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.330037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] PATH_INFO: `/v3/projects/6b4e20f1d7a14a8280e2d1f115f3b674` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.331764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4e20f1d7a14a8280e2d1f115f3b674)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:15.334814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.345661 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1395/2746] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:15.348400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.348961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.349304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.389374 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:15.390702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:15.392078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.416104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4e20f1d7a14a8280e2d1f115f3b674', 'request_id': 'req-50cdd60f-44dd-41f2-94f7-21da89905199'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.426826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4e20f1d7a14a8280e2d1f115f3b674', 'request_id': 'req-50cdd60f-44dd-41f2-94f7-21da89905199'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.436725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4e20f1d7a14a8280e2d1f115f3b674', 'request_id': 'req-50cdd60f-44dd-41f2-94f7-21da89905199'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.461527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] The token cache is being invalidate because project 6b4e20f1d7a14a8280e2d1f115f3b674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:15.462153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.463187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.465612 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1352/2747] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:15 2022] DELETE /identity/v3/projects/6b4e20f1d7a14a8280e2d1f115f3b674 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:15.469978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.471851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.499692 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1396/2748] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:15.505237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.519550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2d2ce-a5b1-4f16-bc30-67befbbceba5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.525334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.526567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.527028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.527357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.528117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:15.528424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:15.530133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3e658-5d1b-41c9-b112-a55d2b708bd3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.556463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1397/2749] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:15.558213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.558921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.559605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.581049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:15.583383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.586136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd60f-44dd-41f2-94f7-21da89905199 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.594425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.596007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.596527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.597046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] PATH_INFO: `/v3/users/7d11079acdc04eedb997f4f33d871b85` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.599648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d11079acdc04eedb997f4f33d871b85)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:15.603667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.611399 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:15.658698 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1398/2750] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:15.660005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.693336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95357185-4ef4-494c-9c04-44bbaadc4d42 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.699726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.700760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.701271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.701900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.702825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:15.705311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.705750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d11079acdc04eedb997f4f33d871b85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.720838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d11079acdc04eedb997f4f33d871b85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.737064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d11079acdc04eedb997f4f33d871b85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.748553 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1399/2751] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:15 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:15.749506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.751226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.762565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d11079acdc04eedb997f4f33d871b85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.763736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d11079acdc04eedb997f4f33d871b85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:15.775395 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1353/2752] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:15 2022] DELETE /identity/v3/users/7d11079acdc04eedb997f4f33d871b85 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:15.776866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:15.779227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.875937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42527e-31d9-4f5b-8663-f39fa9ac8413 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.877535 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:15.935841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384ad5-12c7-459c-9b2b-c612bd8f62cc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:15.946770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.947963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.952454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.952998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.955213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:15.963378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:15.963589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:15.964046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:15.964332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:15.964632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:15.974078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:15.999050 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1354/2753] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:15 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:16.003021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.028169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859ef7-4435-4582-9c8b-e7d2a4728d70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.040523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.041415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.041941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.042304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.043820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.045861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.048934 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:16.052442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.054470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.059321 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1355/2754] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:16.063674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.075621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91a59f-4a57-48d8-bd2d-93f0c4029719 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.081014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.082063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1400/2755] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:16.082637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.083089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.086109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.086894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.089256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.107979 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1356/2756] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:16.109168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.123245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc1980-7dbb-4e08-98cd-23dfd318f62b service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.129686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.130432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.130721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.131254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] PATH_INFO: `/v3/projects/651fa7eea7a04e8d83d2264c1638f8f2/users/f71f3d66b27b471d9772a0a01d3c89ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.152229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651fa7eea7a04e8d83d2264c1638f8f2, user_id=f71f3d66b27b471d9772a0a01d3c89ed, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.154831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086580-e635-43d5-8662-ad0e51036ea1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.161966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.165353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.180826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1401/2757] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:16 2022] PUT /identity/v3/projects/651fa7eea7a04e8d83d2264c1638f8f2/users/f71f3d66b27b471d9772a0a01d3c89ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:16.186323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.186872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.187046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.212164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b05ba7-d973-4f3b-acd0-c55540347306 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.220533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:16.223040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.306843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.307780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.308154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.308934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] PATH_INFO: `/v3/projects/b74c1a464c8f43eab97fa23a628f8085` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.309117 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1402/2758] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:16.313757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74c1a464c8f43eab97fa23a628f8085)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.315367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.329959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.336162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.382543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74c1a464c8f43eab97fa23a628f8085', 'request_id': 'req-da0150a4-1510-4975-83fe-a6fd11835b7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:16.390223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74c1a464c8f43eab97fa23a628f8085', 'request_id': 'req-da0150a4-1510-4975-83fe-a6fd11835b7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:16.397232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74c1a464c8f43eab97fa23a628f8085', 'request_id': 'req-da0150a4-1510-4975-83fe-a6fd11835b7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:16.418621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] The token cache is being invalidate because project b74c1a464c8f43eab97fa23a628f8085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:16.419002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:16.419604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-da0150a4-1510-4975-83fe-a6fd11835b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:16.421382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1357/2759] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:16 2022] DELETE /identity/v3/projects/b74c1a464c8f43eab97fa23a628f8085 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:16.426570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecee90-58df-468e-805a-1f98aa90d7ff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.426749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecee90-58df-468e-805a-1f98aa90d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.427183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecee90-58df-468e-805a-1f98aa90d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.444572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc17c2-2d55-4dbd-ada4-bb413e9f78ac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.450306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9fecee90-58df-468e-805a-1f98aa90d7ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:16.451732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fecee90-58df-468e-805a-1f98aa90d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.486872 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:16.531668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.533348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.533481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.533688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.537605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.545056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1358/2760] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:16.556107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.556418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.556757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.586287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.588254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.601885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:16.603207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.613954 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1359/2761] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:16.615849 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1403/2762] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:16.618340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.629323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45cbf7-0d3d-4fd0-830e-c6778387fdfe None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.635070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.636071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.636763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.637239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.638221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:16.638744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.641184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.661714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1360/2763] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:16.666515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.678724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4d75b-6a2b-4933-8d25-3226b0f08b7d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.683605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.684258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.684842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.685064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.686667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.688730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2447d-6476-4aec-87f9-0ed927335dd5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.737937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1404/2764] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:16.742283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.757878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1877a-09f7-49c2-a40c-429ebca1e038 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.764200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.765340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.765881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.792738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:16.794993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.801485 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:16.853395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.854303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.854643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.854918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.855619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.857840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.901159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1361/2765] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:16.903612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1405/2766] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:16.908188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.915250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.916740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:16.935289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a01ed-ad3e-464a-a5c5-7297d22e7a30 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:16.942518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:16.943878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:16.944099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:16.944316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:16.945073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:16.946724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:16.962587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1362/2767] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:16.964238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:16.986368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf64b5-59cf-44ac-8a00-8dcb29f71914 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:17.001071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:17.002017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.002580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.003078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.005083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:17.007028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:17.025222 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1363/2768] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:17.026812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:17.035403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d52297-c93a-4b31-8fb4-7b9d4d3ccd7f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:17.044679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3168f6-69a9-4446-b111-834eaf641bcb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:17.047436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:17.048355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.048685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.048980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.054223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:17.055632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.056280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.056886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] PATH_INFO: `/v3/projects/66e52f6c749d4dc7beb8607f2d6ae31c/users/c9e591f86b4c4a25b520a6bf8634aa15/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.063956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:17.067587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6807cb3-807e-4db2-866f-e891e24206d5 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:17.077604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e52f6c749d4dc7beb8607f2d6ae31c, user_id=c9e591f86b4c4a25b520a6bf8634aa15, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:17.080621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1406/2769] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:12:17.080915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:17.101707 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1364/2770] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:17 2022] PUT /identity/v3/projects/66e52f6c749d4dc7beb8607f2d6ae31c/users/c9e591f86b4c4a25b520a6bf8634aa15/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:17.115201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3481-1404-488a-8fed-05aff721d77e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.116149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3481-1404-488a-8fed-05aff721d77e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.116435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3481-1404-488a-8fed-05aff721d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.164585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-079b3481-1404-488a-8fed-05aff721d77e None None] MFA Rules not processed for user `c9e591f86b4c4a25b520a6bf8634aa15`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:17.166244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-079b3481-1404-488a-8fed-05aff721d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:17.310485 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1407/2771] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:17.587278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:17.589182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:17.712014 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:17.745011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a9523-63c0-463e-a9de-5379fcf6eedd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:17.760229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:17.763225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.764025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.764435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.779716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:17.781937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:17.797286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1365/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:17.895845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac43ab-c0db-4b50-b5d0-e476b26044f6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.896984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac43ab-c0db-4b50-b5d0-e476b26044f6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.897496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac43ab-c0db-4b50-b5d0-e476b26044f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.935912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6bac43ab-c0db-4b50-b5d0-e476b26044f6 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:17.937244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6bac43ab-c0db-4b50-b5d0-e476b26044f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:17.998887 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:18.078574 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1408/2773] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:18.104732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:18.249499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801fbc5-ea14-49b5-a1c7-751fb3b131f5 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:18.257968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:18.258957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:18.259398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:18.259869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:18.271825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:18.273779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:18.287747 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1366/2774] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:23.851659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.852206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.852780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.887132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] MFA Rules not processed for user `f71f3d66b27b471d9772a0a01d3c89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:23.888452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.983808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1409/2775] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:23.984739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:23.986209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.131750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef37e61-6e90-4ea3-b6d6-e6ed7f21062a service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.146735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.147536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.147705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.147955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.148673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.153214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.200400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1367/2776] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:23 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:24.204439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.226945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24502b2-57e5-4147-9467-5226a6ee8fb5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.351954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.352813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.353098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.353369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.354128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.356101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.392249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1410/2777] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:24.393040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.416864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40fef-21db-400f-86e7-970f386d89a1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.431898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.440157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.441430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.442066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.449986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.456921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.495271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1368/2778] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:24.499023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.551212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351505c0-36da-491a-a21c-cfa54f053dd7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.562519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.563463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.564006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.564291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] PATH_INFO: `/v3/projects/1a9bde1ab6334854a2aec193c95ddc33/users/b5ec9085d4c943c78624add7f32f974c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.601323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9bde1ab6334854a2aec193c95ddc33, user_id=b5ec9085d4c943c78624add7f32f974c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.604426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.633090 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1411/2779] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:24 2022] PUT /identity/v3/projects/1a9bde1ab6334854a2aec193c95ddc33/users/b5ec9085d4c943c78624add7f32f974c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:24.636900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.651669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a2d6c-5a0e-47bb-a9f8-31c57b62a66e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.757075 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.788005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.789948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.789948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.790679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.792103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.802419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.819075 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1369/2780] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:24.820918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.839119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff52fae-4c34-4d45-ae7e-a77ee7d8ecde admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.844272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.845267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.846385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.846385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] PATH_INFO: `/v3/projects/1a9bde1ab6334854a2aec193c95ddc33/users/b5ec9085d4c943c78624add7f32f974c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.848483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9bde1ab6334854a2aec193c95ddc33, user_id=b5ec9085d4c943c78624add7f32f974c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.851461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe702c-a17a-4e44-82dd-433d68f89516 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.869719 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1412/2781] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:24 2022] PUT /identity/v3/projects/1a9bde1ab6334854a2aec193c95ddc33/users/b5ec9085d4c943c78624add7f32f974c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.669444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.694605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406927-b54c-4920-929f-0aea3a69932a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.820089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.820920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.821208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.825030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] PATH_INFO: `/v3/users/c9e591f86b4c4a25b520a6bf8634aa15` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.828111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e591f86b4c4a25b520a6bf8634aa15)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.834013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.963697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e591f86b4c4a25b520a6bf8634aa15'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.979371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e591f86b4c4a25b520a6bf8634aa15'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.992862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e591f86b4c4a25b520a6bf8634aa15'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.011111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e591f86b4c4a25b520a6bf8634aa15'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.012205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e591f86b4c4a25b520a6bf8634aa15'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.022418 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1370/2782] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:25 2022] DELETE /identity/v3/users/c9e591f86b4c4a25b520a6bf8634aa15 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:26.027392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874657f1-b70d-429f-9808-e530c388a88c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.028627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874657f1-b70d-429f-9808-e530c388a88c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.028908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874657f1-b70d-429f-9808-e530c388a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.068307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-874657f1-b70d-429f-9808-e530c388a88c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:26.070979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-874657f1-b70d-429f-9808-e530c388a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.102820 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:26.308331 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1413/2783] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:26.317885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.319406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.458136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37aea9-12dc-4320-a7f1-660b63478455 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.469952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.470705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.470912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.471190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.497334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.498913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99160b-ad73-424d-aca6-f50ce176bd1f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.536812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1371/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:26.995232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874657f1-b70d-429f-9808-e530c388a88c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.996768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-874657f1-b70d-429f-9808-e530c388a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:27.023403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874657f1-b70d-429f-9808-e530c388a88c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.029222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.030463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.030747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.031024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] PATH_INFO: `/v3/projects/66e52f6c749d4dc7beb8607f2d6ae31c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.032839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e52f6c749d4dc7beb8607f2d6ae31c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.048408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.185106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e52f6c749d4dc7beb8607f2d6ae31c', 'request_id': 'req-ffe9f005-8de0-4c30-b928-1bbc188ae480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:27.199088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e52f6c749d4dc7beb8607f2d6ae31c', 'request_id': 'req-ffe9f005-8de0-4c30-b928-1bbc188ae480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:27.215914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e52f6c749d4dc7beb8607f2d6ae31c', 'request_id': 'req-ffe9f005-8de0-4c30-b928-1bbc188ae480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:27.235411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] The token cache is being invalidate because project 66e52f6c749d4dc7beb8607f2d6ae31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:27.235707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:27.238961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ffe9f005-8de0-4c30-b928-1bbc188ae480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:27.245938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1414/2785] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:26 2022] DELETE /identity/v3/projects/66e52f6c749d4dc7beb8607f2d6ae31c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:27.250561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.251121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.251121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.260446 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:27.294897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:27.296168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:27.454527 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1372/2786] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:27.463326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.463691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.464045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.493208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:27.495180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:27.532329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1415/2787] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:27.538356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.572423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d62bc-c696-4cab-bc55-ea73250fb438 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.587101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.587852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.588245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.588891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.590555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:27.591723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.595726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.634132 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1373/2788] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:27.634920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.651881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dbd64-22aa-43c6-bf30-b0c8237a7992 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.666142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.667295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.667875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.668301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.671970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.684646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.736658 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1416/2789] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:27.741632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.755333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90fab7-514a-4718-a7ea-66acf7bf18cc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.919188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.920049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.920450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.920796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.922550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.924041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.972842 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1374/2790] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:27.974172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:28.005568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa3979-f999-4148-a0f4-bbbcb5691ff8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:28.028170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:28.029027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.029313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.037047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.038236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:28.042015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:28.089011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:28.092598 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1417/2791] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:28.108783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4cf7-4aab-4557-82a4-aaf717231c4b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:28.126425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:28.127127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.127415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.130252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.131362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:28.133047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8a6cb-aafd-4972-ac87-45f3b64ee97e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:28.171757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:28.174572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1375/2792] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:28.185812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87346-e70e-41d1-bf45-4e5954b834c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:28.213948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:28.215151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.215593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.216073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] PATH_INFO: `/v3/projects/d4b56de6c48e44de9e938460ffc1805c/users/d56b7263985743839941e421b52bcc04/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.267837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b56de6c48e44de9e938460ffc1805c, user_id=d56b7263985743839941e421b52bcc04, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:28.272325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:28.309724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1418/2793] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:28 2022] PUT /identity/v3/projects/d4b56de6c48e44de9e938460ffc1805c/users/d56b7263985743839941e421b52bcc04/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:28.317913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55c17-6d50-4572-afba-38c32ee3d790 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.317913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55c17-6d50-4572-afba-38c32ee3d790 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.318432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55c17-6d50-4572-afba-38c32ee3d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.422102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-37a55c17-6d50-4572-afba-38c32ee3d790 None None] MFA Rules not processed for user `d56b7263985743839941e421b52bcc04`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:28.426360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-37a55c17-6d50-4572-afba-38c32ee3d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:28.613571 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:28.620717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1376/2794] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:29.653532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:29.658832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:29.755758 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:29.798977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227376-6b3f-4586-b7fa-1df130ddbd39 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:29.815716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:29.818790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:29.819795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:29.820279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:29.830038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:29.832373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:29.844468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1419/2795] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:30.095528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe7e5-d2a1-4d6c-a0aa-918e1a5311a3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.096046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe7e5-d2a1-4d6c-a0aa-918e1a5311a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.096180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe7e5-d2a1-4d6c-a0aa-918e1a5311a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.119183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6a1fe7e5-d2a1-4d6c-a0aa-918e1a5311a3 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:30.123406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6a1fe7e5-d2a1-4d6c-a0aa-918e1a5311a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.223416 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1377/2796] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:30.238486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:30.241125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.430482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71dc8e-7857-476c-9004-a46bb232c5e6 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:30.445502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:30.446325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.446731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.447070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.475715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:30.477404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b6608-bce7-4247-adea-2018d8bc33b1 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:30.501996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1420/2797] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:30.714754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.715258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.715774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.756020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] MFA Rules not processed for user `d56b7263985743839941e421b52bcc04`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:30.759000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.782523 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1378/2798] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:31.861064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.861537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.864522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.934580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:31.937866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:31.976612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1421/2799] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:31.991465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.015155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b506-6825-4279-859e-9ed7dbefefe2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.030909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.031860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.032345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.032774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.056390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.062363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ee451-8865-4b37-83fd-8f3b33b1c06f service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.105794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1379/2800] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:32.263654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.408460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ec23-8bf3-499a-99b7-a3bb0b193edd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.415615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.416643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.416990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.417405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] PATH_INFO: `/v3/users/d56b7263985743839941e421b52bcc04` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.418864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56b7263985743839941e421b52bcc04)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.421282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.547255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56b7263985743839941e421b52bcc04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.548285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56b7263985743839941e421b52bcc04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.554492 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.563290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56b7263985743839941e421b52bcc04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.614124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56b7263985743839941e421b52bcc04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.637375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ef08219-56d5-44f4-9c5d-c3c21aa73f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56b7263985743839941e421b52bcc04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.659511 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1422/2801] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:32 2022] DELETE /identity/v3/users/d56b7263985743839941e421b52bcc04 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:32.663923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.664240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.664523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.686779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:32.689031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.734533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.734806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.735039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.766010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:32.767279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.873881 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1380/2802] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:32.886136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.887495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.918363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1423/2803] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:32.935573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.937138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.054968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656640b-90b2-4f97-a15a-bc05ecf4293b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.069410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.070615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.071128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.072464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.094912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.101878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f194f70-7432-4b03-a427-e6aaa88c39b5 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.123577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1381/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:33.151140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ab21-ee14-4dca-b2c6-87743a1cfaf1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.165588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.166648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.167114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.169892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.192610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.194620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.220868 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1424/2805] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:34.012050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f132d-020d-4ddb-8850-cbdb954938d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.012338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f132d-020d-4ddb-8850-cbdb954938d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.012621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f132d-020d-4ddb-8850-cbdb954938d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.060129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-463f132d-020d-4ddb-8850-cbdb954938d5 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:34.064187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-463f132d-020d-4ddb-8850-cbdb954938d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.085310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1382/2806] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:34.102579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.123131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce238b4-5810-48ec-aba4-c30908b0cc99 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.144408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.145302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.145587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.145897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.168684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.170711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.184261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1425/2807] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:34.526019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d8c9-7012-46cf-8ca6-bbdbc969c933 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.526312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d8c9-7012-46cf-8ca6-bbdbc969c933 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.526600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38d8c9-7012-46cf-8ca6-bbdbc969c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.563070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ff38d8c9-7012-46cf-8ca6-bbdbc969c933 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:34.567516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff38d8c9-7012-46cf-8ca6-bbdbc969c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.632882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1383/2808] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:34.633828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.672663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dfe4-d03a-4b7b-b928-8ae97892b18e service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.683687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.683988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.684509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.684995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.685109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.685304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.685599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.713084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.716805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.748254 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1426/2809] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:34.762366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] MFA Rules not processed for user `b5ec9085d4c943c78624add7f32f974c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:34.764522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.775269 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:34.917039 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1384/2810] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:34.937771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.941047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.976193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f05af-a8c1-4f59-ab40-8a76770d1be8 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.976402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.978226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.982365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.983845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.984365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.985081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] PATH_INFO: `/v3/users/b96d7edf06d147bb94869c925933a78e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.987016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96d7edf06d147bb94869c925933a78e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.989503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.063723 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:35.104294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96d7edf06d147bb94869c925933a78e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.107122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96d7edf06d147bb94869c925933a78e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.131841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96d7edf06d147bb94869c925933a78e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.148107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96d7edf06d147bb94869c925933a78e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.168417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-91ec5c72-2314-4148-aa97-90293b1e4c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96d7edf06d147bb94869c925933a78e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.177417 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1427/2811] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:34 2022] DELETE /identity/v3/users/b96d7edf06d147bb94869c925933a78e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:35.182223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.182866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.183474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.203700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8794135-9cfe-48f5-8f50-de4977c63ff2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.215505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.218898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.309315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.310655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.310655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.310872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.312691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.505897 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:35.529865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.530196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.542661 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1385/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:35.543557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.551381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.657406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b0d9-44d9-4862-9efc-2f156d9ab61d service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.665447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.667538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.668104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.668608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] PATH_INFO: `/v3/projects/d4b56de6c48e44de9e938460ffc1805c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.670234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b56de6c48e44de9e938460ffc1805c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.673047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.810537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b56de6c48e44de9e938460ffc1805c', 'request_id': 'req-6644d2ff-c101-4bfb-9b3a-28b88864c37b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.823720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b56de6c48e44de9e938460ffc1805c', 'request_id': 'req-6644d2ff-c101-4bfb-9b3a-28b88864c37b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.828892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1428/2813] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 645 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:35.835172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b56de6c48e44de9e938460ffc1805c', 'request_id': 'req-6644d2ff-c101-4bfb-9b3a-28b88864c37b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.864483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] The token cache is being invalidate because project d4b56de6c48e44de9e938460ffc1805c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:35.869153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.871342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.872942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.885266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6644d2ff-c101-4bfb-9b3a-28b88864c37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.887439 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1386/2814] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:35 2022] DELETE /identity/v3/projects/d4b56de6c48e44de9e938460ffc1805c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:35.894083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4ed-6355-4952-b618-ce7efec22c3a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.895917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4ed-6355-4952-b618-ce7efec22c3a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.896362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4ed-6355-4952-b618-ce7efec22c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.956832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0c1ab4ed-6355-4952-b618-ce7efec22c3a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.958141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c1ab4ed-6355-4952-b618-ce7efec22c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.046263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105898e3-7f81-420a-87f5-e3c7c8ed1d85 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.136355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1387/2815] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:36.144468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.145066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.145545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.172593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.173303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.173593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.173903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.176356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.186719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:36.192501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.193741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.194137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.212935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1429/2816] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:36.219566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1388/2817] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:36.221953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.238102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60bc37-e5e9-4fe5-bbf5-f2f59a915b6a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.254872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.256684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.258823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.259228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.261124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:36.264059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.273936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.279732 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.310243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1430/2818] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:36.316815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.332746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437dad0-ecb3-40eb-84c9-5ae2b80f28fd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.350075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.351101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.351488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.351865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.352938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.356639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.397157 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.435578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1389/2819] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/projects => generated 413 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.435821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.455379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024be46-8495-46bf-b256-f0e18fe180b1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.569368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.570214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.570595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.571195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.571966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.574008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.603194 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1431/2820] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/users => generated 307 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.607634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.622782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fb903-0cc7-41c1-9c10-5db65ced9316 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.639928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.641019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.641303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.641575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.646828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.648929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.677410 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1390/2821] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.678040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.690713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784fc2-21d6-4bdc-b930-8b37219ca2b8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.697020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.697388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.697801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.698207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.699246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.701358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.736078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.756087 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1432/2822] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:36.761081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8f655-7946-4ea5-bae8-24d9b82d180f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.768748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.769897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.770248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.781922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] PATH_INFO: `/v3/projects/ec53a779c92c4620a832da29e583581b/users/c1c7e27c899648168625087b1653df68/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.801444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec53a779c92c4620a832da29e583581b, user_id=c1c7e27c899648168625087b1653df68, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.804879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.805325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7dd0c-48c0-4e72-a431-7fb018bd8ae4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.807349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.841525 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1391/2823] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:36 2022] PUT /identity/v3/projects/ec53a779c92c4620a832da29e583581b/users/c1c7e27c899648168625087b1653df68/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:36.847991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.849968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a609e4-ce2b-4428-8b71-b7fb3cbe3a1e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.852415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.854063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.878758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:36.880514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.013448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.014020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.014299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.014606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] PATH_INFO: `/v3/projects/221902b3cf044d719cc7dc1fcf7ba33b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.021268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221902b3cf044d719cc7dc1fcf7ba33b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.023610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.056548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1392/2824] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:37.076496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.077953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.164576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221902b3cf044d719cc7dc1fcf7ba33b', 'request_id': 'req-d22017df-041a-40cc-978a-991f222f5a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:37.171953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221902b3cf044d719cc7dc1fcf7ba33b', 'request_id': 'req-d22017df-041a-40cc-978a-991f222f5a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:37.188015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221902b3cf044d719cc7dc1fcf7ba33b', 'request_id': 'req-d22017df-041a-40cc-978a-991f222f5a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:37.243078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9145726-164e-46eb-b2d2-d2d77393e78d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.246799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] The token cache is being invalidate because project 221902b3cf044d719cc7dc1fcf7ba33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:37.246799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:37.255592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d22017df-041a-40cc-978a-991f222f5a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:37.260857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1433/2825] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:36 2022] DELETE /identity/v3/projects/221902b3cf044d719cc7dc1fcf7ba33b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:37.262494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d01cc-04ec-4d9c-a0ac-5792b2cfe050 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.263016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d01cc-04ec-4d9c-a0ac-5792b2cfe050 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.263222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d01cc-04ec-4d9c-a0ac-5792b2cfe050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.270664 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:37.300922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7e0d01cc-04ec-4d9c-a0ac-5792b2cfe050 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:37.309343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7e0d01cc-04ec-4d9c-a0ac-5792b2cfe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.367381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.367652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.367896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.368242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.370436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.434953 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:37.483820 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1434/2826] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:37.485324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.485616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.485924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.500439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.503862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.519030 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1393/2827] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:37.535714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:37.537790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.549660 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1435/2828] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:37.553989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.570966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e0a68-18e4-4537-90e7-5c6e063c7878 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.591939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.592293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.592839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.592839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.593639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:37.594001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.597434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.636660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.651224 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1394/2829] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:37.656548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edff1-cca1-426e-bf52-7e00c79ddd75 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.666438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.667246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.667693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.667909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.668737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.673142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.727720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.727930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1436/2830] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:37 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:37.750334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21eba-91ba-4fe1-ba97-03f076286525 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.914183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.916637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.916637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.916637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.916637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.919414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.985161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1395/2831] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:37 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:37.987569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:38.004911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9532801-d1fc-4a4d-b807-253d5397608a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:38.021790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:38.024509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:38.024792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:38.025076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:38.027570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:38.029264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:38.063128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:38.069539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1437/2832] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:38.081110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba62122-fa5d-45a2-a9b8-d6df99057427 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:38.096222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:38.097813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:38.100053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:38.103286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:38.104340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:38.110690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c505cb-531d-43f8-aebe-2ac696b804ca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:38.138266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1396/2833] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:38.141350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:38.153816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59e1a0-de3f-4ded-a971-5eaed7e67087 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:38.168473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:38.171628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:38.171628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:38.171905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] PATH_INFO: `/v3/projects/640f5ca38a5943b9908c99ed6c1a0b0d/users/03c3c10bebae4beb86b42a6df4c9b700/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:38.224172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] RBAC: Authorizing `identity:create_grant(project_id=640f5ca38a5943b9908c99ed6c1a0b0d, user_id=03c3c10bebae4beb86b42a6df4c9b700, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:38.227175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:38.263091 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1438/2834] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:38 2022] PUT /identity/v3/projects/640f5ca38a5943b9908c99ed6c1a0b0d/users/03c3c10bebae4beb86b42a6df4c9b700/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:38.274096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:38.274688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:38.274781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:38.370799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] MFA Rules not processed for user `03c3c10bebae4beb86b42a6df4c9b700`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:38.372303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:38.520610 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1397/2835] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:38.532323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:38.534883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:38.734486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b56e-a9b9-4257-93c2-901609bd109d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:38.754378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:38.755068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:38.755351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:38.755625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:38.774884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:38.776786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4561-5cbd-4e70-a21f-880964229937 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:38.803420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1439/2836] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:38.943825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:38.988804 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:39.104077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a03709-fbb7-4134-ab00-b934d89fd454 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:39.136499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:39.137573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:39.137928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:39.138258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] PATH_INFO: `/v3/users/03c3c10bebae4beb86b42a6df4c9b700` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:39.139743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c3c10bebae4beb86b42a6df4c9b700)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:39.142105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:39.335463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c3c10bebae4beb86b42a6df4c9b700'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.350969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c3c10bebae4beb86b42a6df4c9b700'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.406812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c3c10bebae4beb86b42a6df4c9b700'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.490922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c3c10bebae4beb86b42a6df4c9b700'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.491714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c3c10bebae4beb86b42a6df4c9b700'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.509232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1398/2837] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:38 2022] DELETE /identity/v3/users/03c3c10bebae4beb86b42a6df4c9b700 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:39.510867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:39.512007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:39.512517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:39.576726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:39.585797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:39.652601 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:39.765730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1440/2838] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:39.775079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:39.777413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:39.941953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743926e9-20ed-4500-89a0-5bee8b4c2d69 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:39.952773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:39.953886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:39.953886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:39.954110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:39.986129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:39.988790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec135fd-2c91-4099-ab1b-dd06b3051700 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:40.071879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1399/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:41.112252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.126908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.159900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74b66-c3d9-4cdb-9bf6-d80792264561 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.184883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.186346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.189552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.190601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] PATH_INFO: `/v3/projects/640f5ca38a5943b9908c99ed6c1a0b0d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.194541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] RBAC: Authorizing `identity:delete_project(project_id=640f5ca38a5943b9908c99ed6c1a0b0d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.200433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.334547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640f5ca38a5943b9908c99ed6c1a0b0d', 'request_id': 'req-aea8681a-c7c7-414f-920f-30836874471b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.348002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640f5ca38a5943b9908c99ed6c1a0b0d', 'request_id': 'req-aea8681a-c7c7-414f-920f-30836874471b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.364705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640f5ca38a5943b9908c99ed6c1a0b0d', 'request_id': 'req-aea8681a-c7c7-414f-920f-30836874471b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.397248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] The token cache is being invalidate because project 640f5ca38a5943b9908c99ed6c1a0b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:41.414128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.415684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aea8681a-c7c7-414f-920f-30836874471b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.418781 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1441/2840] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:41 2022] DELETE /identity/v3/projects/640f5ca38a5943b9908c99ed6c1a0b0d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:41.423630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.424189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.425081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.509942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:41.511409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.617580 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:41.685308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.685858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.686309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.694161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1400/2841] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:41.723017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:41.724677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.756118 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1442/2842] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:41.761211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.773976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50c1cf-f460-4d91-9180-050205cd68d7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.787017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.788834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.790646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.791224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.793004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:41.794385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.796311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.836159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.839956 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1401/2843] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:41.867055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c78ce-86b0-4fb8-a380-72d4739766e3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.883792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.884480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.884759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.885034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.885794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.888404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.934592 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1443/2844] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:41.936047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.954739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2a43-aeb2-4241-a470-0e81fd1af955 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.156105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.157144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.157144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.157390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.161166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.168600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.225702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1402/2845] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:42.227824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.245282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c078c5-c4bc-453d-b7fa-421ba5902d13 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.270111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.270831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.271920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.272206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.273253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.274969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.300827 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1444/2846] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:42.304799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.318280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaaf7-5070-4a0e-afcd-3b105056faa4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.324740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.325875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.326522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.327042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.328083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.330973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11afe68-9216-4931-bc3e-f26c875b93f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.349963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.357089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1403/2847] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:42.361852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d43868-504d-4d19-b5ba-3e83b60b4920 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.368168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.369485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.370135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.370631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] PATH_INFO: `/v3/projects/8336a5a8ae294f77aba940d67364b0b8/users/f3de9a749c874cfc8c34deffb1001a79/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.407362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8336a5a8ae294f77aba940d67364b0b8, user_id=f3de9a749c874cfc8c34deffb1001a79, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.413900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.449917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1445/2848] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:42 2022] PUT /identity/v3/projects/8336a5a8ae294f77aba940d67364b0b8/users/f3de9a749c874cfc8c34deffb1001a79/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:42.450121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6d34-c055-43b4-a0f5-ab7f0dc9f9f5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.450594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6d34-c055-43b4-a0f5-ab7f0dc9f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.451775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da6d34-c055-43b4-a0f5-ab7f0dc9f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.482938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f6da6d34-c055-43b4-a0f5-ab7f0dc9f9f5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:42.485309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f6da6d34-c055-43b4-a0f5-ab7f0dc9f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:42.699266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1404/2849] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:42.781411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.783681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:42.962433 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:43.022956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faecc8-20f8-4fcc-90ea-daa1946c63bf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:43.040206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:43.041645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:43.041645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:43.042262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:43.084143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:43.092817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981574-8dda-4529-aaf5-d763bcd5296a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:43.127266 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1446/2850] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:46.235868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.236321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.236425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.238163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1405/2851] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:12:46.264039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.265079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.265439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.300504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:46.303497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.510784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1447/2852] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:46.540707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.542946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.603000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6b9e-ff7f-49cb-b4c8-07eefbde2ca4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.618460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.619296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.619574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.619845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.646290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.648373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.670769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1406/2853] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:47.878980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:47.880661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.081483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3680c-1ebe-4f6a-8b29-7ef0cc355ad4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:48.090076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:48.090768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.091063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.091333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.093312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.266812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:48.268563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:48.297554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1448/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:50.355104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.356798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.391997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf1e1-cc00-4574-be11-ab1dd5410817 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.398038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.399271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.399711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.400352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] PATH_INFO: `/v3/users/23333c1ebbdf4ddab9d21d5b8b7139e6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.402065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23333c1ebbdf4ddab9d21d5b8b7139e6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.404174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.461706 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:50.497624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23333c1ebbdf4ddab9d21d5b8b7139e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.513378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23333c1ebbdf4ddab9d21d5b8b7139e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.536601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23333c1ebbdf4ddab9d21d5b8b7139e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.562493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23333c1ebbdf4ddab9d21d5b8b7139e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.564044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-47ed42a6-c682-47f2-bcad-e7812b47482f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23333c1ebbdf4ddab9d21d5b8b7139e6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.584040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1407/2855] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:50 2022] DELETE /identity/v3/users/23333c1ebbdf4ddab9d21d5b8b7139e6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:51.047809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.064292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5f40-e854-4471-8783-6cc0fee1b8c0 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.092582 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:51.196487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.197774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.198216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.198811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] PATH_INFO: `/v3/projects/aa4e8e174a104e60a0c40a83bd2235fa` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.200563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4e8e174a104e60a0c40a83bd2235fa)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.205055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.360568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4e8e174a104e60a0c40a83bd2235fa', 'request_id': 'req-b7d345e4-a747-499c-a1cd-d301832fe91b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.380259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4e8e174a104e60a0c40a83bd2235fa', 'request_id': 'req-b7d345e4-a747-499c-a1cd-d301832fe91b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.404186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4e8e174a104e60a0c40a83bd2235fa', 'request_id': 'req-b7d345e4-a747-499c-a1cd-d301832fe91b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.446860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] The token cache is being invalidate because project aa4e8e174a104e60a0c40a83bd2235fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:51.447115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.451111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b7d345e4-a747-499c-a1cd-d301832fe91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.464766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.465234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.465415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.466892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1449/2856] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:51 2022] DELETE /identity/v3/projects/aa4e8e174a104e60a0c40a83bd2235fa => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:51.510706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:51.513738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:51.687164 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1408/2857] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:51.691160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.692213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.692633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.735019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:51.736276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:51.750829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1450/2858] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:51.752612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.766668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c29a65-3119-44b4-8c2f-5a1885f7dc73 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.775682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.776637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.777096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.777540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.778469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:51.778932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.780757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.818073 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1409/2859] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:51.818921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.832886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9f4a-fa4e-484a-8573-f99170ccdc2b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.851885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.852582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.853953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.854257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.854970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.856872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.912168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1451/2860] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:51.916726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.930367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c740-2799-4fff-ac82-a076322014e2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.008456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.010313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.013349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.014063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.015012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.017175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.078742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1410/2861] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:52.086004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.132607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c739d-c86b-4d12-9b85-a74560cfe5e7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.138434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.139421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.139862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.140300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.142820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.144685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.160250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1452/2862] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:52.163993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.179323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb864f-e1cf-4045-a244-eb17ac055f2d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.186739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.188734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.189366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.189928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.190934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.194579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93678311-9136-4375-b092-0d10806b6edc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.214912 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1411/2863] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:52.218662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.235325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81836d92-f49c-4b3d-b355-ec41edbba888 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.242628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.244277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.244559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.245296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] PATH_INFO: `/v3/projects/a32b4be640ce47c28766b103533975c2/users/208a9588c20943b192f340ccbe53b00b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.268583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b4be640ce47c28766b103533975c2, user_id=208a9588c20943b192f340ccbe53b00b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.273649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.296436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1453/2864] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:52 2022] PUT /identity/v3/projects/a32b4be640ce47c28766b103533975c2/users/208a9588c20943b192f340ccbe53b00b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:52.307205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221503-d9b0-46a3-aea7-6663a7455b0b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.307528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221503-d9b0-46a3-aea7-6663a7455b0b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.308585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221503-d9b0-46a3-aea7-6663a7455b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.365974 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:52.375392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8e221503-d9b0-46a3-aea7-6663a7455b0b None None] MFA Rules not processed for user `208a9588c20943b192f340ccbe53b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:52.378496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e221503-d9b0-46a3-aea7-6663a7455b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:52.523516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1412/2865] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:52.536094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.540934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:52.662179 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:52.692345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678d91-e606-4f43-b551-3e598ff23f66 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.700363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.701136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.701475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.701855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.720359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.723791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.755900 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1454/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:52.941548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4cb1-3a83-47ee-bcc2-0c3ed525f6f3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.941972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4cb1-3a83-47ee-bcc2-0c3ed525f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.942255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4cb1-3a83-47ee-bcc2-0c3ed525f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.989916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ceba4cb1-3a83-47ee-bcc2-0c3ed525f6f3 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:52.995986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ceba4cb1-3a83-47ee-bcc2-0c3ed525f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:53.194280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1413/2867] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:53.207296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:53.208852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:53.327323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c11f-5119-4a59-ab8e-3d13e6260edb service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:53.347755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:53.348595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:53.348882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:53.349325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:53.364388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:53.366541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f47390-4038-41fd-8b34-c74506d29fa7 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:53.377060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1455/2868] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:54.405062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:54.405655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:54.405655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:54.478183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] MFA Rules not processed for user `c1c7e27c899648168625087b1653df68`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:54.479715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:54.615084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1414/2869] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:54.624014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:54.624519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:54.624792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:54.656125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] MFA Rules not processed for user `c1c7e27c899648168625087b1653df68`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:54.657364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:54.681322 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1456/2870] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:54.690985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:54.692638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:54.797294 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:54.912649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db2dd-1d37-470b-92ee-a173e3a0d040 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:54.944994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:54.945366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:54.945631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:54.945945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:54.970016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:54.972402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:55.024970 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1415/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:58.690843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:58.692892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:58.960907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3d27b-e4ee-4062-b9e1-d6ef76bf5b24 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:58.970376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:58.971376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:58.971666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:58.971942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] PATH_INFO: `/v3/users/b3861659794d4aa699ca3e984999a1fe` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:58.979678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3861659794d4aa699ca3e984999a1fe)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:58.981651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.144537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3861659794d4aa699ca3e984999a1fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.147885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3861659794d4aa699ca3e984999a1fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.207158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3861659794d4aa699ca3e984999a1fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.246547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3861659794d4aa699ca3e984999a1fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.282102 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:59.333340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3861659794d4aa699ca3e984999a1fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.378453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1457/2872] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:58 2022] DELETE /identity/v3/users/b3861659794d4aa699ca3e984999a1fe => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:00.067690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.088303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153656-b36f-4d1e-b887-0a62b7f7a842 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.376534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.378155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.381588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.382035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] PATH_INFO: `/v3/projects/913058bc11904339a05f4784fee6f1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.392254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913058bc11904339a05f4784fee6f1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.394988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.587950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913058bc11904339a05f4784fee6f1a1', 'request_id': 'req-e7e3d655-b3b9-4fe0-a550-8b91682662c8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:00.609172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913058bc11904339a05f4784fee6f1a1', 'request_id': 'req-e7e3d655-b3b9-4fe0-a550-8b91682662c8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:00.626424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913058bc11904339a05f4784fee6f1a1', 'request_id': 'req-e7e3d655-b3b9-4fe0-a550-8b91682662c8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:00.653362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] The token cache is being invalidate because project 913058bc11904339a05f4784fee6f1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:00.653980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:00.655033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:00.657037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1416/2873] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:00 2022] DELETE /identity/v3/projects/913058bc11904339a05f4784fee6f1a1 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:00.661565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.663029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:00.683009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522f34-7052-4b58-bf04-5951893d912a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.876760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.878203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.879442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.879747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] PATH_INFO: `/v3/users/d5e1b4111c6348f1ae6fdbe313f04da4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.891183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e1b4111c6348f1ae6fdbe313f04da4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.914418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:01.089981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e1b4111c6348f1ae6fdbe313f04da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:01.092139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e1b4111c6348f1ae6fdbe313f04da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:01.137604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e1b4111c6348f1ae6fdbe313f04da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:01.213464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e1b4111c6348f1ae6fdbe313f04da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:01.272262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-107c95aa-4c6c-4589-b817-3b4a60fc6148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e1b4111c6348f1ae6fdbe313f04da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:01.309228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1458/2874] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:00 2022] DELETE /identity/v3/users/d5e1b4111c6348f1ae6fdbe313f04da4 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:01.781117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:01.784671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:01.826643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3d655-b3b9-4fe0-a550-8b91682662c8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:01.961486 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:01.981620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:01.983010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:01.983990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:01.984760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] PATH_INFO: `/v3/projects/ef2087ba847e42c190b9cbad06b0a939` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:01.986872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2087ba847e42c190b9cbad06b0a939)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:01.989032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:02.156035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2087ba847e42c190b9cbad06b0a939', 'request_id': 'req-ac1e2693-da30-4128-ae76-f8036b8cada3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:02.177613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2087ba847e42c190b9cbad06b0a939', 'request_id': 'req-ac1e2693-da30-4128-ae76-f8036b8cada3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:02.196956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2087ba847e42c190b9cbad06b0a939', 'request_id': 'req-ac1e2693-da30-4128-ae76-f8036b8cada3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:02.226909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] The token cache is being invalidate because project ef2087ba847e42c190b9cbad06b0a939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:02.227133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:02.243121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac1e2693-da30-4128-ae76-f8036b8cada3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:02.247389 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1417/2875] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:01 2022] DELETE /identity/v3/projects/ef2087ba847e42c190b9cbad06b0a939 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:02.252965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:02.253531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:02.253531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:02.326382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:02.327666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:02.477131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1459/2876] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:02.486700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:02.487297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:02.487740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:02.562029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:02.563291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:02.610048 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1418/2877] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:02.611706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:02.629705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301c551-209e-4e1c-9797-8048c3224eb6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:02.642994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:02.643694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:02.644029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:02.644496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:02.647876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:02.648676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:02.651223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:02.658603 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:02.695169 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1460/2878] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:02.696063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:02.712560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbeab-1728-43c3-ac69-3cb88748fd87 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:02.720387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:02.721642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:02.722539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:02.723614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:02.725245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:02.730624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:02.819781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1419/2879] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:02 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:02.823924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:02.855881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6393-cf82-426d-9590-fecfe1b6f75d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:02.991257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:02.992514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:02.995383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:02.995869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:02.997057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:02.999431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.032555 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1461/2880] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:02 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:03.037392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:03.071496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9cb36-c9a4-41f0-a007-3847f4c8f6dd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:03.082978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:03.084048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.084444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.084830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.091616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:03.093554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.165293 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1420/2881] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:03.169317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:03.185960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063095f-2766-4a55-b347-074a22ae0c1e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:03.200803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:03.201522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.201856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.202139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.203172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:03.205692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ecd2e-3d10-4d95-a0c7-b1c7f0ef32eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.238385 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1462/2882] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:03.238927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:03.258933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cd133-203e-4c6e-8754-5544784a6ad3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:03.276202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:03.278656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.279268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.279617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] PATH_INFO: `/v3/projects/fa61fdd30c1148c78ec1262eac09d6fd/users/48d3d461293a497fbfde7044e5fa4c7b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.319664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa61fdd30c1148c78ec1262eac09d6fd, user_id=48d3d461293a497fbfde7044e5fa4c7b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:03.323486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.367245 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1421/2883] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:03 2022] PUT /identity/v3/projects/fa61fdd30c1148c78ec1262eac09d6fd/users/48d3d461293a497fbfde7044e5fa4c7b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:03.371435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.372571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.373075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.422347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] MFA Rules not processed for user `48d3d461293a497fbfde7044e5fa4c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:03.424425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:03.520084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1463/2884] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:03.521598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:03.683566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57640a8-13fa-4839-a899-4e0375dcfe9a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:03.696176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:03.696870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.697322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.697608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.698349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:03.700295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.791284 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1422/2885] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:03 2022] POST /identity/v3/projects => generated 401 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:03.795935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:03.814185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9da8-07c2-44fb-ba48-b72fc155348b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:03.943340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:03.944431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:03.945002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:03.945519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:03.946478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:03.951187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:03.972137 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:03.996531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1464/2886] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:03 2022] POST /identity/v3/users => generated 307 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:03.997731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:04.005851 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:04.021714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd87a0-8b05-4f1e-adce-1ae30c0243e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:04.032518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:04.033485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.033984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.034443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.042537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:04.044504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5763474-0d54-4a63-ab3b-63b6949a05e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:04.086573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:04.087959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1423/2887] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:04.119007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cdc5c-f406-4e72-a70c-d72e225b7570 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:04.127081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:04.128442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.129181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.130076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] PATH_INFO: `/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778/users/747b30f6748741708d6e36b5f6ddf0c4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.166438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de215-0e37-428e-871b-babcbec0b44c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.167235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de215-0e37-428e-871b-babcbec0b44c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.167235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de215-0e37-428e-871b-babcbec0b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.194323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f01dd536afd4fdb8b4ad1e49789c778, user_id=747b30f6748741708d6e36b5f6ddf0c4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:04.212898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:04.243295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a68de215-0e37-428e-871b-babcbec0b44c None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:04.245018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a68de215-0e37-428e-871b-babcbec0b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:04.256216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1465/2888] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:04 2022] PUT /identity/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778/users/747b30f6748741708d6e36b5f6ddf0c4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:04.260152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:04.421615 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1424/2889] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:04.424019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.431535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.432123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.458815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374d53-fc0f-4b96-910b-60016d0cbc14 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:04.463863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:04.467017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:04.478321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:04.483294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.487531 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1425/2890] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:04.487973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.488522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.491248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:04.496992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6ee0-3d15-4f81-94ca-c2a8d48b2254 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:04.528866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1466/2891] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:04.532790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:04.557552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b43f3a-5850-40ad-a2e3-8505fc11cc1c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:04.586339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:04.587275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.587557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.590366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] PATH_INFO: `/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778/users/747b30f6748741708d6e36b5f6ddf0c4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.597964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f01dd536afd4fdb8b4ad1e49789c778, user_id=747b30f6748741708d6e36b5f6ddf0c4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:04.605691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:04.634269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1426/2892] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:04 2022] PUT /identity/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778/users/747b30f6748741708d6e36b5f6ddf0c4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:04.645445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:04.647014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:04.647747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:04.781964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] MFA Rules not processed for user `747b30f6748741708d6e36b5f6ddf0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:04.784309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:04.840174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:04.843711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:05.008903 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1467/2893] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:05.089286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7aa7b-46d4-4806-8584-b5974bd3de34 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:05.095481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:05.097318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:05.097821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:05.098285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:05.231820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:05.233832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:05.246504 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:05.258147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1427/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:06.694326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:06.696350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:06.727458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079d93a-7be5-435e-bd84-0cfcda2c9b5c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:06.749994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:06.750910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.751463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.752411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.780175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:06.781811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44047bfc-09fc-42ff-ab39-0c6308257f2a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:06.814999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1468/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:07.413950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:07.429506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16327f56-8468-4436-b8bd-db56c54ca20b service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:07.458565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:07.459660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:07.463306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:07.463730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:07.478914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde141-8abe-446a-a368-499450532883 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:07.479198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde141-8abe-446a-a368-499450532883 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:07.479474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde141-8abe-446a-a368-499450532883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:07.522161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9cdde141-8abe-446a-a368-499450532883 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:07.526614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9cdde141-8abe-446a-a368-499450532883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:07.600971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:07.603776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:07.617456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1428/2896] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:07.680641 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:07.772448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1469/2897] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:07.785478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:07.787556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:08.000838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143695f6-9c11-49d4-84ed-64043450eb40 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:08.014481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:08.015444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:08.015925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:08.016376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:08.038336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:08.040271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fdf9b-1b11-408b-b21c-e0c74c0a6c1f service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:08.065434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1429/2898] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:08.366772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde141-8abe-446a-a368-499450532883 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:08.368272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9cdde141-8abe-446a-a368-499450532883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:08.583616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde141-8abe-446a-a368-499450532883 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:08.599573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:08.600730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:08.601014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:08.601478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] PATH_INFO: `/v3/users/208a9588c20943b192f340ccbe53b00b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:08.605255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208a9588c20943b192f340ccbe53b00b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:08.607501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:08.779637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208a9588c20943b192f340ccbe53b00b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.786136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208a9588c20943b192f340ccbe53b00b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.801465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208a9588c20943b192f340ccbe53b00b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.822131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208a9588c20943b192f340ccbe53b00b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.884560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208a9588c20943b192f340ccbe53b00b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.908674 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1470/2899] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:08 2022] DELETE /identity/v3/users/208a9588c20943b192f340ccbe53b00b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:08.913190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:08.914110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:08.914551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:08.952055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:08.953350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:09.043599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1430/2900] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:09.066536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:09.068515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:09.252872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe28c-b161-4a67-bc2f-662e0b3c5db1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:09.273929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:09.274922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:09.275373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:09.275841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:09.311846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:09.313591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea0e83-a007-4c2c-99b8-ab1e159dfadd service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:09.339109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1471/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:09.650150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:09.651674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:09.692404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8e3b2-fcdc-4e54-92ba-e78d9e58d0f5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:09.713967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:09.715404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:09.716340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:09.716853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] PATH_INFO: `/v3/users/48d3d461293a497fbfde7044e5fa4c7b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:09.719046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d3d461293a497fbfde7044e5fa4c7b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:09.730238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:09.776005 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:09.839325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d3d461293a497fbfde7044e5fa4c7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:09.848929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d3d461293a497fbfde7044e5fa4c7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:09.858624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d3d461293a497fbfde7044e5fa4c7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:09.881765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d3d461293a497fbfde7044e5fa4c7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:09.882818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d3d461293a497fbfde7044e5fa4c7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:09.891083 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1431/2902] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:09 2022] DELETE /identity/v3/users/48d3d461293a497fbfde7044e5fa4c7b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:09.896145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:09.897115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:09.897794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:09.905199 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:09.924631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:09.926479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:10.022267 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1472/2903] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:10.035888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:10.037568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:10.159678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7b9fc-dc29-48e5-b4dc-7d5ff83734f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:10.167601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:10.168736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.169270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.170431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.194045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:10.195823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b1a0-b8ca-4d5a-8ea2-0ec3ad2c342e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:10.211330 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1432/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:10.347495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:10.350933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:10.365371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80e3c5-f66f-424f-bf9f-f08548948c0e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:10.387973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:10.390970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.395200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.395679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] PATH_INFO: `/v3/projects/a32b4be640ce47c28766b103533975c2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.399170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32b4be640ce47c28766b103533975c2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:10.403689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:10.506970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32b4be640ce47c28766b103533975c2', 'request_id': 'req-126ee4f9-f30e-4526-919e-4659575256fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:10.522583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32b4be640ce47c28766b103533975c2', 'request_id': 'req-126ee4f9-f30e-4526-919e-4659575256fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:10.544139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32b4be640ce47c28766b103533975c2', 'request_id': 'req-126ee4f9-f30e-4526-919e-4659575256fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:10.566839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] The token cache is being invalidate because project a32b4be640ce47c28766b103533975c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:10.567423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:10.568212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-126ee4f9-f30e-4526-919e-4659575256fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:10.570473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1473/2905] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:10 2022] DELETE /identity/v3/projects/a32b4be640ce47c28766b103533975c2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:10.575603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.576246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.576622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.614093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:10.615696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:10.717743 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1433/2906] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:10.728354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.728724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.729178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.757554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:10.759155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:10.789664 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1474/2907] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:10.790473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:10.806062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1738a-ea1d-40d9-b53c-4e1d82f81947 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:10.836473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:10.837606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.837977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.838730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.839256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:10.839698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:10.864428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:10.905939 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1434/2908] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:13:10.911060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:10.924611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51750456-0bac-4dad-988d-11f7e043d094 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:10.930549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:10.931655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:10.932764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:10.933219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:10.935723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:10.938005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:10.992067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1475/2909] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:10 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:10.997625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.011870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750f165-dd40-462f-8b9c-a045afb31de5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.079792 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:11.093410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.095928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:11.133936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.134756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.135054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.135334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.137734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.139810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.170839 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1435/2910] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:10 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:11.179365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.198784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4b5d7-0ec5-4403-93b2-3347196f595a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.205437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.206406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.206899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.210968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.212900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.215304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.233181 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1436/2911] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:11.237555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.256547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367f3-d85b-4d87-8b70-e1137180cf2d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.264610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.265407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.265727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.266010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.267694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.269588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.272906 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:11.281777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d28c6-f535-4197-880d-728cda6f0c18 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.290983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.292412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.293036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.293475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] PATH_INFO: `/v3/projects/fa61fdd30c1148c78ec1262eac09d6fd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.294982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa61fdd30c1148c78ec1262eac09d6fd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.297381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.297875 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1437/2912] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:11.305782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.318435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d1bd-42d9-4412-a10b-792ae29d84e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.323514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.324563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.324960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.325347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] PATH_INFO: `/v3/projects/84eb5576dfd24e7885a7bc84d961df68/users/d6a6b46cc4b4432bad7b924002f94ea0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.343284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eb5576dfd24e7885a7bc84d961df68, user_id=d6a6b46cc4b4432bad7b924002f94ea0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.348429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8837c4-c379-44e7-987b-6c9eda908276 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.365560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa61fdd30c1148c78ec1262eac09d6fd', 'request_id': 'req-96126998-6809-45a2-8756-25a96b9cc83f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.370519 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1438/2913] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:11 2022] PUT /identity/v3/projects/84eb5576dfd24e7885a7bc84d961df68/users/d6a6b46cc4b4432bad7b924002f94ea0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:11.372846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa61fdd30c1148c78ec1262eac09d6fd', 'request_id': 'req-96126998-6809-45a2-8756-25a96b9cc83f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.385015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.385417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa61fdd30c1148c78ec1262eac09d6fd', 'request_id': 'req-96126998-6809-45a2-8756-25a96b9cc83f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.386067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.386636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.411296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] The token cache is being invalidate because project fa61fdd30c1148c78ec1262eac09d6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:11.411519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.415447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.417889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1476/2914] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:11 2022] DELETE /identity/v3/projects/fa61fdd30c1148c78ec1262eac09d6fd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:11.421879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.423492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:11.431873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] MFA Rules not processed for user `d6a6b46cc4b4432bad7b924002f94ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:11.433971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:11.587343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96126998-6809-45a2-8756-25a96b9cc83f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.609731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1439/2915] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:11.621264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:11.624011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:11.713806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.716068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.716370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.716695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] PATH_INFO: `/v3/users/747b30f6748741708d6e36b5f6ddf0c4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.719184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747b30f6748741708d6e36b5f6ddf0c4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.722473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.786554 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:11.799684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b57a-d2a9-4888-9741-cbd7337a95e8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:11.807013 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:11.814809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:11.815451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.815740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.816024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.827277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747b30f6748741708d6e36b5f6ddf0c4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.828372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747b30f6748741708d6e36b5f6ddf0c4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.834734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:11.836470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:11.844531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747b30f6748741708d6e36b5f6ddf0c4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.860526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747b30f6748741708d6e36b5f6ddf0c4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.862593 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1440/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:11.894863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-238fcdf9-728b-4a49-8291-16ea99763581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747b30f6748741708d6e36b5f6ddf0c4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:11.910590 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1477/2917] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:11 2022] DELETE /identity/v3/users/747b30f6748741708d6e36b5f6ddf0c4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:12.204105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.206325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.233571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021ec1a-1329-4293-9af2-0abdfcd74988 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:12.368269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:12.368944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.369230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.369506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] PATH_INFO: `/v3/users/d6a6b46cc4b4432bad7b924002f94ea0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.388744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a6b46cc4b4432bad7b924002f94ea0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:12.393922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:12.530257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a6b46cc4b4432bad7b924002f94ea0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.554185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a6b46cc4b4432bad7b924002f94ea0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.567750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a6b46cc4b4432bad7b924002f94ea0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.591672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a6b46cc4b4432bad7b924002f94ea0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.593408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a6b46cc4b4432bad7b924002f94ea0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.615533 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1441/2918] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:12 2022] DELETE /identity/v3/users/d6a6b46cc4b4432bad7b924002f94ea0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:12.620963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.621501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.621588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.678801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:12.680046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.696899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.698377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.821605 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1478/2919] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:12.835609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.837926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.872823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6db89-f240-4a14-a019-3b71a524510c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:12.889046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:12.890647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.892986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.894500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] PATH_INFO: `/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.896595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f01dd536afd4fdb8b4ad1e49789c778)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:12.902228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:12.948555 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:13.002446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8390-89a8-4261-8e27-53ad260965fd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.004511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f01dd536afd4fdb8b4ad1e49789c778', 'request_id': 'req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:13.012299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f01dd536afd4fdb8b4ad1e49789c778', 'request_id': 'req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:13.021009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f01dd536afd4fdb8b4ad1e49789c778', 'request_id': 'req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:13.043467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] The token cache is being invalidate because project 7f01dd536afd4fdb8b4ad1e49789c778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:13.043843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:13.045991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0233c98e-8085-4a7e-8e2b-3d6eb0f91b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:13.051178 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1442/2920] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:12 2022] DELETE /identity/v3/projects/7f01dd536afd4fdb8b4ad1e49789c778 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:13.068147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5a73f-c5e1-433a-89f6-6526e4760896 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.068510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5a73f-c5e1-433a-89f6-6526e4760896 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.068777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5a73f-c5e1-433a-89f6-6526e4760896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.136729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c6b5a73f-c5e1-433a-89f6-6526e4760896 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:13.138054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c6b5a73f-c5e1-433a-89f6-6526e4760896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.146428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.149909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.150354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.150734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.156241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.252171 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:13.291226 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1443/2921] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:13.302368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.302602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.302846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.348937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:13.350273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.378590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.381043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.386271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1444/2922] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:13.388169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.402072 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1479/2923] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:13.417791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc62f0-90b3-4bbc-9480-e61ed9f5ee9d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.424714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.425522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.425923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.426264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.427082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:13.427447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.430203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.476184 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1445/2924] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:13:13.480856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.498160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2946-b15c-47e1-9463-3eef8b62c335 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.514065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.515287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.515571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.515908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.517368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.519318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.571532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.584204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1480/2925] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:13.598581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a700a-db45-4888-a8cc-6e8ad82ae8e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.749242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.750096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.750472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.750629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.751956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.768209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.842736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.853871 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1446/2926] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:13.863182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6943-48d0-496e-9ecc-58053d7d65b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.881778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.885997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.886640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.887121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.888162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.895570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.934077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1481/2927] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:13.935251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.958006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73af07-cc60-4249-92dd-63bf3ee25ec7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.973103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.973846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.974129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.974410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.975156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.977354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ad9b4-d2d8-45bf-8d81-658ae5c756a3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.986734 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:14.016714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.028270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d92ee-d9bf-4190-889f-525cdb5382df admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.038196 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1447/2928] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:14.046403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.047309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.047589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.048190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] PATH_INFO: `/v3/projects/97dbe5dcafa142fb8984c5b5fe02f858/users/201ede925d9e4d54ab7ddce0753b4dfa/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.094456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dbe5dcafa142fb8984c5b5fe02f858, user_id=201ede925d9e4d54ab7ddce0753b4dfa, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.099170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.132554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1482/2929] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:14 2022] PUT /identity/v3/projects/97dbe5dcafa142fb8984c5b5fe02f858/users/201ede925d9e4d54ab7ddce0753b4dfa/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:14.135348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.135719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.135897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.168211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] MFA Rules not processed for user `201ede925d9e4d54ab7ddce0753b4dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:14.169607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:14.278550 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1448/2930] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:14.283567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.447345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697b9de-fd26-4a06-b7f3-baaabf235af6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.463434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.464127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.464440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.464715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.465551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.472039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.536973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1483/2931] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:14.540926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.555205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840522-52ae-448b-b804-18148a310bd7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.681074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.681796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.682080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.682354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.683074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.695273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.737739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.756469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbd29d-1f8c-4fb2-9264-1cec0f7aa556 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.761803 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1449/2932] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:14.777496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.778246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.778516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.778790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.779531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.781153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.816827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.817240 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1484/2933] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:14.829834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555ca24-51f6-4a2b-9ba4-f954c087f65a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.837423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.838382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.838660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.839050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] PATH_INFO: `/v3/projects/a928330b994c49d9a6950abb84ff6743/users/2d15d0cc34c041689ac9b7fb462e99c7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.860228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928330b994c49d9a6950abb84ff6743, user_id=2d15d0cc34c041689ac9b7fb462e99c7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.863768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.892219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1450/2934] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:14 2022] PUT /identity/v3/projects/a928330b994c49d9a6950abb84ff6743/users/2d15d0cc34c041689ac9b7fb462e99c7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:14.893694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.908286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd6674-fff7-4855-af84-2cdbfea973c4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.958527 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:14.999713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.000835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.002224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.002710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.005260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:15.007580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4974af-6b33-4e94-ba4b-94b7c43f0a96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:15.025961 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1485/2935] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:15.026883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.056182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a3f05-4eb8-46e3-ad97-7e2935d71790 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:15.065694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.066919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.068453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.069040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] PATH_INFO: `/v3/projects/a928330b994c49d9a6950abb84ff6743/users/2d15d0cc34c041689ac9b7fb462e99c7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.072852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928330b994c49d9a6950abb84ff6743, user_id=2d15d0cc34c041689ac9b7fb462e99c7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:15.078455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:15.119190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.119606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.119977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.121961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1451/2936] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:15 2022] PUT /identity/v3/projects/a928330b994c49d9a6950abb84ff6743/users/2d15d0cc34c041689ac9b7fb462e99c7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:15.184736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] MFA Rules not processed for user `2d15d0cc34c041689ac9b7fb462e99c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:15.186610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.200489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.203484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.382034 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:15.443161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81995c7-9e44-4677-b765-8a3962624790 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:15.453435 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1486/2937] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:15.458901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.461267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.462176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.462616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] PATH_INFO: `/v3/projects/84eb5576dfd24e7885a7bc84d961df68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.464126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eb5576dfd24e7885a7bc84d961df68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:15.467810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:15.526302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.528477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.584197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eb5576dfd24e7885a7bc84d961df68', 'request_id': 'req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.591823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eb5576dfd24e7885a7bc84d961df68', 'request_id': 'req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.601272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eb5576dfd24e7885a7bc84d961df68', 'request_id': 'req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.627291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] The token cache is being invalidate because project 84eb5576dfd24e7885a7bc84d961df68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:15.628531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.631528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-21884eb7-9e5f-49ff-ba38-07da89fe0f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.634917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1452/2938] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:15 2022] DELETE /identity/v3/projects/84eb5576dfd24e7885a7bc84d961df68 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:15.648731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eee6a-2b9a-4170-8614-0f7abe41ce7f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.649895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eee6a-2b9a-4170-8614-0f7abe41ce7f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.651289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eee6a-2b9a-4170-8614-0f7abe41ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.685743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-346eee6a-2b9a-4170-8614-0f7abe41ce7f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:15.687904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-346eee6a-2b9a-4170-8614-0f7abe41ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.735024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc721-946b-488c-8f22-573a2656b078 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:15.785159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1453/2939] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:15.786884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.787179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.787459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.866863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:15.868108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.905284 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1454/2940] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:15.911048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.916244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.918323 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:15.955819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.956676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.956965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.957247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.959329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:16.105308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5318f5-5b4f-4593-8a44-5ecedf9167ad None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.117911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.118978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.119505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.122239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.129914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:16.131913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.136461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.174648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.176406 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1487/2941] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:16.177431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.182964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.240859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a1564-8cad-4d2b-8e7b-3d4b19e29a6b service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.261652 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1455/2942] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:16.273312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.274116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.274392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.274717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.278479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:16.278853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.287322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.339871 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1488/2943] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:16.341841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.367125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80958607-2461-4ddd-96fd-eb112453aa7a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.387759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.394957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.395350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.395641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.399030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.403960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.424552 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:16.426217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.428683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:16.533365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1456/2944] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:16.536530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018202d-bfac-4c56-9a42-9ea459dc2c13 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.537632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.692377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf66bae-a8ed-4236-a0a4-2480443d2235 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.712113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.713850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.714760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.715217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.717955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.731315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.739959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.740641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.745371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.746022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.748300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:16.816102 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1457/2945] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:16 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:16.821742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.856789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f9a70-7071-4b52-83ad-10e988885386 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.881339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.882457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.882731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.883004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.883836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.885812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.921889 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1458/2946] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:16.923982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.945530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97003-fce2-4943-baa7-ad6eb5e53a51 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.959245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.959994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.960270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.960546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.961293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.961720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.965290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.967125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaa0e8-5af6-43a1-89a4-44cce25531c7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.005425 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1489/2947] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:17.021339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1459/2948] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:17.025710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.041117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6a969-e9bc-4fb9-8c9f-f0639f65d6e5 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.054507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.055657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.056358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.059826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] PATH_INFO: `/v3/projects/86dcce798be5406685973e61c9014b0c/users/ab40062ec270461986a3dece91f0584c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.096265 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.128139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dcce798be5406685973e61c9014b0c, user_id=ab40062ec270461986a3dece91f0584c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.136917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.180817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1490/2949] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:17 2022] PUT /identity/v3/projects/86dcce798be5406685973e61c9014b0c/users/ab40062ec270461986a3dece91f0584c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:17.186168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.186627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.186915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.249663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:17.250977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.437610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.440696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.468376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9586d-9906-46db-9124-d5d9c0204102 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.468513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1460/2950] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:17.479162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.482196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.483312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.484101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] PATH_INFO: `/v3/users/201ede925d9e4d54ab7ddce0753b4dfa` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.488253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201ede925d9e4d54ab7ddce0753b4dfa)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.492002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.525382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.605214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201ede925d9e4d54ab7ddce0753b4dfa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.607090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201ede925d9e4d54ab7ddce0753b4dfa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.619829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201ede925d9e4d54ab7ddce0753b4dfa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.632442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201ede925d9e4d54ab7ddce0753b4dfa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.668174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9dba26d-9fc0-4778-97b0-19a90f43d958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201ede925d9e4d54ab7ddce0753b4dfa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.683221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1491/2951] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:17 2022] DELETE /identity/v3/users/201ede925d9e4d54ab7ddce0753b4dfa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:17.687716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.688017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.688301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.695647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea7e03-e6cd-4f76-8036-abb86d69b525 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.712550 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.734938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:17.736294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.843685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.844562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.845434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.846998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.849150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.896960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1492/2952] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:17.906520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.908735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.927723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db014c0-9096-45c4-80ca-31dee6833e2b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.932398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.934539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.934971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.935249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.940532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.942307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.950246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.951928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.954832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1461/2953] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:17.963827 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1493/2954] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:18.451945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.453595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.486151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20ecc6-6785-40f9-a75f-f487a9633c3b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.491808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.493022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.493374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.493953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] PATH_INFO: `/v3/projects/97dbe5dcafa142fb8984c5b5fe02f858` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.495188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dbe5dcafa142fb8984c5b5fe02f858)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.498433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.572817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dbe5dcafa142fb8984c5b5fe02f858', 'request_id': 'req-88e3fc36-8743-4be1-bc12-99cf8937b03b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.580829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dbe5dcafa142fb8984c5b5fe02f858', 'request_id': 'req-88e3fc36-8743-4be1-bc12-99cf8937b03b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.587368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dbe5dcafa142fb8984c5b5fe02f858', 'request_id': 'req-88e3fc36-8743-4be1-bc12-99cf8937b03b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.602476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] The token cache is being invalidate because project 97dbe5dcafa142fb8984c5b5fe02f858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:18.602768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.603416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.604975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1462/2955] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:18 2022] DELETE /identity/v3/projects/97dbe5dcafa142fb8984c5b5fe02f858 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:18.609116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.619334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03bf42-2b4c-4186-9ee2-b5a08f6ca6d6 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.672973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.691961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.693004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.693284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.693564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] PATH_INFO: `/v3/users/2d15d0cc34c041689ac9b7fb462e99c7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.694803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d15d0cc34c041689ac9b7fb462e99c7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.696721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.765469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d15d0cc34c041689ac9b7fb462e99c7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.768674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d15d0cc34c041689ac9b7fb462e99c7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.794329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d15d0cc34c041689ac9b7fb462e99c7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.810425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d15d0cc34c041689ac9b7fb462e99c7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.842339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-21d196ff-c178-483b-86d7-3685d71dcc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d15d0cc34c041689ac9b7fb462e99c7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.858742 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1494/2956] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:18 2022] DELETE /identity/v3/users/2d15d0cc34c041689ac9b7fb462e99c7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:18.906900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.910163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.978221 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.997550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fc36-8743-4be1-bc12-99cf8937b03b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.015338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.016302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.016970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.050160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:19.051407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.097715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.099046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.099401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.099750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.103236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.156032 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1495/2957] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:19.200997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.202595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.297782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.299495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.314281 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1463/2958] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:19.331730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b1842-2cf8-4a2a-ba94-f5d5d52232ae None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.349589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.350730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.351012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.351284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.387507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.389289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317cf62-0497-4c66-82d2-be9076414a64 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.415991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1496/2959] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:13:19.528872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.530834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.715184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4c591-f421-44cd-a542-ecd5498f9adc service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.728549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.729710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.730136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.730354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] PATH_INFO: `/v3/projects/a928330b994c49d9a6950abb84ff6743` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.734463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a928330b994c49d9a6950abb84ff6743)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.737137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.846238 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.859803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a928330b994c49d9a6950abb84ff6743', 'request_id': 'req-52f1358f-bf75-45cb-9a82-98b75b9e9f40'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.873503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a928330b994c49d9a6950abb84ff6743', 'request_id': 'req-52f1358f-bf75-45cb-9a82-98b75b9e9f40'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.887432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a928330b994c49d9a6950abb84ff6743', 'request_id': 'req-52f1358f-bf75-45cb-9a82-98b75b9e9f40'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.908303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] The token cache is being invalidate because project a928330b994c49d9a6950abb84ff6743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:19.908970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.913530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-52f1358f-bf75-45cb-9a82-98b75b9e9f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.915285 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1464/2960] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:19 2022] DELETE /identity/v3/projects/a928330b994c49d9a6950abb84ff6743 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:19.920415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.921104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.921636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.932628 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.967087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:19.968350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.132803 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1497/2961] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:20.140478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.140773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.141053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.326492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:20.328698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.338232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1465/2962] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:20.342279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.360851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf69344-8aed-4764-aa5d-9e9674510629 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.378540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.379510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.379799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.380079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.380844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:20.381154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.382840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.410239 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1498/2963] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:20.411380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.424979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232f50d-d14b-4c3c-b6f0-85e01e63a1e1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.435137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.436064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.436445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.436846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.437660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.440652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.518711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1466/2964] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:20.523041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.539317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d010ea-d298-4a3a-b2b2-11a0339bf48f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.666985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.667855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.668140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.668424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.669196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.671633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.704887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1499/2965] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:20.708015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.726714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c30e3-2489-47fa-9bc1-aaafc19d7713 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.739983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.740938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.741229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.741511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.743439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.748412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.772652 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1467/2966] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:20.776616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.794469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8f5b0-6711-44c0-a5da-1b1f58a5b79a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.812020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.812827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.813169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.814216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.815066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.817930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c636-9a6d-4843-bbf4-7df61261e57b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.843761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1500/2967] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:20.850273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.874266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e896-b0e0-4cf7-a62b-958facc4de52 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.890719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.893710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.895467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.895854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] PATH_INFO: `/v3/projects/18d42b864ea74428b5e86afa50c085cb/users/35d5548c898a4ac38ee2fdee8a8661cf/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.983243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d42b864ea74428b5e86afa50c085cb, user_id=35d5548c898a4ac38ee2fdee8a8661cf, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.986970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.018312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1468/2968] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:20 2022] PUT /identity/v3/projects/18d42b864ea74428b5e86afa50c085cb/users/35d5548c898a4ac38ee2fdee8a8661cf/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:21.028856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.029453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.030067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.104672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] MFA Rules not processed for user `35d5548c898a4ac38ee2fdee8a8661cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:21.106362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.332757 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:21.348079 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1501/2969] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:21.349283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.498499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f263cb8-3e64-4e7c-b129-1ff75022c7ef admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.518275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.526642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.526642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.526642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.526642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.527592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.591742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1469/2970] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/projects => generated 393 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:21.596893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.612026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582788e-c4d9-417b-a8ca-eef3bc484ac0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.692045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.692894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.693186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.693468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.694218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.696339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.727970 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1502/2971] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:21.732099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.745389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b652c-fdae-455e-a630-e293ea844dfc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.760393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.761102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.761371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.761644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.762423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.769716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.799522 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1470/2972] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:21.800011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.812143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb768e5-fad7-4830-b738-a663fb80a167 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.817993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.819476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.819784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.820109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] PATH_INFO: `/v3/projects/892afead52584d7a9513a8f22e2fe681/users/532de4730bbb45bba22e2af17f840e32/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.840086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892afead52584d7a9513a8f22e2fe681, user_id=532de4730bbb45bba22e2af17f840e32, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.842988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.866914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1503/2973] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:21 2022] PUT /identity/v3/projects/892afead52584d7a9513a8f22e2fe681/users/532de4730bbb45bba22e2af17f840e32/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:21.870744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.885813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773e99-870b-4a64-9fdc-af105defd14f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.012412 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:22.061322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.062194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.062549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.062750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.063709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.066286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447fbc2-3c16-4928-b545-d55f258768a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.099817 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1471/2974] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:22.101455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:22.143130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7a308-d673-4ca6-bcb2-f35ff98d3b19 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.163394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.164309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.164588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.164860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] PATH_INFO: `/v3/projects/892afead52584d7a9513a8f22e2fe681/users/532de4730bbb45bba22e2af17f840e32/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.166909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=892afead52584d7a9513a8f22e2fe681, user_id=532de4730bbb45bba22e2af17f840e32, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.180923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.206849 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1504/2975] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:22 2022] PUT /identity/v3/projects/892afead52584d7a9513a8f22e2fe681/users/532de4730bbb45bba22e2af17f840e32/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:22.218084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc607a-b316-465e-af18-c96dc5ce9cd3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.218399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc607a-b316-465e-af18-c96dc5ce9cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.218634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc607a-b316-465e-af18-c96dc5ce9cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.253312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2acc607a-b316-465e-af18-c96dc5ce9cd3 None None] MFA Rules not processed for user `532de4730bbb45bba22e2af17f840e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:22.255005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2acc607a-b316-465e-af18-c96dc5ce9cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:22.379500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1472/2976] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:22.471260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:22.583362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc763d-0f55-4853-9727-08768fc7a79b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.600059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.601286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.601589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.601887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] PATH_INFO: `/v3/users/35d5548c898a4ac38ee2fdee8a8661cf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.604391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d5548c898a4ac38ee2fdee8a8661cf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.613899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.707716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d5548c898a4ac38ee2fdee8a8661cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:22.710092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d5548c898a4ac38ee2fdee8a8661cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:22.722760 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:22.732598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d5548c898a4ac38ee2fdee8a8661cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:22.746131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d5548c898a4ac38ee2fdee8a8661cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:22.782849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d5548c898a4ac38ee2fdee8a8661cf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:22.802483 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1505/2977] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:22 2022] DELETE /identity/v3/users/35d5548c898a4ac38ee2fdee8a8661cf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:22.805226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.810124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.810998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.865738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:22.868492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:23.103462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1473/2978] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:23.219160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:23.220871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:23.358513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168bca-f47e-49f9-a2cb-9de0373a6727 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:23.373162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:23.373420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:23.373542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:23.374238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:23.396679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:23.398075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:23.421929 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1506/2979] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:24.214828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:24.217146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:24.264420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119e881-c2d9-4fa7-ad1d-127a2d7bfe54 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:24.278545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:24.279494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:24.279806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:24.280279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] PATH_INFO: `/v3/projects/18d42b864ea74428b5e86afa50c085cb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:24.281512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d42b864ea74428b5e86afa50c085cb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:24.285206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:24.424868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d42b864ea74428b5e86afa50c085cb', 'request_id': 'req-4ae68ee6-23f1-4596-adab-b68b071390c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.441360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d42b864ea74428b5e86afa50c085cb', 'request_id': 'req-4ae68ee6-23f1-4596-adab-b68b071390c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.447337 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:24.474775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d42b864ea74428b5e86afa50c085cb', 'request_id': 'req-4ae68ee6-23f1-4596-adab-b68b071390c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.518811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] The token cache is being invalidate because project 18d42b864ea74428b5e86afa50c085cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:24.519451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.520242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ae68ee6-23f1-4596-adab-b68b071390c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.524975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1474/2980] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:24 2022] DELETE /identity/v3/projects/18d42b864ea74428b5e86afa50c085cb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:24.526278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:24.540455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690f93-1eaa-4678-ab73-daf5c0a72bea service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:24.675540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:24.676644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:24.676991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:24.677278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] PATH_INFO: `/v3/users/532de4730bbb45bba22e2af17f840e32` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:24.683850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=532de4730bbb45bba22e2af17f840e32)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:24.687597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:24.822787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532de4730bbb45bba22e2af17f840e32'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.826185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532de4730bbb45bba22e2af17f840e32'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.842160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532de4730bbb45bba22e2af17f840e32'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.852753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532de4730bbb45bba22e2af17f840e32'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.863282 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:24.872587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ad9b6247-5611-45d3-a08d-1ac6a0fdf82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532de4730bbb45bba22e2af17f840e32'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:24.883143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1507/2981] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:24 2022] DELETE /identity/v3/users/532de4730bbb45bba22e2af17f840e32 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:25.779194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:25.780004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:25.780428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:25.782363 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1475/2982] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:13:25.793715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:25.794162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:25.794477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:25.835530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:25.836780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:25.987405 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1508/2983] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:26.014442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:26.016366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:26.054790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e203f99-d3af-463b-b98b-4e7465b56d14 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:26.075907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:26.076585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.076871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.077149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.099964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:26.104456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218514e0-a66f-437d-b0a3-59a9a3156da7 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:26.158834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1476/2984] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:26.175746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:26.177795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:26.339382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e9805-5f5b-434b-a1d7-8ecaf1f24f16 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:26.353483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:26.358889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.359270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.359776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] PATH_INFO: `/v3/projects/892afead52584d7a9513a8f22e2fe681` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.362911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] RBAC: Authorizing `identity:delete_project(project_id=892afead52584d7a9513a8f22e2fe681)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:26.368645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:26.474881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892afead52584d7a9513a8f22e2fe681', 'request_id': 'req-7790b928-a8c7-4d07-9367-e83e2e65135a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:26.493792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892afead52584d7a9513a8f22e2fe681', 'request_id': 'req-7790b928-a8c7-4d07-9367-e83e2e65135a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:26.512549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892afead52584d7a9513a8f22e2fe681', 'request_id': 'req-7790b928-a8c7-4d07-9367-e83e2e65135a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:26.538791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] The token cache is being invalidate because project 892afead52584d7a9513a8f22e2fe681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:26.539147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:26.539987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7790b928-a8c7-4d07-9367-e83e2e65135a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:26.542069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1509/2985] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:26 2022] DELETE /identity/v3/projects/892afead52584d7a9513a8f22e2fe681 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:26.548561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.549420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.550183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.575620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:26.579716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:26.723822 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1477/2986] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:26.731904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.732336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.732722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.768203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:26.770520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:26.801570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1510/2987] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:26.806198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:26.821699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ef3c-69e8-49be-be19-00c58f7ad817 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:26.837830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:26.839795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.840081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.841234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.856880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:26.858015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:26.865982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:26.904568 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1478/2988] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:26.909468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:26.924681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4770d-4d97-42e8-8b17-905ca9903c97 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:26.942360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:26.943379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:26.943764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:26.944145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:26.944955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:26.947478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8caa3-3539-4341-afe1-2d963a5df018 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:26.977151 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:27.025325 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1511/2989] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:26 2022] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:27.029691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.045302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d289a-80de-456d-90a5-566027e07d2b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.093173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e923-47e2-47e0-8e82-c3d2e91b2020 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.093457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e923-47e2-47e0-8e82-c3d2e91b2020 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.093759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809e923-47e2-47e0-8e82-c3d2e91b2020 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.095754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1512/2990] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:13:27.103198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.103484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.103761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.134015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:27.135254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:27.195920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.196596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.196877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.197152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.197944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.199892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.247198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1479/2991] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:27 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:27.255986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.272870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eb1ef-c399-4591-8f24-0ba0ad1c614b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.291477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.292190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.292476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.292756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.293509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.295188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.316337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1480/2992] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:27.321758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.322879 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1513/2993] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:27.337702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ea8a6-9304-4662-b8e1-824edf6b81b5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.346949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.349992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:27.354733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.355240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.355522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.355798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.356546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.358201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.377944 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1481/2994] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:27.383397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.415301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a66b2-8231-4ad3-b998-97e36047cfe5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.438621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.439730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.440015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.440293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] PATH_INFO: `/v3/projects/e6caac543f0e47e5908eb146739cddca/users/735a3f7d7e454f14a7a4ed229affd75b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.485298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145311-3597-455a-81c9-48c2a84e0b5a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.492322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.493317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.493609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.494660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.494819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6caac543f0e47e5908eb146739cddca, user_id=735a3f7d7e454f14a7a4ed229affd75b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.497488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8782c6-5153-4f1f-a7dc-b4d09f6ffbf3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.522381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.530669 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1482/2995] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:27 2022] PUT /identity/v3/projects/e6caac543f0e47e5908eb146739cddca/users/735a3f7d7e454f14a7a4ed229affd75b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:27.534043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fec91-59c0-46d6-bd1b-8ed215566aef service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.543281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.543552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.543841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.556176 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1514/2996] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:27.557338 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:27.586767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:27.588512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:27.597700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.598448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.599431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.641659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:27.643437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:27.740352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1483/2997] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:27.772961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.774498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:27.806169 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1515/2998] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:27.830927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:27.841120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d8667-55c7-4601-a950-50f5cb26c330 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.853975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.854728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.855082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.855421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.872084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.879331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:27.904022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1516/2999] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:27.908574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10f19a-3d29-4020-951e-103d3666d189 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:27.931452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:27.932164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:27.932452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:27.932728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:27.975678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:27.991188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326f3c-fba1-4ee4-b49c-05aca1cce855 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:28.025626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1484/3000] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:28.484294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:28.486614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:28.522506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced9c7-c19d-4b5c-a164-06461e84651e service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:28.528589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:28.530123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:28.530614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:28.531093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] PATH_INFO: `/v3/users/3c39d06504644aa29428fc9b130e73ea` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:28.532916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c39d06504644aa29428fc9b130e73ea)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:28.536830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:28.562316 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:28.671253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c39d06504644aa29428fc9b130e73ea'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:28.672180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c39d06504644aa29428fc9b130e73ea'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:28.720561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c39d06504644aa29428fc9b130e73ea'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:28.750299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c39d06504644aa29428fc9b130e73ea'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:28.812597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c39d06504644aa29428fc9b130e73ea'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:28.837938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1517/3001] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:28 2022] DELETE /identity/v3/users/3c39d06504644aa29428fc9b130e73ea => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:28.843152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:28.843462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:28.843744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:28.926127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:28.928298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.188582 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1485/3002] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:29.225015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:29.227352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.443128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d43d-3ab6-4adb-9944-60957644f11e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:29.447819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:29.448524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:29.448811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:29.449084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:29.466879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:29.468836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726ca48-8526-43f1-a9e1-e79071483e30 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:29.481863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:29.483804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.498978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b8248-fb17-46e8-9c76-4f056ca4d700 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:29.515183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:29.518477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:29.519073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:29.519574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:29.531014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.531691 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1518/3003] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:29.554721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:29.556180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:29.574558 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1486/3004] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:29.677247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:29.677535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:29.677841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:29.737874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] MFA Rules not processed for user `ab40062ec270461986a3dece91f0584c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:29.742779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.882708 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1519/3005] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:31.520036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:31.521505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:31.551295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda07c47-d635-4165-9ec4-be10a3033871 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:31.567189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:31.568105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:31.568389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:31.568671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] PATH_INFO: `/v3/projects/6dc5a0a6cd7f48bc8c41a790c3f82cc6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:31.570090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc5a0a6cd7f48bc8c41a790c3f82cc6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:31.572070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:31.647221 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.673729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'request_id': 'req-a0149500-3ddf-427c-80f7-c46611eeb250'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.694819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'request_id': 'req-a0149500-3ddf-427c-80f7-c46611eeb250'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.703996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc5a0a6cd7f48bc8c41a790c3f82cc6', 'request_id': 'req-a0149500-3ddf-427c-80f7-c46611eeb250'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.739753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] The token cache is being invalidate because project 6dc5a0a6cd7f48bc8c41a790c3f82cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:31.740293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.741342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.743687 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1487/3006] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:31 2022] DELETE /identity/v3/projects/6dc5a0a6cd7f48bc8c41a790c3f82cc6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:31.747736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:31.760069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186239-ff99-4baa-81ea-9da876599ce8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:31.789176 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.847087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:31.848617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:31.848941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:31.850008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] PATH_INFO: `/v3/users/92d10926d17f46009589656326529d94` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:31.852875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d10926d17f46009589656326529d94)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:31.856092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:31.958542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d10926d17f46009589656326529d94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.965366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d10926d17f46009589656326529d94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.979069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d10926d17f46009589656326529d94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.002859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d10926d17f46009589656326529d94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.005769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.007275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.029095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d10926d17f46009589656326529d94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.052436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1520/3007] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:31 2022] DELETE /identity/v3/users/92d10926d17f46009589656326529d94 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:32.195793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149500-3ddf-427c-80f7-c46611eeb250 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.366045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.366842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.369517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.370969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.374517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.463077 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:32.480717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.483301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994939a1-b087-43ad-ac80-0d6b471084c0 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.510622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1488/3008] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:35.087946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:35.089624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:35.318350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40749d96-85e8-40d5-9e10-75dd26e3890b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:35.337782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:35.338681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:35.338966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:35.339618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] PATH_INFO: `/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:35.341868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad2e4b4b5ab478a85ba7b44dd581faf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:35.344476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:35.490005 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:35.496963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad2e4b4b5ab478a85ba7b44dd581faf', 'request_id': 'req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:35.513880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad2e4b4b5ab478a85ba7b44dd581faf', 'request_id': 'req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:35.539351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad2e4b4b5ab478a85ba7b44dd581faf', 'request_id': 'req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:35.575036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] The token cache is being invalidate because project 7ad2e4b4b5ab478a85ba7b44dd581faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:35.577434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:35.579979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6ea0c73b-e51b-41a8-a282-cdd680c21a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:35.582764 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1521/3009] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:35 2022] DELETE /identity/v3/projects/7ad2e4b4b5ab478a85ba7b44dd581faf => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:35.590008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:35.590989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:35.591406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:35.633634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:35.635186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:35.879713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1489/3010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:35.888238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:35.888527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:35.888811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:35.954670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:35.956284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:35.994817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1522/3011] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:36.002529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.015056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614e618-989f-40d8-9e80-74bc8e4ee859 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.033008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.033856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.034342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.034695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.035458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:36.035804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.037487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.084098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1490/3012] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:36.088253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.107463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652f423-72d0-48b1-8fab-29c0d24a857e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.138421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.139398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.140093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.140593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.143006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.146989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.205480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1523/3013] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:36 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:36.209811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.222308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa5d8b-1210-48f1-a055-bbdd785b4976 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.388620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.389335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.389623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.394125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.395745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.399823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.467744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1491/3014] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:36 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:36.472721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.487098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed475b6-15f2-457f-8921-2d876bead42d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.520045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.520771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.521059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.521337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.522124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.524059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.564586 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1524/3015] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:36.568195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.581757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d6763-97b8-4ecd-882b-71287b29f6f1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.614427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.615118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.615642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.616111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.617918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.627563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34ad2d-cbaa-4bca-9f02-d81ac41e837c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.672128 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1492/3016] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:36.674424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:36.687441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12301078-182f-4467-9e58-c203561c3761 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:36.708723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:36.710068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.710608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.711433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] PATH_INFO: `/v3/projects/6023d0f8f7d4483585c0443676fce3e5/users/adbae035c5d24e7eb2d053a0fbd13f28/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.755051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6023d0f8f7d4483585c0443676fce3e5, user_id=adbae035c5d24e7eb2d053a0fbd13f28, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:36.758035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:36.786282 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1525/3017] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:36 2022] PUT /identity/v3/projects/6023d0f8f7d4483585c0443676fce3e5/users/adbae035c5d24e7eb2d053a0fbd13f28/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:36.797097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:36.797420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:36.797730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:36.856186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] MFA Rules not processed for user `adbae035c5d24e7eb2d053a0fbd13f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:36.857725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:36.974504 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:37.014375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1493/3018] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:37.018766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.135640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.138182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:37.256070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7ebf-3358-4289-b085-9df8018f24ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.275173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.279021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.281035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.286570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.289093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.291293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.366846 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1526/3019] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:37 2022] POST /identity/v3/projects => generated 393 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:37.371001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.387649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff10d-1b98-4099-9b99-677a156befe0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.567989 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:37.601502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2aedc-5635-459c-b1a3-6f1d99227554 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.609344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.611076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.611546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.612024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.615161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.616068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.616514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.618789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.619703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.623998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.624927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:37.666652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.671698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.682972 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1527/3020] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:37 2022] POST /identity/v3/users => generated 303 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:37.683901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.703882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5823bac-fec0-44bf-9c83-6acf6bed9e7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.704576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1494/3021] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:37.710560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.711339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.711529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.711806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.712551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.714207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.739176 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1528/3022] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:37.742843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.759168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1807cf-da0a-4018-9e2c-b24102022e83 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.774648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.775778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.780744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.781072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] PATH_INFO: `/v3/projects/62c19142f37447f89f9edd357efe0313/users/60b93ca2f2dc44ecbd199629537fd433/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.839349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c19142f37447f89f9edd357efe0313, user_id=60b93ca2f2dc44ecbd199629537fd433, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.842592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2669145-f35e-43ae-af4c-5b662b962bd4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.869135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1495/3023] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:37 2022] PUT /identity/v3/projects/62c19142f37447f89f9edd357efe0313/users/60b93ca2f2dc44ecbd199629537fd433/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:37.872961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.900652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620b9f-fa42-4083-a07f-e141b5cdaa1d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.916645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52d4f-eef5-4dab-9e2d-4441477a0415 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.917376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52d4f-eef5-4dab-9e2d-4441477a0415 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.918246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db52d4f-eef5-4dab-9e2d-4441477a0415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.952797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1db52d4f-eef5-4dab-9e2d-4441477a0415 None None] MFA Rules not processed for user `f71f3d66b27b471d9772a0a01d3c89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:37.957074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1db52d4f-eef5-4dab-9e2d-4441477a0415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.062232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.066563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.066893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.067175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.067962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.069619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.076058 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:38.101594 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1529/3024] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:38.107811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.121176 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1496/3025] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:38.126828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a659c3-5764-46c9-b5a2-9764b5f9bf97 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.134251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee976b6-9346-468a-b951-3b26ab305af0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.135476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee976b6-9346-468a-b951-3b26ab305af0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.136186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee976b6-9346-468a-b951-3b26ab305af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.141887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.143113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.144663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.150766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] PATH_INFO: `/v3/projects/62c19142f37447f89f9edd357efe0313/users/60b93ca2f2dc44ecbd199629537fd433/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.153379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c19142f37447f89f9edd357efe0313, user_id=60b93ca2f2dc44ecbd199629537fd433, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.156734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b834e1-8029-4623-874b-9d3db3db0e2d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.169747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5ee976b6-9346-468a-b951-3b26ab305af0 None None] MFA Rules not processed for user `f71f3d66b27b471d9772a0a01d3c89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:38.171007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ee976b6-9346-468a-b951-3b26ab305af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.188999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1530/3026] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:38 2022] PUT /identity/v3/projects/62c19142f37447f89f9edd357efe0313/users/60b93ca2f2dc44ecbd199629537fd433/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:38.200252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.200803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.201272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.256083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] MFA Rules not processed for user `60b93ca2f2dc44ecbd199629537fd433`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:38.257528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.258177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1497/3027] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:38.368892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1531/3028] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:42.694638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:42.695104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:42.695440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:42.737709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] MFA Rules not processed for user `735a3f7d7e454f14a7a4ed229affd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:42.739384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:42.858021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1498/3029] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:42.862838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:42.864418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:42.923245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:42.946083 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:42.979597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17af83-6e97-483d-8d12-6c3eda42be2a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:42.986310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:42.986998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:42.989041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:42.989360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:42.990098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:42.992264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.031033 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1532/3030] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:42 2022] POST /identity/v3/projects => generated 395 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:43.033581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.035822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:43.038363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f666f-bc0e-4b58-bccb-8dea12a835f2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.070353 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:43.131821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df52971-a332-40d0-8256-368815ddd399 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.138520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.139647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.140317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.140733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.143107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:43.150542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.151484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.151882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.152448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.171070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.173057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.185648 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1533/3031] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:43.186499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.282445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8214d-5d44-4444-9722-c343702ae016 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.289848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.290626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.291850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.293843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.294773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.295749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.298468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.302490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.327599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1499/3032] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:43.339785 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1534/3033] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:43 2022] POST /identity/v3/users => generated 304 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:43.340918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.353273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effba22f-c30b-4f7c-9d31-fadbcedf18b6 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.358882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.360531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.361016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.361467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.362506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.364623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.386975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1500/3034] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:43.390081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.408210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86c7b6-0cc8-4deb-ae67-b6e405d05274 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.424778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.425813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.426142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.426526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] PATH_INFO: `/v3/projects/c41a13f022a24583accedda5a698d7ae/users/db929a5c238a4cea9161fae69f637d2c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.472446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41a13f022a24583accedda5a698d7ae, user_id=db929a5c238a4cea9161fae69f637d2c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.475631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.508167 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1535/3035] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:43 2022] PUT /identity/v3/projects/c41a13f022a24583accedda5a698d7ae/users/db929a5c238a4cea9161fae69f637d2c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:43.512320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.524853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb1723-ab4e-408a-b9f2-ff16b4a08672 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.621269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.622120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.622510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.623454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.625958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.628606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d952e4-32b9-4853-9979-b0a57b59c710 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.649724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1501/3036] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:43.652625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:43.670505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa4b59-b90f-4f36-a7d1-94d2d527af07 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:43.685812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:43.686863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:43.687255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:43.688184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] PATH_INFO: `/v3/projects/c41a13f022a24583accedda5a698d7ae/users/db929a5c238a4cea9161fae69f637d2c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:43.690877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41a13f022a24583accedda5a698d7ae, user_id=db929a5c238a4cea9161fae69f637d2c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:43.695255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:43.712274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1536/3037] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:43 2022] PUT /identity/v3/projects/c41a13f022a24583accedda5a698d7ae/users/db929a5c238a4cea9161fae69f637d2c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:44.427499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.428436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.429196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.457208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:44.475598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:44.562634 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:44.620799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1502/3038] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:45.990309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.992608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:46.039973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:46.090595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93357c-05f0-4b2f-aedf-c1914f2da498 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.097834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.103402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.103934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.104221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] PATH_INFO: `/v3/users/01b0f82f73ea4c14a51c5481e78d4493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.107520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b0f82f73ea4c14a51c5481e78d4493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.137826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.215639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b0f82f73ea4c14a51c5481e78d4493'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.216484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b0f82f73ea4c14a51c5481e78d4493'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.228018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b0f82f73ea4c14a51c5481e78d4493'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.243432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b0f82f73ea4c14a51c5481e78d4493'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.268122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b0f82f73ea4c14a51c5481e78d4493'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.284224 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1537/3039] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:45 2022] DELETE /identity/v3/users/01b0f82f73ea4c14a51c5481e78d4493 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:46.614348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.634861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f7a7f-441b-4194-a422-300902e7c644 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.785485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.786725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.787197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.787645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] PATH_INFO: `/v3/projects/6c9db762e4c14d538ea1c9de1b204c95` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.790360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9db762e4c14d538ea1c9de1b204c95)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.792742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.894090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9db762e4c14d538ea1c9de1b204c95', 'request_id': 'req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.909880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9db762e4c14d538ea1c9de1b204c95', 'request_id': 'req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.931428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9db762e4c14d538ea1c9de1b204c95', 'request_id': 'req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.946724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] The token cache is being invalidate because project 6c9db762e4c14d538ea1c9de1b204c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:46.947011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.949490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:46.959652 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1503/3040] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:46 2022] DELETE /identity/v3/projects/6c9db762e4c14d538ea1c9de1b204c95 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:46.964509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.966101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:46.999938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272440f3-5756-4d59-99a4-31c7893dd374 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:47.194497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:47.201287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:47.201287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:47.201617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] PATH_INFO: `/v3/users/a79c6bb21f4d4b8a89acbe6c70b539e6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:47.205628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79c6bb21f4d4b8a89acbe6c70b539e6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:47.207777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:47.330357 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:47.349041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79c6bb21f4d4b8a89acbe6c70b539e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:47.350703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79c6bb21f4d4b8a89acbe6c70b539e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:47.369087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79c6bb21f4d4b8a89acbe6c70b539e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:47.379931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79c6bb21f4d4b8a89acbe6c70b539e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:47.433946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79c6bb21f4d4b8a89acbe6c70b539e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:47.500571 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1538/3041] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:46 2022] DELETE /identity/v3/users/a79c6bb21f4d4b8a89acbe6c70b539e6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:47.542528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:47.547093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.763288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05c68c-3cbc-4cef-9e7d-dfd2867ed6f9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:47.789486 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:47.899628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:47.900316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:47.900612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:47.900880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:47.902885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.931520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:47.932010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff602f5-93be-43b7-9d15-bfea09e3cf02 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:47.959178 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1504/3042] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:48.245150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:48.247427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.261899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118308-a901-4d97-8856-317df9de876c None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.262254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118308-a901-4d97-8856-317df9de876c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.262618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118308-a901-4d97-8856-317df9de876c None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.264072 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1505/3043] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:13:48.271048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.274104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.275299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.342942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:48.352673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.470489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2555-dd7d-44d5-bd05-d8cd7b731795 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:48.478722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099880-4114-4965-b834-2be84521e01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:48.485117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099880-4114-4965-b834-2be84521e01b service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.485117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099880-4114-4965-b834-2be84521e01b service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.485117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099880-4114-4965-b834-2be84521e01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.486360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e099880-4114-4965-b834-2be84521e01b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.491357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1506/3044] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:48.534775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:48.538906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.634845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099880-4114-4965-b834-2be84521e01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:48.637024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e099880-4114-4965-b834-2be84521e01b service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:48.669334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1539/3045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:48.671799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099880-4114-4965-b834-2be84521e01b service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:48.676973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e099880-4114-4965-b834-2be84521e01b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.706029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0fc7-9a3a-40e6-bde1-d84f33ed9e56 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:48.711366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:48.712176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.712547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.713057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.737495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:48.739562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:48.756088 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1507/3046] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:48.757243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:48.761596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.826336 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:48.833273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099880-4114-4965-b834-2be84521e01b service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:48.842355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:48.843344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.844107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.844721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] PATH_INFO: `/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.846567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9b63fe4a5a49b79a5172f01e8c8311)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:48.848641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:48.872699 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:48.928458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc349b65-5fee-4223-956d-a38b773f17af service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:48.930415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9b63fe4a5a49b79a5172f01e8c8311', 'request_id': 'req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:48.938864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9b63fe4a5a49b79a5172f01e8c8311', 'request_id': 'req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:48.951865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9b63fe4a5a49b79a5172f01e8c8311', 'request_id': 'req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:48.971087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] The token cache is being invalidate because project 3f9b63fe4a5a49b79a5172f01e8c8311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:48.971521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:48.973498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d653dbc-4a62-4d5c-bd2f-55d0ff28cbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:48.976292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1540/3047] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:48 2022] DELETE /identity/v3/projects/3f9b63fe4a5a49b79a5172f01e8c8311 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:48.986246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c449-4dcf-4e98-bf12-37ddfb407237 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.986697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c449-4dcf-4e98-bf12-37ddfb407237 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.987104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3c449-4dcf-4e98-bf12-37ddfb407237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.030370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f0e3c449-4dcf-4e98-bf12-37ddfb407237 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:49.036173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f0e3c449-4dcf-4e98-bf12-37ddfb407237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.079258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.080238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.080634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.080997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] PATH_INFO: `/v3/users/adbae035c5d24e7eb2d053a0fbd13f28` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.084423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbae035c5d24e7eb2d053a0fbd13f28)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:49.088873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:49.161766 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1541/3048] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:49.173799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.174920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.175842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.235840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:49.237469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.253649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbae035c5d24e7eb2d053a0fbd13f28'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:49.266650 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1542/3049] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:49.269508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:49.275560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbae035c5d24e7eb2d053a0fbd13f28'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:49.294463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbae035c5d24e7eb2d053a0fbd13f28'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:49.295995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ee71e-7829-44b8-be81-d2521743f4df None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:49.308112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.308803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.309086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.309368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.314403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:49.314734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:49.316408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44784b-8a31-4260-974d-1cfd6b2ba2c8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:49.335221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbae035c5d24e7eb2d053a0fbd13f28'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:49.336139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbae035c5d24e7eb2d053a0fbd13f28'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:49.348534 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1508/3050] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:48 2022] DELETE /identity/v3/users/adbae035c5d24e7eb2d053a0fbd13f28 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:49.357778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1543/3051] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:49.367829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.368208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.368492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.379340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:49.382803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.422072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:49.426850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.611479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e65b-29a3-46c0-8ed0-c11097152851 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:49.638854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.639730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.640106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.642572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.643386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:49.655307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:49.677353 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1544/3052] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:49.698505 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:49.727083 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1509/3053] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:49 2022] POST /identity/v3/projects => generated 377 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:49.731487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:49.741792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:49.745081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.746829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ad88c-bba2-4a23-8f2c-e963a0ed9d36 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:49.762280 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:49.894137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87f37-f634-4fad-824b-935b647c047f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:49.902156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.902934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.903289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.903634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.937057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:49.937812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:49.938103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:49.938381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.939105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:49.941054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:49.983311 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1545/3054] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:49 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:49.988237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:50.011029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfc62b-e20e-42ef-8b19-aec08fc4404d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:50.027388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:50.028113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:50.028403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:50.028684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:50.029470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:50.031726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:50.044851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:50.048142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:50.055245 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1546/3055] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:50.066671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:50.081163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db5470-2338-4f0c-affe-c10d079c6896 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:50.094771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:50.097795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:50.098031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:50.098322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:50.098634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1510/3056] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:50.099188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:50.103038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54e28a-1400-408d-a554-eca95e97c3da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:50.133277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1547/3057] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:50.134436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:50.165186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c7f01-917d-4573-8c70-29560e8ad630 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:50.188949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:50.192855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:50.196208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:50.198378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] PATH_INFO: `/v3/projects/eb233b56b3734747a1dc864cc7c84b1b/users/1d9ddb861cc146cda7dea654bc742c80/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:50.264672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb233b56b3734747a1dc864cc7c84b1b, user_id=1d9ddb861cc146cda7dea654bc742c80, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:50.268655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:50.301739 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1511/3058] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:50 2022] PUT /identity/v3/projects/eb233b56b3734747a1dc864cc7c84b1b/users/1d9ddb861cc146cda7dea654bc742c80/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:50.305958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:50.306406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:50.307240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:50.369513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:50.370778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:50.507068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1548/3059] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:50.557599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:50.652112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391695c-f25b-445d-9f13-6da80c06cfce admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:50.656478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:50.657344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:50.657632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:50.657953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:50.671351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:50.686712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:50.703701 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1512/3060] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:51.890306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:51.892709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:51.916295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba3afd-c280-4369-bdcc-88fbba50330d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:51.935384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:51.937117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:51.937648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:51.938360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] PATH_INFO: `/v3/projects/6023d0f8f7d4483585c0443676fce3e5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:51.940165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6023d0f8f7d4483585c0443676fce3e5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:51.942470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:52.048049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6023d0f8f7d4483585c0443676fce3e5', 'request_id': 'req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.071052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6023d0f8f7d4483585c0443676fce3e5', 'request_id': 'req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.085638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6023d0f8f7d4483585c0443676fce3e5', 'request_id': 'req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.104912 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:52.113194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] The token cache is being invalidate because project 6023d0f8f7d4483585c0443676fce3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:52.113790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.130275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.131968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1549/3061] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:51 2022] DELETE /identity/v3/projects/6023d0f8f7d4483585c0443676fce3e5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:52.136619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:52.149852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc68ce6-e9af-4513-8b93-16d0bebbca64 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:52.177343 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:52.226818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:52.228827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:52.229185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:52.229770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] PATH_INFO: `/v3/users/60b93ca2f2dc44ecbd199629537fd433` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:52.237867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b93ca2f2dc44ecbd199629537fd433)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:52.246856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:52.320202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b93ca2f2dc44ecbd199629537fd433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.331707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b93ca2f2dc44ecbd199629537fd433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.349830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b93ca2f2dc44ecbd199629537fd433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.368226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b93ca2f2dc44ecbd199629537fd433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.369082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b93ca2f2dc44ecbd199629537fd433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:52.382517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1513/3062] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:52 2022] DELETE /identity/v3/users/60b93ca2f2dc44ecbd199629537fd433 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:53.311663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:53.313138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:53.508824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fb79c-2ae9-4ab7-b3bb-926b55dd0dd1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:53.611451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:53.612735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:53.613155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:53.613690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:53.616788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:53.777185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:53.778886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78d147-9522-45e1-a194-8737da46bc1f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:53.800187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1550/3063] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:54.467588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:54.469120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:54.640955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d46bb-cdbd-4f99-9cf3-80c25bbe2773 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:54.648129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:54.649023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:54.649306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:54.649580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] PATH_INFO: `/v3/projects/62c19142f37447f89f9edd357efe0313` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:54.650941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c19142f37447f89f9edd357efe0313)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:54.653882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:54.785391 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:54.797322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c19142f37447f89f9edd357efe0313', 'request_id': 'req-d3ef7e67-09a8-4447-9dff-fb8918b0f327'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:54.816859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c19142f37447f89f9edd357efe0313', 'request_id': 'req-d3ef7e67-09a8-4447-9dff-fb8918b0f327'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:54.861040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c19142f37447f89f9edd357efe0313', 'request_id': 'req-d3ef7e67-09a8-4447-9dff-fb8918b0f327'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:54.896762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] The token cache is being invalidate because project 62c19142f37447f89f9edd357efe0313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:54.898466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:54.900596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3ef7e67-09a8-4447-9dff-fb8918b0f327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:54.904603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1514/3064] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:54 2022] DELETE /identity/v3/projects/62c19142f37447f89f9edd357efe0313 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:54.913554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:54.914455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:54.914929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:54.962996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:54.964290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:55.100560 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:55.237305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1551/3065] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:55.246298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.246567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.246849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.328809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:55.338862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:55.367501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1515/3066] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:55.368634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:55.396861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6130-d12e-4116-a6da-eb7bdc154791 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:55.415740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:55.416436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.416721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.416995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.417782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:55.418104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:55.419731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:55.459036 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1552/3067] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:55.464020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:55.477425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aa4c2-1967-401a-885a-e6ad03e8ed57 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:55.497171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:55.497891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.498178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.498456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.499162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:55.501815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:55.594327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1516/3068] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:55 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:55.598608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:55.612545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff869762-c159-40a2-bf83-c015ccbfc343 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:55.818942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:55.819642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.819922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.820199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.820907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:55.834277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:55.908666 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1553/3069] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:55 2022] POST /identity/v3/users => generated 296 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:55.911539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:55.927107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6dac0-71d5-493d-aa0d-64d94099683e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:55.941564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:55.945083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:55.945704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:55.946254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:55.947242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:55.949101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:55.987307 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1517/3070] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:55.988493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:56.003376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7782-dce8-4476-8eaa-d350df0f9773 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:56.014373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:56.016209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:56.016673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:56.017175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:56.018967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:56.020790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1a0f-9a8e-477b-aee3-e9f0c70a73e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:56.059680 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1554/3071] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:56.065481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:56.082355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b75d4f-9829-4fc6-94e5-98edb94c3566 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:56.095507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:56.096707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:56.097175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:56.097550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] PATH_INFO: `/v3/projects/8108854e56ae4763adc8b92e20fea723/users/d3ff3f6412d44e84b697d6baf677f8a3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:56.155239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8108854e56ae4763adc8b92e20fea723, user_id=d3ff3f6412d44e84b697d6baf677f8a3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:56.161249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:56.203175 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1518/3072] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:56 2022] PUT /identity/v3/projects/8108854e56ae4763adc8b92e20fea723/users/d3ff3f6412d44e84b697d6baf677f8a3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:56.205328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:56.205632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:56.205942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:56.275422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:56.276791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:56.455823 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1555/3073] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:56.522208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:56.524339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:56.636743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7935a11-f8da-4e1b-ba18-29716b0b387c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:56.641070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:56.641791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:56.642075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:56.642351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:56.667099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:56.668574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e29fc6-454b-4c6b-85db-50ae20386856 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:56.702158 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1519/3074] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:59.261210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:59.277232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2f37-287d-4de3-8ac8-9546324436ec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:59.284954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:59.286765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:59.287333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:59.287797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:59.290456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:59.305955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:59.308431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550333e-87a0-4bc2-a9a7-4a127c6fa06a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:59.320765 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1556/3075] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:59.881989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:59.882539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:59.882632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:59.965962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] MFA Rules not processed for user `db929a5c238a4cea9161fae69f637d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:59.967305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:00.157380 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:00.169946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1520/3076] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:00.182594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:00.183353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:00.184305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:00.234869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] MFA Rules not processed for user `735a3f7d7e454f14a7a4ed229affd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:00.236677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:00.300760 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:00.386354 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1557/3077] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:01.629972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:01.632262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:01.847946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bd119-e126-459e-91cb-e72a165c02aa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:01.862663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:01.863350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:01.863630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:01.863904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:01.865802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:01.888582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:01.890836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:01.917156 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1521/3078] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:04.088292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:04.113091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49901ffe-8ecd-4023-a6dc-3c793d8967d2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:04.143921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:04.151171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:04.151569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:04.151980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:04.159742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:04.200651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:04.203799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce107-48aa-406f-9cbc-f40ccc56283d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:04.227072 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1558/3079] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:11.906263 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=35 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:12.710854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:12.727846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758391dc-8f13-46ab-92cd-7d013a10a468 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:12.760402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:12.761372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:12.761841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:12.762273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:12.768193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:12.807854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:12.809725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288ed7-323b-47ad-bcef-53101801f153 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:12.857401 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1522/3080] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:14.229772 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=18 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:16.784094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.786082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.786553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.855337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] MFA Rules not processed for user `1d9ddb861cc146cda7dea654bc742c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:16.857358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:17.042235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382bad-f577-47d5-85d8-cddce4ba5d86 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.042851 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1559/3081] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:14:17.043353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382bad-f577-47d5-85d8-cddce4ba5d86 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.043879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382bad-f577-47d5-85d8-cddce4ba5d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.088619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4382bad-f577-47d5-85d8-cddce4ba5d86 None None] MFA Rules not processed for user `1d9ddb861cc146cda7dea654bc742c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:17.093454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4382bad-f577-47d5-85d8-cddce4ba5d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:17.115264 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1523/3082] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:14:17.269386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:17.271121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:17.316081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec57d91-62e8-4554-bcab-d0c54c63eacf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.325904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.327104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.327659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.328206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.342139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.345052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.361718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1560/3083] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:24.491650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:24.492167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:24.492510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:24.598962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] MFA Rules not processed for user `d3ff3f6412d44e84b697d6baf677f8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:24.601631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:24.956324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1524/3084] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:25.556240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:25.580807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5654cc-8b96-4edb-8672-13ff1c2d284f service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:25.599654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:25.600870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:25.600870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:25.601120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:25.615172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:25.616777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89abd7-4964-4c41-8366-a11c570d9c68 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:25.622721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:25.651100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd69bf4-5f64-4b91-a87d-021cd24d28e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:25.660017 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1561/3085] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:25.672296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:25.672967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:25.673269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:25.673522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:25.693716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:25.695335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfd924-69f8-4f4b-9fd3-3796fac506b7 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:25.714290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1525/3086] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:14:29.223067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:29.223967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:29.224409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:29.231807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1562/3087] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:14:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:14:29.238984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:29.240291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:29.240726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:29.269584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:29.271474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:29.469293 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1526/3088] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:29.499940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:29.501743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:29.529966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09e43-136a-4adb-9f88-8236da63086c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:29.542940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:29.543793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:29.544228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:29.547251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:29.606940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:29.609253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:29.647839 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1563/3089] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:29.986818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:30.004257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a9b8-fedf-495a-b77b-e07ef1261e18 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:30.053139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:30.058367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:30.058937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:30.060090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:30.069995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:30.089504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:30.095146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:30.120492 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1527/3090] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:30.168837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:30.189720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a998e-a0d6-4d35-8cb8-b346e893619d service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:30.205815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:30.207304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:30.208339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:30.210357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:30.217331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:30.255585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:30.258433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:30.329474 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1564/3091] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:30.333308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:30.334938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:30.368628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417fba6-3534-40bb-9252-9295edc27a41 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:30.400990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:30.402235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:30.403013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:30.403303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] PATH_INFO: `/v3/users/c1c7e27c899648168625087b1653df68` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:30.405552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c7e27c899648168625087b1653df68)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:30.409092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:30.531113 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:30.587441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c7e27c899648168625087b1653df68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:30.639161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c7e27c899648168625087b1653df68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:30.657005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c7e27c899648168625087b1653df68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:30.694492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c7e27c899648168625087b1653df68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:30.695840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-38cf0909-c77a-4428-a2b6-dc39cd2f4c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c7e27c899648168625087b1653df68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:30.706453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1528/3092] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:14:30 2022] DELETE /identity/v3/users/c1c7e27c899648168625087b1653df68 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:31.384733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:31.407383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2fa79-e2a0-40d6-b5d6-d17f9cedbcfb service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:31.580852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:31.582559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:31.583043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:31.593851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] PATH_INFO: `/v3/projects/ec53a779c92c4620a832da29e583581b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:31.596110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec53a779c92c4620a832da29e583581b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:31.603450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:31.690334 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:31.716443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec53a779c92c4620a832da29e583581b', 'request_id': 'req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:31.731740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec53a779c92c4620a832da29e583581b', 'request_id': 'req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:31.757101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec53a779c92c4620a832da29e583581b', 'request_id': 'req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:31.779965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] The token cache is being invalidate because project ec53a779c92c4620a832da29e583581b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:14:31.780569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:31.781477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cfc095d-4d9b-423d-9827-bbd8c0d975e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:31.783464 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1565/3093] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:14:31 2022] DELETE /identity/v3/projects/ec53a779c92c4620a832da29e583581b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:31.789541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:31.790100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:31.790197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:31.823275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:31.825015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:32.037860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1529/3094] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:32.047017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.047306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.047585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.090725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:32.095247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:32.121448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1566/3095] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:32.126672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.139558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49b413-e75c-4b33-89d0-c495735eb0bb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.149876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.151212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.151775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.152211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.153238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:14:32.153755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.156727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.172784 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1530/3096] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:14:32.177072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.188763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edb212-30c0-4a19-bb91-102524498479 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.201947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.203072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.203589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.204071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.205028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.207350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.264209 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1567/3097] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:14:32 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:32.265437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.281452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde3ba3-1457-4694-a8ed-152059bf7753 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.349630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.350955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.351450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.351933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.353006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.355867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.387232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1531/3098] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:14:32 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:32.391642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.406752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00dcf5-e5f6-43fb-83c3-a211b39e3126 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.413617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.415429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.415887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.416319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.417730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.421157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.462295 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1568/3099] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:14:32.463680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.481359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44582e-6ff8-4e98-9a35-f780863946ea admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.488752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.490393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.490923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.491434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.492805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.496519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43707884-5ed3-4031-856c-79d6c2a12697 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.522770 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1532/3100] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:14:32.524457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.536631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2ca91-c99f-41f9-8d21-bc542d31087a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:32.571022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:32.571958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.572245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.572529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] PATH_INFO: `/v3/projects/4cf11782d87a420bad0347bc2b2d5626/users/e0916fd6e6b145b2b002e3c880a3bda4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.634133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf11782d87a420bad0347bc2b2d5626, user_id=e0916fd6e6b145b2b002e3c880a3bda4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:32.637441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:32.668070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:32.668761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:32.669199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:32.672104 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1569/3101] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:14:32 2022] PUT /identity/v3/projects/4cf11782d87a420bad0347bc2b2d5626/users/e0916fd6e6b145b2b002e3c880a3bda4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:32.695802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:32.697069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:32.712847 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:32.897018 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1533/3102] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:32.968723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:32.970858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:33.207598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa5be8-a585-4cb2-a80a-a01938061514 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:33.211987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:33.212917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:33.214162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:33.214706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:33.231124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:33.235038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:33.251659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1570/3103] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:14:33.505019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:33.505019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:33.520808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897d92-9ef3-4383-be51-7c45f2e76df6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:33.525017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:33.525683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:33.526081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:33.526459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] PATH_INFO: `/v3/users/ab40062ec270461986a3dece91f0584c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:33.527812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab40062ec270461986a3dece91f0584c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:33.530817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:33.595326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab40062ec270461986a3dece91f0584c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:33.609257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab40062ec270461986a3dece91f0584c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:33.625462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab40062ec270461986a3dece91f0584c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:33.648696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab40062ec270461986a3dece91f0584c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:33.649834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50965034-1b46-4364-9878-10e62af5f89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab40062ec270461986a3dece91f0584c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:33.662215 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1534/3104] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:14:33 2022] DELETE /identity/v3/users/ab40062ec270461986a3dece91f0584c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:34.335771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:34.350731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9595900-19d2-4cf8-9710-d40193e2c0f6 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:34.481480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:34.482934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:34.483655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:34.484095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] PATH_INFO: `/v3/projects/86dcce798be5406685973e61c9014b0c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:34.485611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dcce798be5406685973e61c9014b0c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:34.487732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:34.509940 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:34.600638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dcce798be5406685973e61c9014b0c', 'request_id': 'req-fca0f4ba-6923-4055-8516-499802dcc800'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:34.609978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dcce798be5406685973e61c9014b0c', 'request_id': 'req-fca0f4ba-6923-4055-8516-499802dcc800'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:34.619571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dcce798be5406685973e61c9014b0c', 'request_id': 'req-fca0f4ba-6923-4055-8516-499802dcc800'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:34.639513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] The token cache is being invalidate because project 86dcce798be5406685973e61c9014b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:14:34.639795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:34.640531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fca0f4ba-6923-4055-8516-499802dcc800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:34.642571 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1571/3105] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:14:34 2022] DELETE /identity/v3/projects/86dcce798be5406685973e61c9014b0c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:34.650839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:34.651362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:34.651678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:34.680584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:34.682344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:34.760701 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1535/3106] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:34.768901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:34.769326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:34.770163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:34.820346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:34.821796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:34.830824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1572/3107] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:34.834933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:34.847526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33c617-d5b5-4d69-887b-a08d7fbe1848 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:34.853028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:34.853753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:34.854034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:34.854308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:34.855393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:14:34.855588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:34.858089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:34.877250 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1536/3108] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:14:34.878030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:34.895496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139abd-0b8c-4cb9-ae3f-e855321f15be None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:34.904534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:34.906023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:34.907185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:34.907712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:34.909869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:34.912533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:34.970239 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1573/3109] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:14:34 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:14:34.974533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:34.986785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d233f-c525-427e-8279-1a37d3279979 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:35.003462 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:35.061487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:35.062283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.062537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.062877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.063700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:35.065770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:35.105108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1537/3110] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:14:34 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:35.106461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:35.121601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936ad00-21f6-4d08-907a-ba3405d94c68 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:35.141057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:35.141910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.142140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.143208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.144047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:35.149239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:35.178525 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1574/3111] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:14:35.179086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:35.190622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600140b-e80a-49da-95c0-b49ae3f99d96 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:35.196295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:35.197021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.197303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.197579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.198435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:35.200098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829991-b5c4-4f5c-95bb-ded170182ed6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:35.212417 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1538/3112] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:14:35.218891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:35.234766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0b7e0-e4d4-4adb-87f8-bc2343f99dfb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:35.242291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:35.243698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.244297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.245098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] PATH_INFO: `/v3/projects/faa16a8779184f18afc0118c7581b9b9/users/3428b2650a774c998b63ed06114872b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.267837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa16a8779184f18afc0118c7581b9b9, user_id=3428b2650a774c998b63ed06114872b0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:35.271643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:35.295038 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1575/3113] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:14:35 2022] PUT /identity/v3/projects/faa16a8779184f18afc0118c7581b9b9/users/3428b2650a774c998b63ed06114872b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:35.297227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ad5c-2a93-4019-912d-47ad5c5c1553 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.297518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ad5c-2a93-4019-912d-47ad5c5c1553 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.297828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41ad5c-2a93-4019-912d-47ad5c5c1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.341985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8a41ad5c-2a93-4019-912d-47ad5c5c1553 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:35.343471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8a41ad5c-2a93-4019-912d-47ad5c5c1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:35.431242 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1539/3114] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:35.458022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:35.464246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:35.560919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56de3ac-4a6c-41a4-bbbc-c4a278fad2fa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:35.566729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:35.567936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:35.568668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:35.569183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:35.585032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:35.587274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:35.608155 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1576/3115] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:38.347171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:38.348046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:38.348521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:38.391355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] MFA Rules not processed for user `40b5fc3b4b6d43ab9342da568567140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:38.392737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:38.600786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1540/3116] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:45.596393 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:47.270876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:47.273137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:47.304720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d03ce-52ee-46c2-a060-f6096318559f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:47.318621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:47.319681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:47.320127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:47.320508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] PATH_INFO: `/v3/users/d3ff3f6412d44e84b697d6baf677f8a3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:47.327661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ff3f6412d44e84b697d6baf677f8a3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:47.333306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:47.502834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ff3f6412d44e84b697d6baf677f8a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:47.503658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ff3f6412d44e84b697d6baf677f8a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:47.527703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ff3f6412d44e84b697d6baf677f8a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:47.543217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ff3f6412d44e84b697d6baf677f8a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:47.566875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71bee7c1-3048-4706-aae6-e2d2d6bc5079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ff3f6412d44e84b697d6baf677f8a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:47.586829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1577/3117] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:14:47 2022] DELETE /identity/v3/users/d3ff3f6412d44e84b697d6baf677f8a3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:48.578723 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:48.644195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:48.658866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d583-6cf9-4793-a738-bb8edf4dbef5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:48.782582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:48.783552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:48.783839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:48.784117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] PATH_INFO: `/v3/projects/8108854e56ae4763adc8b92e20fea723` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:48.785469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8108854e56ae4763adc8b92e20fea723)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:48.801950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:48.892793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8108854e56ae4763adc8b92e20fea723', 'request_id': 'req-c80e3c24-8308-4211-8dad-915d93fbf70f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:48.911729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8108854e56ae4763adc8b92e20fea723', 'request_id': 'req-c80e3c24-8308-4211-8dad-915d93fbf70f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:48.935240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8108854e56ae4763adc8b92e20fea723', 'request_id': 'req-c80e3c24-8308-4211-8dad-915d93fbf70f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:48.958798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] The token cache is being invalidate because project 8108854e56ae4763adc8b92e20fea723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:14:48.959222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:48.960024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c80e3c24-8308-4211-8dad-915d93fbf70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:48.964980 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1541/3118] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:14:48 2022] DELETE /identity/v3/projects/8108854e56ae4763adc8b92e20fea723 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:48.967570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:48.968062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:48.968178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:48.997776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:48.999389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:49.112251 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1578/3119] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:49.121170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.121170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.121493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.159504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:49.160758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:49.179674 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1542/3120] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:49.183842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.208656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3839-9bc1-496f-8bef-4b4755b60e12 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.215389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.223398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.224438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.226040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.227757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:14:49.228948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.235007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:49.288028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1579/3121] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:14:49.288798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.304575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed41f8-723d-4ae4-907e-8f952afaa825 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.316949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.317868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.318715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.319818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.321089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.323948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:49.422830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.424736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1543/3122] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:14:49 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:49.443592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55479e4-19b8-4a84-a796-dc2ab0135c45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.696327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.698474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.701087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.702056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.704057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.711377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:49.733520 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:49.768602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.782204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1580/3123] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:14:49 2022] POST /identity/v3/users => generated 301 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:49.784501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec8c8-df60-4047-9915-aaea7fdcb9b6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.795655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.796689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.797149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.797644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.798592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.801049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:49.821961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.832876 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1544/3124] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:14:49.851213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2490-9257-49fd-b201-751edc154cbc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.866277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.868643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.868926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.869199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.870363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.871635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d54ea1-9eb5-402d-9dee-25eaa99df295 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:49.909499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:49.922609 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1581/3125] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:14:49.929705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2924f-c580-4e9b-9629-91976ed0d7bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:49.940087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:49.941110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:49.941645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:49.942179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] PATH_INFO: `/v3/projects/2b1d8c33b5254856bd1d395ca4ae080f/users/1c7c2b8076ac434d8bbf9aa4fe72facb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:49.962449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1d8c33b5254856bd1d395ca4ae080f, user_id=1c7c2b8076ac434d8bbf9aa4fe72facb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:49.966036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd01cf-84ef-4766-a25f-6ad23186a3c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:50.001717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1545/3126] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:14:49 2022] PUT /identity/v3/projects/2b1d8c33b5254856bd1d395ca4ae080f/users/1c7c2b8076ac434d8bbf9aa4fe72facb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:14:50.007451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:50.008497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:50.008936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:50.042640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:50.044827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:50.146192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec015f-03d6-48b0-b341-14799e32e137 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:50.146415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec015f-03d6-48b0-b341-14799e32e137 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:50.146695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec015f-03d6-48b0-b341-14799e32e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:50.155608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1582/3127] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:50.175565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b6ec015f-03d6-48b0-b341-14799e32e137 None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:50.177434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6ec015f-03d6-48b0-b341-14799e32e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:50.203760 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:50.254524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:50.255151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1546/3128] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:50.257050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:50.391970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218f3c-73df-448c-aff1-3e536825a79a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:50.400228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:50.401011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:50.401390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:50.401811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:50.415029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:50.416910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5b39f-24f8-4b6b-a289-1c2c70cf99f9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:50.438298 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1583/3129] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:53.620336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:53.620877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:53.621029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:53.708687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] MFA Rules not processed for user `e0916fd6e6b145b2b002e3c880a3bda4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:53.710398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:53.930326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d77-773b-4f8d-9ba2-bf5f00ab0cd7 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:53.930909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d77-773b-4f8d-9ba2-bf5f00ab0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:53.931012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d77-773b-4f8d-9ba2-bf5f00ab0cd7 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:53.932366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1584/3130] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:14:53.945947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:53.946241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:53.946523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:53.968867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1547/3131] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:53.988921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:53.990506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:54.082228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1585/3132] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 24 01:14:54.107459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:54.109251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:54.151149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffbc8-f3eb-442c-9564-bb43ef6c0e44 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:54.174579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:54.176335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:54.176659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:54.176989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:54.204309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:54.209395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4010d-15f9-4b93-8848-f98fe4284d9e service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:54.242594 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1548/3133] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:54.306079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:54.307848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:54.367516 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:54.562907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad3e7-430a-4d34-9c64-8a6171ddf91a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:54.588000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:54.593591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:54.593912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:54.594195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:54.624373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:54.629104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10cd3-ad37-4963-8c48-7d8ed3a316fe service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:54.664887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1586/3134] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:56.063231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682b99-32c0-448e-b1e7-1e9ffd7f5d9a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:56.064031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682b99-32c0-448e-b1e7-1e9ffd7f5d9a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:56.064031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3682b99-32c0-448e-b1e7-1e9ffd7f5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:56.140214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d3682b99-32c0-448e-b1e7-1e9ffd7f5d9a None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:56.140214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d3682b99-32c0-448e-b1e7-1e9ffd7f5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:56.178995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1549/3135] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:57.102400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:57.102400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:57.102400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:57.212829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] MFA Rules not processed for user `3428b2650a774c998b63ed06114872b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:57.215907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:57.558492 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1587/3136] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:57.568977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:57.569560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:57.569560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:57.662285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] MFA Rules not processed for user `3428b2650a774c998b63ed06114872b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:57.676048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:57.735345 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1550/3137] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:00.439122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:00.440953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:00.503255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a394df-3f1f-44a9-9021-26c0a916ca2c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:00.532354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:00.534301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:00.536260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:00.536553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:00.578835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:00.586773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:00.638298 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1588/3138] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:04.484120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:04.486437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:04.520975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f686129-344f-43cf-93fd-e37c67e0fb0a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:04.536961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:04.544474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:04.544962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:04.545470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] PATH_INFO: `/v3/users/1d9ddb861cc146cda7dea654bc742c80` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:04.547302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9ddb861cc146cda7dea654bc742c80)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:04.550406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:04.710518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9ddb861cc146cda7dea654bc742c80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:04.728156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9ddb861cc146cda7dea654bc742c80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:04.750732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9ddb861cc146cda7dea654bc742c80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:04.796669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9ddb861cc146cda7dea654bc742c80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:04.801501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4843cff-e732-4b27-b115-f30d56bb0074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9ddb861cc146cda7dea654bc742c80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:04.839914 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1551/3139] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:15:04 2022] DELETE /identity/v3/users/1d9ddb861cc146cda7dea654bc742c80 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:05.227979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:05.252255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf035168-8daf-4d07-9d85-2630cca046fe service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:05.398802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:05.400141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:05.400762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:05.401524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] PATH_INFO: `/v3/projects/eb233b56b3734747a1dc864cc7c84b1b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:05.403760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb233b56b3734747a1dc864cc7c84b1b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:05.406591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:05.468514 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:05.516914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb233b56b3734747a1dc864cc7c84b1b', 'request_id': 'req-ef6c9650-8ca6-4d85-addb-2ecd6d108575'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:05.531245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb233b56b3734747a1dc864cc7c84b1b', 'request_id': 'req-ef6c9650-8ca6-4d85-addb-2ecd6d108575'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:05.549309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb233b56b3734747a1dc864cc7c84b1b', 'request_id': 'req-ef6c9650-8ca6-4d85-addb-2ecd6d108575'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:05.570391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] The token cache is being invalidate because project eb233b56b3734747a1dc864cc7c84b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:05.570646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:05.571380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef6c9650-8ca6-4d85-addb-2ecd6d108575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:05.576888 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1589/3140] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:05 2022] DELETE /identity/v3/projects/eb233b56b3734747a1dc864cc7c84b1b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:05.579927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a58e-5839-4b8f-8622-d99558a7d094 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:05.580436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a58e-5839-4b8f-8622-d99558a7d094 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:05.580547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a58e-5839-4b8f-8622-d99558a7d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:05.605707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c2a0a58e-5839-4b8f-8622-d99558a7d094 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:05.607326 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:05.608395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c2a0a58e-5839-4b8f-8622-d99558a7d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:05.665418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:05.668677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:05.672551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:05.769085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] MFA Rules not processed for user `735a3f7d7e454f14a7a4ed229affd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:05.770561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:05.837201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1552/3141] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:05.846825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:05.860305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:05.860913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:05.909711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:05.911071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:05.927532 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1553/3142] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:05.931546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:05.944935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2426-afd0-4e6b-bedc-b479dd2d6a0e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:05.969386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:05.971471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:05.971754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:05.975504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:05.976406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:15:05.976722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:05.983560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:05.989036 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1590/3143] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:06.018702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1554/3144] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:15:06.024174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:06.054128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93aeda-1f74-46be-b182-bd4bcdcc06c7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:06.096377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:06.097333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.098494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.098494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.102667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:06.104719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:06.212988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1591/3145] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:15:06 2022] POST /identity/v3/projects => generated 399 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:06.215347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:06.248311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92077c2b-8642-44ca-b7cd-0db482bf8d75 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:06.398751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:06.399647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.399895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.400078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.400840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:06.403305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:06.442656 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1555/3146] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:15:06 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:15:06.447325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:06.467141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a801a-3c44-484d-b100-c87344f4599c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:06.480465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:06.484298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.484585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.484920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.488163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:06.490967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:06.525143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1592/3147] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:06.527526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:06.563392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cc320-bdd5-4aaf-93ca-19c613eb6fb4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:06.583053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:06.583773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.584040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.584311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.585074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:06.586969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2abdd-da20-46e7-a712-4c6623d81ace admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:06.612925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1556/3148] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:06.614617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:06.630938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052f5c-78af-4fab-b50a-00f2a5da6233 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:06.642328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:06.645835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.646231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.646520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] PATH_INFO: `/v3/projects/641ace3f76eb466ba57c3f42b8173978/users/5da455c083744e7c814e8638483ffffe/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.701700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641ace3f76eb466ba57c3f42b8173978, user_id=5da455c083744e7c814e8638483ffffe, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:06.704616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:06.748077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1593/3149] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:15:06 2022] PUT /identity/v3/projects/641ace3f76eb466ba57c3f42b8173978/users/5da455c083744e7c814e8638483ffffe/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:06.751228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8b7a-1990-4c9a-bd9d-03d8de628b9c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:06.751416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8b7a-1990-4c9a-bd9d-03d8de628b9c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:06.752444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8b7a-1990-4c9a-bd9d-03d8de628b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:06.843627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dbce8b7a-1990-4c9a-bd9d-03d8de628b9c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:06.847307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dbce8b7a-1990-4c9a-bd9d-03d8de628b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:07.054203 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1557/3150] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:07.079675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:07.081535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:07.260922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0fd81-c7ac-4263-8c07-8200e3471187 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:07.274342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:07.275284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:07.275818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:07.276329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:07.295539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:07.300834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:07.317815 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:07.333044 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1594/3151] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:14.416371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:14.417580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:14.419901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:14.462890 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:14.506813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] MFA Rules not processed for user `1c7c2b8076ac434d8bbf9aa4fe72facb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:14.510836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:14.682106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1558/3152] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:16.362911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:16.364376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:16.380378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b12816-07cc-4d4f-9d87-c9c5198ebf31 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:16.384843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:16.385507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:16.386098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:16.386540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:16.389739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:16.409561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:16.412509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2a17-58cb-4319-8fa7-6fd26423b886 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:16.432244 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1595/3153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:19.630639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:19.632805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:19.883779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6961c2-5211-4cd7-8b5a-67f23062abe3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:19.896259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:19.897266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:19.897799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:19.898369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:19.913875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:19.916822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8a76-0891-4823-aa4b-86e625ec580d service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:19.945360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1559/3154] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:26.422133 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:29.212779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:29.213999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:29.214528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:29.273426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] MFA Rules not processed for user `5da455c083744e7c814e8638483ffffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:29.274735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:29.429878 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1596/3155] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:29.440720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:29.441309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:29.441470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:29.512008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] MFA Rules not processed for user `5da455c083744e7c814e8638483ffffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:29.513485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:29.523308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1560/3156] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:30.279093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:30.285012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:30.308986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73aaaa-7a1b-449f-9aab-c11b4eea414a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:30.316091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:30.317276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:30.317760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:30.318205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:30.341222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:30.343835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:30.358620 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1597/3157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:31.389591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:31.391523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:31.413753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17631f-280d-4d90-80c2-832cc81eeafc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:31.426540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:31.427827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:31.429422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:31.431757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] PATH_INFO: `/v3/users/1c7c2b8076ac434d8bbf9aa4fe72facb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:31.433495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7c2b8076ac434d8bbf9aa4fe72facb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:31.437214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:31.592022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7c2b8076ac434d8bbf9aa4fe72facb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:31.612109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7c2b8076ac434d8bbf9aa4fe72facb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:31.641099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7c2b8076ac434d8bbf9aa4fe72facb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:31.656633 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:31.714701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7c2b8076ac434d8bbf9aa4fe72facb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:31.726171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fc294264-fcac-4eca-9192-11343cef2af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7c2b8076ac434d8bbf9aa4fe72facb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:31.751947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1561/3158] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:15:31 2022] DELETE /identity/v3/users/1c7c2b8076ac434d8bbf9aa4fe72facb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:32.240993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:32.346029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc27a7-0124-4048-9d27-0f1453506dc7 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:32.461357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:32.463374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:32.463912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:32.465007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] PATH_INFO: `/v3/projects/2b1d8c33b5254856bd1d395ca4ae080f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:32.467820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1d8c33b5254856bd1d395ca4ae080f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:32.470487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:32.624110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1d8c33b5254856bd1d395ca4ae080f', 'request_id': 'req-7e1518fc-f2cd-45f2-b1e2-615182127e96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:32.662836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1d8c33b5254856bd1d395ca4ae080f', 'request_id': 'req-7e1518fc-f2cd-45f2-b1e2-615182127e96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:32.678502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1d8c33b5254856bd1d395ca4ae080f', 'request_id': 'req-7e1518fc-f2cd-45f2-b1e2-615182127e96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:32.730675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] The token cache is being invalidate because project 2b1d8c33b5254856bd1d395ca4ae080f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:32.731183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:32.735260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7e1518fc-f2cd-45f2-b1e2-615182127e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:32.742484 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1598/3159] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:32 2022] DELETE /identity/v3/projects/2b1d8c33b5254856bd1d395ca4ae080f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:32.749827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:32.751320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:32.751997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:32.795519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:32.798081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:32.953512 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1562/3160] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:32.961880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:32.962330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:32.962777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:32.979360 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:32.989847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:32.992543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:33.006271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1599/3161] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:33.010025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.024241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce529-2b49-4ea7-bb77-55f4c0a39bdd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.030335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.033164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.033906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.034413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.035456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:15:33.036365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.038381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.145835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1563/3162] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:15:33.153288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.175884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077dcc3-dc89-4ed5-bb58-4add3444483e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.188900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.189600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.189914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.190379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.191285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.198422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.254164 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1600/3163] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:15:33 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:33.258640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.285984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c732fc-3c41-4bd2-848f-832e5b199582 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.451458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.452510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.452510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.452791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.453507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.455522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.492123 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1564/3164] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:15:33 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:33.498067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.513439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c3d4-2ffa-4e48-9872-e815d16c67b4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.522550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.524322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.525296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.530270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.535678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.538162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.566495 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1601/3165] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:33.568136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.592200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1939d-e406-46f1-86bb-885d9bf680ec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.599670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.600630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.600914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.601189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.601983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.603823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254091a-2fdc-4a9f-99b3-bf56ecc95b70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.621221 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1565/3166] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:33.625664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:33.637019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7841a9-5a9e-4c50-9a89-2c28dc4e2cc0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:33.645388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:33.646725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.647222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.647751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] PATH_INFO: `/v3/projects/8a078a3f8468439788ea2327659fb762/users/82276fe777fb4b08ac6baddf33d752ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.700517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a078a3f8468439788ea2327659fb762, user_id=82276fe777fb4b08ac6baddf33d752ab, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:33.703313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ebbb1-80b1-4136-bf8c-bf76986c7cc0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:33.730448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1602/3167] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:15:33 2022] PUT /identity/v3/projects/8a078a3f8468439788ea2327659fb762/users/82276fe777fb4b08ac6baddf33d752ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:33.742317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:33.743133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:33.743594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:33.807620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] MFA Rules not processed for user `82276fe777fb4b08ac6baddf33d752ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:33.811017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:33.938688 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:34.020026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1566/3168] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:34.031399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.032002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.032464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.070450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] MFA Rules not processed for user `82276fe777fb4b08ac6baddf33d752ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:34.071972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:34.085621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1603/3169] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:34.634412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:34.636530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:34.764422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143eea1-8e6b-42ed-a839-ffb32998381c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:34.770621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:34.771551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.772013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.772464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.784693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:34.787376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a2fb7-eca6-46e3-b97e-4adc721fa087 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:34.800947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1567/3170] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:43.451879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:43.452993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:43.455464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbf3-e41f-480a-a366-95d581cb7c47 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:43.455890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbf3-e41f-480a-a366-95d581cb7c47 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:43.456022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbf3-e41f-480a-a366-95d581cb7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:43.470288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7aff1-311a-47a5-9628-06c0ed8b4a99 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:43.484530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:43.485264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:43.485543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:43.486076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:43.488249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:43.491100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d14afbf3-e41f-480a-a366-95d581cb7c47 None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:43.492607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d14afbf3-e41f-480a-a366-95d581cb7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:43.566955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1568/3171] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:43.591544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:43.593160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109dce1-35fa-492f-bc13-155e995bc06e service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:43.604676 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1604/3172] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:46.783107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beff722-7b24-4aeb-9b3f-e088d88a4db6 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:46.784035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beff722-7b24-4aeb-9b3f-e088d88a4db6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:46.784480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beff722-7b24-4aeb-9b3f-e088d88a4db6 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:46.786982 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1569/3173] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:15:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:15:46.793935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:46.794884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:46.795778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:46.825829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:46.827468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:46.988116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1605/3174] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:15:47.015756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fbe-65fc-4325-b6ac-1043b84e061b None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:47.016279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fbe-65fc-4325-b6ac-1043b84e061b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:47.016789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fbe-65fc-4325-b6ac-1043b84e061b None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:47.019750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:47.019920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1570/3175] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:15:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:15:47.021848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:47.031313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:47.031441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:47.031999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:47.038998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236a43-cffa-4a7a-85a0-c7bb4ea27a23 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:47.046397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:47.047340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:47.048772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:47.049207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:47.057434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:47.060283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:47.060531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:47.062236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:47.072847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1571/3176] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:47.076868 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1606/3177] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:15:47.112613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:47.114660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:47.134846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c60c6-8fbe-445a-9e3a-d9031a1ce936 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:47.143374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:47.144037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:47.144322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:47.144599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:47.163219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:47.164825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:47.173065 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:47.190094 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1607/3178] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:48.124749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:48.127421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:48.273112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f045f6-3195-4837-8065-d6b690309b04 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:48.282430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:48.292906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:48.294414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:48.294703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:48.300524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:48.320411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:48.322832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:48.339571 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1572/3179] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:48.359267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:48.380183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa98d01-ecab-4a07-81fa-be2d9d70db0d service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:48.388887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:48.389940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:48.390543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:48.391041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:48.394298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:48.411284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:48.413741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:48.442194 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1608/3180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:50.718341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:50.720426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:50.744950 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:50.962733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5eb46-2287-4828-b3e7-9c537d64ee51 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:50.968636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:50.969630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:50.970077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:50.970518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] PATH_INFO: `/v3/users/e0916fd6e6b145b2b002e3c880a3bda4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:50.972023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0916fd6e6b145b2b002e3c880a3bda4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:50.974571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:51.045029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0916fd6e6b145b2b002e3c880a3bda4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.069714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0916fd6e6b145b2b002e3c880a3bda4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.083689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0916fd6e6b145b2b002e3c880a3bda4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.102087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0916fd6e6b145b2b002e3c880a3bda4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.103160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-791fb721-2f94-42d3-bf53-0b1fe143193a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0916fd6e6b145b2b002e3c880a3bda4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.115713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1573/3181] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:15:50 2022] DELETE /identity/v3/users/e0916fd6e6b145b2b002e3c880a3bda4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:51.605235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:51.646830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f141e-468c-4197-9222-ed189fc3a7b4 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:51.803913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:51.805068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:51.805520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:51.805998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] PATH_INFO: `/v3/projects/4cf11782d87a420bad0347bc2b2d5626` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:51.810697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf11782d87a420bad0347bc2b2d5626)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:51.812957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:51.911138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf11782d87a420bad0347bc2b2d5626', 'request_id': 'req-ecf02cca-246d-4fa9-a3a2-a50b679347f8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.920988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf11782d87a420bad0347bc2b2d5626', 'request_id': 'req-ecf02cca-246d-4fa9-a3a2-a50b679347f8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.942909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf11782d87a420bad0347bc2b2d5626', 'request_id': 'req-ecf02cca-246d-4fa9-a3a2-a50b679347f8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.957282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] The token cache is being invalidate because project 4cf11782d87a420bad0347bc2b2d5626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:51.957783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.958739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ecf02cca-246d-4fa9-a3a2-a50b679347f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:51.964781 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1609/3182] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:51 2022] DELETE /identity/v3/projects/4cf11782d87a420bad0347bc2b2d5626 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:51.967396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:51.967887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:51.967993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.007684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:52.008904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:52.065701 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.114004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1574/3183] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:52.116911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.117208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.117695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.147756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:52.149694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:52.169375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.173825 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1610/3184] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:52.187612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeca84-e088-4ca6-a47a-74c5c6ff590c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.187612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.187612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.187923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.188010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.189531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:15:52.189879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.191532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.219213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1575/3185] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:15:52.223676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.235192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd7bef-c1c8-4bb8-8108-74499bdbcc1a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.241083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.241968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.242398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.242914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.243605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.246845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.281878 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1611/3186] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:15:52 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:15:52.285943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.298257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6875-2728-4da5-aa58-10d1f3672c57 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.395469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.396436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.396606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.396955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.398336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.400432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.432942 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1576/3187] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:15:52 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:52.434611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.450310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adde6e4-2aee-43d3-81c8-52dfc9dae0d4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.455789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.456501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.456832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.457154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.458933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.460726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.478933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1612/3188] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:15:52.485258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.497054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c15ca-900c-4e2f-aa74-4a8322386268 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.506683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.509280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.509629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.510002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.511440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.512661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bb06f-c777-4e4e-9376-151f1e12bb46 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.527374 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1577/3189] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:52.532403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.548520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661914dc-8764-44df-b097-5762d216aec2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.556182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.558258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.558649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.559103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] PATH_INFO: `/v3/projects/59f19f4a68ce46019ac8f50a275b2d3d/users/cee3f1e6e5ba4185a4080a27d7c21702/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.581894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f19f4a68ce46019ac8f50a275b2d3d, user_id=cee3f1e6e5ba4185a4080a27d7c21702, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.584970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.607447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1613/3190] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:15:52 2022] PUT /identity/v3/projects/59f19f4a68ce46019ac8f50a275b2d3d/users/cee3f1e6e5ba4185a4080a27d7c21702/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:52.613657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.614094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.614470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.634075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:52.635502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:52.734706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1578/3191] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:52.746597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:52.749796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:52.764644 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:52.870400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8910a-05b5-4728-9922-808c482bcf4e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:52.879199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:52.879883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:52.880367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:52.880744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:52.893415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:52.894966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460132f-36be-4180-96ac-8a060a4bc8c0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:52.908646 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1614/3192] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:57.915689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:57.918505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:57.994329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fabb4-e7e4-4d15-8ef3-fae306e6cba3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:57.994878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fabb4-e7e4-4d15-8ef3-fae306e6cba3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:57.994878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fabb4-e7e4-4d15-8ef3-fae306e6cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:58.008647 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:58.092007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3a9fabb4-e7e4-4d15-8ef3-fae306e6cba3 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:58.093510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a9fabb4-e7e4-4d15-8ef3-fae306e6cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:58.109241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0a6d-cfaf-4925-a371-bf766856c175 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:58.160915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:58.161603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:58.161921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:58.162203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:58.174482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:58.227240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:58.229160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:58.281718 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1579/3193] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:58.318726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1615/3194] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:15:58.405512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:58.407119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:58.625255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f95d-ca56-449a-9a43-4693908b80cd service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:58.636940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:58.637624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:58.637938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:58.638214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:58.654334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:58.656130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:58.668665 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1580/3195] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:01.962363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de876-d5e4-4ef4-9ad4-a73f6f868e08 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:01.963259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de876-d5e4-4ef4-9ad4-a73f6f868e08 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:01.963692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695de876-d5e4-4ef4-9ad4-a73f6f868e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:02.012520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-695de876-d5e4-4ef4-9ad4-a73f6f868e08 None None] MFA Rules not processed for user `cee3f1e6e5ba4185a4080a27d7c21702`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:02.014722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-695de876-d5e4-4ef4-9ad4-a73f6f868e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:02.125064 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1616/3196] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:02.147082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:02.151362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:02.308158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a482-c4d0-4f87-aa84-bc010fa63657 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:02.333761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:02.334449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:02.334735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:02.335012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:02.346893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:02.349722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:02.382733 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1581/3197] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:03.981417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0af6-a641-40a8-88f2-fee6e688688a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:03.982657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0af6-a641-40a8-88f2-fee6e688688a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:03.983493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f0af6-a641-40a8-88f2-fee6e688688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:04.007189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-236f0af6-a641-40a8-88f2-fee6e688688a None None] MFA Rules not processed for user `cee3f1e6e5ba4185a4080a27d7c21702`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:04.008718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-236f0af6-a641-40a8-88f2-fee6e688688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:04.017711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1617/3198] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:12.377824 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:13.999625 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:16.707867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:16.732020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71bb93-de15-423e-ba67-fba139ea3fdf service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:16.745431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:16.751530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:16.752174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:16.752711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:16.755313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:16.779297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:16.782073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9234e65-3c82-4b18-8d28-2fa746f59b64 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:16.797942 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1582/3199] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:17.425783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7843-5088-444e-ae2b-63e1f6c5168f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:17.426414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7843-5088-444e-ae2b-63e1f6c5168f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:17.426414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e7843-5088-444e-ae2b-63e1f6c5168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:17.474268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e65e7843-5088-444e-ae2b-63e1f6c5168f None None] MFA Rules not processed for user `735a3f7d7e454f14a7a4ed229affd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:17.475645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e65e7843-5088-444e-ae2b-63e1f6c5168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:17.623368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1618/3200] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:16:21.223738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2167-9252-4a06-bc41-538b64af1a9f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:21.224344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2167-9252-4a06-bc41-538b64af1a9f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:21.224344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2167-9252-4a06-bc41-538b64af1a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:21.261182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b1d2167-9252-4a06-bc41-538b64af1a9f None None] MFA Rules not processed for user `3428b2650a774c998b63ed06114872b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:21.262684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b1d2167-9252-4a06-bc41-538b64af1a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:21.320408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:21.321114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:21.321114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:21.344524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:21.346058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:21.357169 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1619/3201] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:16:21.366737 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1583/3202] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:21.377534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:21.392543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1772d5-155b-4488-8bf7-0c426c92704b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:21.398550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:21.399652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:21.400277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:21.400780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:21.412158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:21.416190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0393-90e8-4fad-888c-bddbce8ba9e4 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:21.428372 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1620/3203] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:22.007852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afe5d-5bc7-4735-ac56-bffac0de4c7e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:22.008250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afe5d-5bc7-4735-ac56-bffac0de4c7e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:22.008630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afe5d-5bc7-4735-ac56-bffac0de4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:22.034437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f92afe5d-5bc7-4735-ac56-bffac0de4c7e None None] MFA Rules not processed for user `5da455c083744e7c814e8638483ffffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:22.036263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f92afe5d-5bc7-4735-ac56-bffac0de4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:22.138397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1584/3204] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:27.308966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f064-ad71-420e-9418-c17d63287d2b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:27.309524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f064-ad71-420e-9418-c17d63287d2b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:27.309524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f064-ad71-420e-9418-c17d63287d2b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:27.311461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1621/3205] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:16:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:16:27.318765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ea9e-36bc-4761-bd23-89b3ba8e8ca0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:27.319308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ea9e-36bc-4761-bd23-89b3ba8e8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:27.319308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ea9e-36bc-4761-bd23-89b3ba8e8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:27.358446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3c07ea9e-36bc-4761-bd23-89b3ba8e8ca0 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:27.359935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c07ea9e-36bc-4761-bd23-89b3ba8e8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:27.402948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1585/3206] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:27.419493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f064-ad71-420e-9418-c17d63287d2b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:27.433228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f064-ad71-420e-9418-c17d63287d2b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:27.447080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:27.453542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:27.466130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:27.473636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:27.504201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:27.506280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:27.537023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1622/3207] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:29.568737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b14e7-7b8f-488d-8f15-9f19985f81b3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:29.569274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b14e7-7b8f-488d-8f15-9f19985f81b3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:29.569525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b14e7-7b8f-488d-8f15-9f19985f81b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:29.608593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3b6b14e7-7b8f-488d-8f15-9f19985f81b3 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:29.610069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3b6b14e7-7b8f-488d-8f15-9f19985f81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:29.636060 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1586/3208] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:16:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 24 01:16:29.652704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:29.675917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf272-6738-42d3-9aea-5cc6d8d264d2 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:29.691434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:29.692261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:29.692835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:29.693219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:29.715566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:29.735202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ff8b-becc-41ff-9364-cb157c2e96e2 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:29.770173 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1623/3209] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:39.627569 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=65 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:39.754633 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=46 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:40.913376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:40.913977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:40.914125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:40.944776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] MFA Rules not processed for user `cee3f1e6e5ba4185a4080a27d7c21702`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:40.947070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:40.971466 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1587/3210] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:43.080083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15557-6988-4147-8e86-e7f8ebdcb7e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:43.080698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15557-6988-4147-8e86-e7f8ebdcb7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:43.080698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15557-6988-4147-8e86-e7f8ebdcb7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:43.121263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1de15557-6988-4147-8e86-e7f8ebdcb7e2 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:43.129554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1de15557-6988-4147-8e86-e7f8ebdcb7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:43.142233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1624/3211] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:43.156773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:43.189838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806d27-e48d-4322-87ad-d4abb0520ae9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:43.208479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:43.209776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:43.210245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:43.210873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:43.225913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:43.229053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:43.241953 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1588/3212] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:16:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:51.304157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed5953-a294-4d2b-8052-4267ec94d2db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:51.304666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed5953-a294-4d2b-8052-4267ec94d2db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:51.304758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed5953-a294-4d2b-8052-4267ec94d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:51.345400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8ed5953-a294-4d2b-8052-4267ec94d2db None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:51.346662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8ed5953-a294-4d2b-8052-4267ec94d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:51.357841 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1625/3213] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:51.373686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:51.390895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8a4a-b5a2-45fb-90dc-133edc2576b2 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:51.408235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:51.409639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:51.410233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:51.410700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:51.425129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:51.427801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:51.446787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1589/3214] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:16:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:16:57.916783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1be9-cf57-4d0e-bea8-109d5cd62dea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:57.917300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1be9-cf57-4d0e-bea8-109d5cd62dea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:57.917542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1be9-cf57-4d0e-bea8-109d5cd62dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:57.955251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-80ef1be9-cf57-4d0e-bea8-109d5cd62dea None None] MFA Rules not processed for user `5da455c083744e7c814e8638483ffffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:57.956613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80ef1be9-cf57-4d0e-bea8-109d5cd62dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:57.970183 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1626/3215] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:57.987326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:57.988925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:58.079137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f29df5-6b9e-477f-b27d-019348df5ee3 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:58.100490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:58.102375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:58.102710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:58.102988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] PATH_INFO: `/v3/users/82276fe777fb4b08ac6baddf33d752ab` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:58.108307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82276fe777fb4b08ac6baddf33d752ab)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:58.117190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:58.242793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82276fe777fb4b08ac6baddf33d752ab'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:58.278989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82276fe777fb4b08ac6baddf33d752ab'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:58.295604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82276fe777fb4b08ac6baddf33d752ab'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:58.321039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82276fe777fb4b08ac6baddf33d752ab'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:58.322508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82276fe777fb4b08ac6baddf33d752ab'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:58.334290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1590/3216] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:16:57 2022] DELETE /identity/v3/users/82276fe777fb4b08ac6baddf33d752ab => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:58.339507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:58.340051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:58.340507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:58.370307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:58.371845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:58.445746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1627/3217] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:58.466300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:58.469711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:58.639771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb7798-ba6b-4669-a810-c75ea8072601 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:58.645457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:58.646522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:58.646795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:58.647704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:58.659650 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:58.667820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:58.669556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57870-afed-44a9-8805-c528d45623cd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:58.686702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1591/3218] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:59.040081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.041811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:59.056587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd758c-8a75-4fdc-8e39-15d8eacb1102 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.062677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.063553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.063832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.064107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] PATH_INFO: `/v3/projects/8a078a3f8468439788ea2327659fb762` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.065331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a078a3f8468439788ea2327659fb762)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.067479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.131916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a078a3f8468439788ea2327659fb762', 'request_id': 'req-f202f05f-8eda-45e7-a515-3ac5d54e5053'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:59.138620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a078a3f8468439788ea2327659fb762', 'request_id': 'req-f202f05f-8eda-45e7-a515-3ac5d54e5053'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:59.148550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a078a3f8468439788ea2327659fb762', 'request_id': 'req-f202f05f-8eda-45e7-a515-3ac5d54e5053'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:59.161595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] The token cache is being invalidate because project 8a078a3f8468439788ea2327659fb762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:16:59.162268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:59.162602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f202f05f-8eda-45e7-a515-3ac5d54e5053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:59.164243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1628/3219] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:59 2022] DELETE /identity/v3/projects/8a078a3f8468439788ea2327659fb762 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:59.169641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.170730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.171015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.211066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:59.212560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:59.302908 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1592/3220] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:59.310975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.311801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.312356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.335016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:59.336694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:59.372654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1629/3221] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:59.377048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.417892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf4de-c986-4372-bd23-2489fd18f63d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.428049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.428758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.429045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.429389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.430259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:16:59.431060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.432289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.454630 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1593/3222] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:16:59.455816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.471046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408888bd-0b37-4572-9f65-fd9593dd8a70 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.478847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.480739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.481036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.481319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.482067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.484011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.535158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.559493 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1630/3223] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:16:59 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:16:59.564590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eba31-023d-4fcc-9398-fb0dc092e4cf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.673724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.674832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.674832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.675103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.675968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.678573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.725517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1594/3224] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:16:59 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:16:59.730248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.749058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f627ae9-1281-459b-919d-df8fc6ce72cb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.761544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.762338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.762636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.762909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.763684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.767078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.795608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1631/3225] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:16:59.799850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.825100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8b2f7-7146-43ca-b2b5-eaaa464d6560 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.830702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.831319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.831587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.831962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.833388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.835742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de5a62-6976-4a9e-a3fd-47881dffc13a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.848406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1595/3226] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:16:59.852845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:59.868650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf09c67-1f37-43db-9147-a33e71d8417e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:59.879318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:59.880253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.881169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.881452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] PATH_INFO: `/v3/projects/2bbddc1704b84539b5e602d6546ba743/users/af549d9da3ff44bfbf9760282e493426/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.922603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbddc1704b84539b5e602d6546ba743, user_id=af549d9da3ff44bfbf9760282e493426, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:59.926277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:59.929938 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:59.958061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:59.959282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:59.959702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:59.962150 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1632/3227] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:16:59 2022] PUT /identity/v3/projects/2bbddc1704b84539b5e602d6546ba743/users/af549d9da3ff44bfbf9760282e493426/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:59.998740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] MFA Rules not processed for user `af549d9da3ff44bfbf9760282e493426`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:00.005397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:00.048381 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:00.093199 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1596/3228] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:16:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:00.108975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:00.110964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:00.235110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57fb75-e051-4d91-9a68-fcd400ed4364 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:00.244509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:00.245169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:00.245597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:00.245927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:00.260988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:00.263004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:00.280703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1633/3229] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:17:00.983672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:01.080371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae992eb-7a1a-4dd3-9d96-e36fa21c5359 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:01.088591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:01.089762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:01.090052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:01.090372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] PATH_INFO: `/v3/users/af549d9da3ff44bfbf9760282e493426` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:01.092423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af549d9da3ff44bfbf9760282e493426)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:01.095983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:01.180099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:01.183205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:01.195849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af549d9da3ff44bfbf9760282e493426'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:01.214211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af549d9da3ff44bfbf9760282e493426'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:01.227554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af549d9da3ff44bfbf9760282e493426'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:01.246317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af549d9da3ff44bfbf9760282e493426'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:01.247713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1d2da341-4564-4bb3-bb13-36bc9bfb839f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af549d9da3ff44bfbf9760282e493426'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:01.254796 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1597/3230] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:00 2022] DELETE /identity/v3/users/af549d9da3ff44bfbf9760282e493426 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:01.259040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:01.260174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:01.260366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:01.263487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61adddd-c206-4c3d-bffb-2cdf7998ee1a service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:01.279207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:01.281289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:01.318698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:01.319497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:01.319781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:01.320054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:01.322764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:01.338954 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:01.363218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1598/3231] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:01.381270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:01.386238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:01.393090 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:01.400995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba1347-d6fe-41e3-b26d-5ecb67ef9d3d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:01.405500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:01.406188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:01.406815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:01.407107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:01.419268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:01.420828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d6c3-2f27-40e6-a244-d48c111e3766 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:01.432152 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1599/3232] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:01.437899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:01.439386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:01.451215 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1634/3233] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:02.016031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:02.016987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:02.017327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:02.039101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:02.040454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:02.133378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1600/3234] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:02.158475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:02.160063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:02.246941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5f2c-bdb1-4768-b234-3cd4d1d672ab service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:02.255703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:02.256886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:02.257397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:02.258121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:02.268732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:02.270426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae80e5f-77b8-4ad2-aa3f-955419ff36c0 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:02.282462 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1635/3235] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:02.562782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:02.565300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:02.605967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9448ca-441e-4e81-bb31-7cabdbe533e1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:02.637105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:02.639251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:02.642008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:02.643567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] PATH_INFO: `/v3/projects/2bbddc1704b84539b5e602d6546ba743` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:02.646325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbddc1704b84539b5e602d6546ba743)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:02.667079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:02.762451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbddc1704b84539b5e602d6546ba743', 'request_id': 'req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:02.769863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbddc1704b84539b5e602d6546ba743', 'request_id': 'req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:02.778455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbddc1704b84539b5e602d6546ba743', 'request_id': 'req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:02.801701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] The token cache is being invalidate because project 2bbddc1704b84539b5e602d6546ba743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:02.803748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:02.804697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c871ab8-e7be-4f5d-88e2-488b2c7b000b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:02.812357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1601/3236] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:02 2022] DELETE /identity/v3/projects/2bbddc1704b84539b5e602d6546ba743 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:02.818310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:02.818602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:02.818885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:02.857191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:02.858700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:02.940971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1636/3237] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:02.951542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:02.951840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:02.952122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:02.985012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:02.987357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:03.012613 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1602/3238] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:03.015232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.026375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c4b19-5e5c-4147-a8f0-86f73f8de448 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.035400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.036414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.036926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.037428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.038450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:03.039158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.042037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.058520 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1637/3239] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:03.062928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.078160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f040b7-df38-46e5-8df1-5a6d17c881d4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.084817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.086302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.088628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.089238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.090309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.093352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.159582 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1603/3240] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:03 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:03.163566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.174715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5aec-fbb1-453b-8dbc-af768d07ba82 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.220421 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:03.242100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.242783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.243067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.243594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.245392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.247849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.295929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.304067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1638/3241] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:03 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:03.310857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fe417-f5e0-45cd-9cbf-8c54f07c345f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.316641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.317555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.318073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.318659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.320360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.323890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.337640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1604/3242] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:03.342242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.353494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9433fb-15fb-4300-83fa-48b738e23428 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.364594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.365291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.365566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.366460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.366713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.368453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2e3e-dc63-4843-8785-d2478f1d7f56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.381461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1639/3243] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:03.386355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:03.396701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a28065-c139-492e-af10-971ab1b5b1d1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:03.403399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:03.404363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.404582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.404839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] PATH_INFO: `/v3/projects/58be8e29b7a844adafd15b55b50ca36d/users/f9bd5d6997fd4f61b74e823d75f3e9f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.422671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58be8e29b7a844adafd15b55b50ca36d, user_id=f9bd5d6997fd4f61b74e823d75f3e9f8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:03.426278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:03.458772 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1605/3244] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:03 2022] PUT /identity/v3/projects/58be8e29b7a844adafd15b55b50ca36d/users/f9bd5d6997fd4f61b74e823d75f3e9f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:03.459952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca3e9-b709-471c-897a-4a97519d2798 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:03.460302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca3e9-b709-471c-897a-4a97519d2798 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:03.460630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca3e9-b709-471c-897a-4a97519d2798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:03.521534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-afaca3e9-b709-471c-897a-4a97519d2798 None None] MFA Rules not processed for user `f9bd5d6997fd4f61b74e823d75f3e9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:03.523189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-afaca3e9-b709-471c-897a-4a97519d2798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:03.612512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1640/3245] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:04.929190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:04.931775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:04.939305 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:05.074974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a85c-af37-4fe4-9e44-ed0f8bac34f0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:05.082905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:05.084389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:05.084982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:05.096996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:05.131286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:05.133028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:05.160286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1606/3246] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:05.359591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98105-a295-4a12-a773-72759db57d8e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:05.360078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98105-a295-4a12-a773-72759db57d8e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:05.360184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98105-a295-4a12-a773-72759db57d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:05.393455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-08e98105-a295-4a12-a773-72759db57d8e None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:05.394753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08e98105-a295-4a12-a773-72759db57d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:05.539932 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1641/3247] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:09.177767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:09.285425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308d1-88c5-4e4a-b294-244cacef3b08 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:09.290888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:09.292958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:09.292958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:09.293436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] PATH_INFO: `/v3/users/f9bd5d6997fd4f61b74e823d75f3e9f8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:09.295178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9bd5d6997fd4f61b74e823d75f3e9f8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:09.297374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:09.384085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bd5d6997fd4f61b74e823d75f3e9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:09.406541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bd5d6997fd4f61b74e823d75f3e9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:09.418324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bd5d6997fd4f61b74e823d75f3e9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:09.449622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bd5d6997fd4f61b74e823d75f3e9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:09.450639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bd5d6997fd4f61b74e823d75f3e9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:09.459610 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1607/3248] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:09 2022] DELETE /identity/v3/users/f9bd5d6997fd4f61b74e823d75f3e9f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:09.464303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:09.465170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:09.465170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:09.488589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:09.490207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:09.585614 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:09.602587 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1642/3249] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:09.613782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:09.615600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:09.631778 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:09.694866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc308-766e-4b58-b990-d2a177cd11e5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:09.699166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:09.700143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:09.700426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:09.700697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:09.711546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:09.713249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd1591-62d8-457c-8aae-a55f9df31fa2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:09.724821 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1608/3250] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:10.219883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:10.222516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:10.242913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487ba3-9503-4559-862d-a01546f35d81 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:10.250311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:10.251463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.251983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.252422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] PATH_INFO: `/v3/projects/58be8e29b7a844adafd15b55b50ca36d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.254353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=58be8e29b7a844adafd15b55b50ca36d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:10.256579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:10.325203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58be8e29b7a844adafd15b55b50ca36d', 'request_id': 'req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:10.334721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58be8e29b7a844adafd15b55b50ca36d', 'request_id': 'req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:10.346210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58be8e29b7a844adafd15b55b50ca36d', 'request_id': 'req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:10.364780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] The token cache is being invalidate because project 58be8e29b7a844adafd15b55b50ca36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:10.365067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:10.366752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14a3d51f-6c12-46c4-b60c-3aa7c0ca69fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:10.368774 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1643/3251] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:10 2022] DELETE /identity/v3/projects/58be8e29b7a844adafd15b55b50ca36d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:10.373998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.374785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.375223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.403357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:10.404608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:10.485767 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1609/3252] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:10.491858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.493233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.494674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.518686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:10.520206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:10.542303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1644/3253] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:10.543185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:10.558980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5c3c3-fb4a-4b58-a85e-5089cb745305 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:10.564530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:10.565216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.565500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.565869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.567322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:10.567641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:10.571135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:10.596853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1610/3254] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:10.598110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:10.624560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0293e18-5ec1-44a7-92fb-5a7f89b2413f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:10.631195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:10.631794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.632078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.632357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.633072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:10.637606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:10.678866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1645/3255] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:10 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:17:10.682899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:10.713812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0f3e-6f99-4ea7-bb6b-cfe86c703355 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:10.909553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:10.910292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.910573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.910847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.911559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:10.917857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:10.961592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:10.961874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1611/3256] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:10 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:10.975211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86a97-17bf-4d10-81f0-63a5351a0f19 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:10.983629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:10.984803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:10.985256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:10.986163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:10.987690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:10.989309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:11.007656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1646/3257] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:17:11.012547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:11.027399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fac9a-e72e-4c33-b65c-3c950a601fc7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:11.032784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:11.033717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:11.034189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:11.035389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:11.036802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:11.039729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbe563-5f6a-446e-b0d6-6a61d50a3dec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:11.054742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1612/3258] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:11.059210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:11.070727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116c895-4df3-4571-b851-696c4abefbe5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:11.076887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:11.078095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:11.078846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:11.079325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] PATH_INFO: `/v3/projects/bf158623293e4d54b3201f00944210b2/users/256fc6648338427d83aeb6b6c9697877/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:11.102168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf158623293e4d54b3201f00944210b2, user_id=256fc6648338427d83aeb6b6c9697877, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:11.105148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:11.127233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1647/3259] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:11 2022] PUT /identity/v3/projects/bf158623293e4d54b3201f00944210b2/users/256fc6648338427d83aeb6b6c9697877/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:11.129150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:11.129496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:11.129866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:11.155825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:11.157785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:11.178637 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:11.281472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1613/3260] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:11.333597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:11.335516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:11.482914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7acac-3c20-4b66-a6ae-d70768607fa8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:11.515431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:11.522114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:11.522530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:11.526235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:11.560350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:11.562074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:11.582843 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1648/3261] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:13.543163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:13.544751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:13.567375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1acf8-41d5-4fb9-a949-a5fdf290d765 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:13.576270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:13.577169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:13.577448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:13.580030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] PATH_INFO: `/v3/users/40b5fc3b4b6d43ab9342da568567140d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:13.582459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b5fc3b4b6d43ab9342da568567140d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:13.584422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:13.681996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b5fc3b4b6d43ab9342da568567140d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:13.696137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b5fc3b4b6d43ab9342da568567140d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:13.708738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b5fc3b4b6d43ab9342da568567140d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:13.731599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b5fc3b4b6d43ab9342da568567140d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:13.731874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b5fc3b4b6d43ab9342da568567140d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:13.742131 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1614/3262] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:13 2022] DELETE /identity/v3/users/40b5fc3b4b6d43ab9342da568567140d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:14.278681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:14.294122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe52a0b-712a-48c0-8eb4-3030780f02d1 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:14.325956 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:14.499451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:14.502387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:14.516025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:14.517023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] PATH_INFO: `/v3/projects/58e5e52270c14573b0d4c868cb9fa69c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:14.524392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e5e52270c14573b0d4c868cb9fa69c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:14.528575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:14.614015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e5e52270c14573b0d4c868cb9fa69c', 'request_id': 'req-e0b4cf78-4942-4b71-8bea-1e2ee5814537'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.621019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e5e52270c14573b0d4c868cb9fa69c', 'request_id': 'req-e0b4cf78-4942-4b71-8bea-1e2ee5814537'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.632863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e5e52270c14573b0d4c868cb9fa69c', 'request_id': 'req-e0b4cf78-4942-4b71-8bea-1e2ee5814537'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.648030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] The token cache is being invalidate because project 58e5e52270c14573b0d4c868cb9fa69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:14.648700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.649614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.652869 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1649/3263] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:14 2022] DELETE /identity/v3/projects/58e5e52270c14573b0d4c868cb9fa69c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:14.657178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:14.658680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:14.673557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4b63-5cd9-40df-b69e-27ce1394e91c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:14.773789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:14.774851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:14.775752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:14.776042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] PATH_INFO: `/v3/users/725f3addf4524e98be4cccc41e75b63c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:14.780080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725f3addf4524e98be4cccc41e75b63c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:14.782298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:14.835782 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:14.871833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725f3addf4524e98be4cccc41e75b63c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.895918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725f3addf4524e98be4cccc41e75b63c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.918209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725f3addf4524e98be4cccc41e75b63c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.932641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725f3addf4524e98be4cccc41e75b63c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.934528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b957ce94-8c2f-43b0-bb54-3e8f020ab534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725f3addf4524e98be4cccc41e75b63c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:14.943558 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1615/3264] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:14 2022] DELETE /identity/v3/users/725f3addf4524e98be4cccc41e75b63c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:15.522779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:15.525302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:15.541623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cf78-4942-4b71-8bea-1e2ee5814537 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:15.701947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:15.701947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:15.701947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:15.701947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] PATH_INFO: `/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:15.702556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8b52c0d4d24bd0a8cdbc1c43216b31)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:15.703250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:15.808659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8b52c0d4d24bd0a8cdbc1c43216b31', 'request_id': 'req-40576d60-d3e5-4c94-864e-eff0d7172c09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:15.811792 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.836595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8b52c0d4d24bd0a8cdbc1c43216b31', 'request_id': 'req-40576d60-d3e5-4c94-864e-eff0d7172c09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:15.848937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8b52c0d4d24bd0a8cdbc1c43216b31', 'request_id': 'req-40576d60-d3e5-4c94-864e-eff0d7172c09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:15.870377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] The token cache is being invalidate because project 0a8b52c0d4d24bd0a8cdbc1c43216b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:15.870865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:15.872425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-40576d60-d3e5-4c94-864e-eff0d7172c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:15.878704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1650/3265] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:15 2022] DELETE /identity/v3/projects/0a8b52c0d4d24bd0a8cdbc1c43216b31 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:15.879676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:15.880218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:15.880218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:15.907319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:15.907831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:15.996606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1616/3266] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:16.004404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.004773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.005050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.028104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:16.029729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:16.045797 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1651/3267] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:16.048239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.085125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f56d1-fdf0-4762-98b2-f29aa7627544 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.102095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.103590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.104042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.104385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.105521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:16.106081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.110188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.152354 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1617/3268] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:16.158387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.174908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d192-1032-42fe-9678-9c89e166d3cd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.193381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.194430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.194880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.195463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.196388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.204316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.273282 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1652/3269] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:16 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:16.278575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.296985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7346a4-9d1e-42a6-af6e-90c062f63628 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.512675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.513387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.513705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.513964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.514674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.516641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.568620 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1618/3270] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:16 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:16.573152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.588775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c3221-a4ad-4180-bd16-5e99f1393f95 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.594536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.595482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.595926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.596837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.598086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.599867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.615713 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1653/3271] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:16.620488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.637999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a927cb9-d71c-48de-8fa6-1623e037276f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.652959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.653661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.653969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.654246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.655639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.657420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61279593-8eb8-475c-ac6a-a774eaab16fa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.693422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.693816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1619/3272] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:16.712775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f53408-b9d8-4fef-95f3-9feea7a00f54 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.738561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.738561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.738561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.738561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] PATH_INFO: `/v3/projects/08cb5ce8c4354541b492eb8cc8f89c3b/users/7033c900a87241779c10097a9c494e7b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.758430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cb5ce8c4354541b492eb8cc8f89c3b, user_id=7033c900a87241779c10097a9c494e7b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.764964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.784002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1654/3273] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:16 2022] PUT /identity/v3/projects/08cb5ce8c4354541b492eb8cc8f89c3b/users/7033c900a87241779c10097a9c494e7b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:16.795554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.795810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.796091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.869033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:16.875799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:16.886396 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:17.024126 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1620/3274] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:17.030319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.138467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93c9d9-a298-40e6-853f-3fcd9e8e38d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.144455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.145822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.146264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.146707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.147570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.150706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.202908 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1655/3275] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:17 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:17.206262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.224218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ba2a7-ced7-4153-bebc-2f3f5fc51ca4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.304406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.305181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.305546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.306263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.307197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.309266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.338001 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1621/3276] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:17 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:17.342184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.363627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8105-0629-45e3-a7de-bcd3e4c1c76a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.370534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.371352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.371745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.372126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.373856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.375888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.389655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1656/3277] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:17.393887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.408562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94f19-228d-426d-bed9-d21f209f7945 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.413590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.414578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.414860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.415782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] PATH_INFO: `/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8/users/9129b6000e674a49a47040b00a4d763d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.447362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824c3ea5105432dadfa9ea27f21b2f8, user_id=9129b6000e674a49a47040b00a4d763d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.451524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.480488 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1622/3278] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:17 2022] PUT /identity/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8/users/9129b6000e674a49a47040b00a4d763d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:17.484313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.498093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3739a8-cbe0-486b-823c-a86b4cd4aa9a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.612123 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:17.653433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.654419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.655606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.657518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.662664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.668533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed481af-b728-4b3e-bb3d-c72363b338e3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.704848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:17.705216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1657/3279] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:17.722144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a2bf4-706b-4906-a55b-9e30287335bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:17.734768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:17.737696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.738595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.739875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] PATH_INFO: `/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8/users/9129b6000e674a49a47040b00a4d763d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.743284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824c3ea5105432dadfa9ea27f21b2f8, user_id=9129b6000e674a49a47040b00a4d763d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:17.747108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badf85-052f-43f2-9b07-fbaf59de3f6e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:17.768200 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1623/3280] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:17 2022] PUT /identity/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8/users/9129b6000e674a49a47040b00a4d763d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:17:17.780989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.781599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.782103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.855405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] MFA Rules not processed for user `9129b6000e674a49a47040b00a4d763d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:17.858110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:17.958410 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1658/3281] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:17.969176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f29bd-1066-47c3-89fb-b52a13a6f823 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:17.969785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f29bd-1066-47c3-89fb-b52a13a6f823 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:17.969785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f29bd-1066-47c3-89fb-b52a13a6f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:17.989661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3c7f29bd-1066-47c3-89fb-b52a13a6f823 None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:17.991774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c7f29bd-1066-47c3-89fb-b52a13a6f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:18.082124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1624/3282] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:18.102522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:18.104788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:18.235380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1940-1196-42fd-9cc6-dc5f63eaf980 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:18.250640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:18.251332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:18.251625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:18.251909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:18.262075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:18.265132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:18.278257 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1659/3283] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:19.913542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ad2-3d14-4869-b023-883f83b1e9d0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:19.920272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ad2-3d14-4869-b023-883f83b1e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:19.920817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689ad2-3d14-4869-b023-883f83b1e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:19.929988 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:20.002927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-10689ad2-3d14-4869-b023-883f83b1e9d0 None None] MFA Rules not processed for user `256fc6648338427d83aeb6b6c9697877`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:20.005110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10689ad2-3d14-4869-b023-883f83b1e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:20.242832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1625/3284] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:20.313652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:20.317025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:20.358522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f216-20fe-4663-b5ac-b6e4ed7adaa1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:20.382750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:20.383694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:20.384131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:20.384718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:20.397307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:20.399442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:20.411189 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1660/3285] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:27.683746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:27.685157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:27.685441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:27.709058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] MFA Rules not processed for user `3428b2650a774c998b63ed06114872b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:27.710735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:27.801958 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1626/3286] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:30.405640 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:32.610893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:32.618598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:32.869917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589538b-27b7-4cf7-b924-4857e3da8e9e service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:32.875555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:32.876603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:32.876887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:32.877291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] PATH_INFO: `/v3/users/5da455c083744e7c814e8638483ffffe` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:32.878856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da455c083744e7c814e8638483ffffe)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:32.881941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:32.905685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:32.907361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:32.937618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c20e8-9c15-4851-a2f7-59b42cae26f5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:32.947656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:32.955805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:32.956563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:32.957097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] PATH_INFO: `/v3/users/cee3f1e6e5ba4185a4080a27d7c21702` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:32.966691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee3f1e6e5ba4185a4080a27d7c21702)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:32.974260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:33.006341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da455c083744e7c814e8638483ffffe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.008400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da455c083744e7c814e8638483ffffe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.023718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da455c083744e7c814e8638483ffffe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.046818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da455c083744e7c814e8638483ffffe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.081993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da455c083744e7c814e8638483ffffe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.093441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee3f1e6e5ba4185a4080a27d7c21702'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.105625 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1661/3287] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:32 2022] DELETE /identity/v3/users/5da455c083744e7c814e8638483ffffe => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:33.111432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee3f1e6e5ba4185a4080a27d7c21702'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.132437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee3f1e6e5ba4185a4080a27d7c21702'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.150162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee3f1e6e5ba4185a4080a27d7c21702'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.151353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee3f1e6e5ba4185a4080a27d7c21702'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:33.160803 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1627/3288] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:32 2022] DELETE /identity/v3/users/cee3f1e6e5ba4185a4080a27d7c21702 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:17:33.567108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:33.568756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:33.778016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867098c-eea8-4729-b2e1-4c432c21ddd5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:33.827321 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:33.882733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:33.885066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:33.887150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:33.889335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:33.889335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:33.889335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] PATH_INFO: `/v3/projects/641ace3f76eb466ba57c3f42b8173978` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:33.896419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641ace3f76eb466ba57c3f42b8173978)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:33.898463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:33.907569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59264cab-da12-4bb8-817b-d64c89a9117b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:33.924748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:33.925714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:33.926181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:33.926464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] PATH_INFO: `/v3/projects/59f19f4a68ce46019ac8f50a275b2d3d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:33.929081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f19f4a68ce46019ac8f50a275b2d3d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:33.939283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:33.949554 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:33.988300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641ace3f76eb466ba57c3f42b8173978', 'request_id': 'req-1ffa16bf-84fa-45d0-8225-193b294875d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.004884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641ace3f76eb466ba57c3f42b8173978', 'request_id': 'req-1ffa16bf-84fa-45d0-8225-193b294875d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.018593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641ace3f76eb466ba57c3f42b8173978', 'request_id': 'req-1ffa16bf-84fa-45d0-8225-193b294875d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.045194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] The token cache is being invalidate because project 641ace3f76eb466ba57c3f42b8173978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:34.045462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.045902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f19f4a68ce46019ac8f50a275b2d3d', 'request_id': 'req-f9a62070-7277-4859-913b-87e6528fdfb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.047538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ffa16bf-84fa-45d0-8225-193b294875d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.056536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1662/3289] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:33 2022] DELETE /identity/v3/projects/641ace3f76eb466ba57c3f42b8173978 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:34.060279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98200df-20d3-42e5-bb3a-bd1bc2784ad2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.060835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98200df-20d3-42e5-bb3a-bd1bc2784ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.061247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98200df-20d3-42e5-bb3a-bd1bc2784ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.082778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f19f4a68ce46019ac8f50a275b2d3d', 'request_id': 'req-f9a62070-7277-4859-913b-87e6528fdfb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.096660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f19f4a68ce46019ac8f50a275b2d3d', 'request_id': 'req-f9a62070-7277-4859-913b-87e6528fdfb6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.101206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b98200df-20d3-42e5-bb3a-bd1bc2784ad2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:34.104700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b98200df-20d3-42e5-bb3a-bd1bc2784ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:34.117324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] The token cache is being invalidate because project 59f19f4a68ce46019ac8f50a275b2d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:34.117930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.119043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f9a62070-7277-4859-913b-87e6528fdfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:34.122033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1628/3290] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:33 2022] DELETE /identity/v3/projects/59f19f4a68ce46019ac8f50a275b2d3d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:34.127263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1269dc-b081-48ff-808e-459c79c6cb36 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.128017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1269dc-b081-48ff-808e-459c79c6cb36 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.128017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1269dc-b081-48ff-808e-459c79c6cb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.184682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ae1269dc-b081-48ff-808e-459c79c6cb36 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:34.186317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ae1269dc-b081-48ff-808e-459c79c6cb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:34.289362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1663/3291] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:34.299136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.299431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.299715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.328807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:34.330968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:34.350805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1664/3292] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:34.356128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.376181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1240-0eed-45d5-8701-d5346e6459c9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.376554 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1629/3293] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:34.385307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.386145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.386627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.389931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.390998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.390998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.391184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.391895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:34.392201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.396079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.427856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:34.429154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:34.434859 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1665/3294] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:34.439640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.445408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1630/3295] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:34.449525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.461219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caff9a-f863-4479-8d36-bb0d1092b2ad admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.464998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b29091-4ebc-42dd-856d-d4345be9ddf0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.468514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.470495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.471166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.471463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.472388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.476022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.478129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.480038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.480877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.481649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.484062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:34.486087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.490137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.526484 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1666/3296] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:34.531107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.532972 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1631/3297] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:17:34.537552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.565842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a176fd-eb8b-4a26-b933-29624fe193aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.579379 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.704876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0088a4-ce04-4ec7-9bae-eb42bda64e36 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.722964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.723400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.723687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.723965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.728148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.739033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.747833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.748497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.748783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.749063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.749816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.751800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.785917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1667/3298] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:17:34.787615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.794437 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.808369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1632/3299] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:34.809318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.831677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb2d5-2ab3-4afa-9fc1-4a8fa18e5df0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.970123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.970772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.971097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.971380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.972253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.973877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.984682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7433947-37de-485e-be77-c048faef7d60 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.017283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.018449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.018738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.019018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.019745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.022923 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1668/3300] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:35.023902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.027177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.049166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b7270-dcab-4bed-88e2-43a611f389c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.061814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.062564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.062922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.063324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.064009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.066678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.082960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1633/3301] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:34 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:35.087794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.101632 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1669/3302] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:35.103995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.123604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bad2e-b3fc-4081-8d6d-fe1c6150c575 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.136377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c157cc6-aed6-4d4a-a89e-bd942c9f5abe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.143009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.144462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.144747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.145050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] PATH_INFO: `/v3/projects/9f3d51dfae8346b5b0756ce610b0a7c8/users/943cc5b6e7b441ce81c6e87d6c9205a4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.147360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.148158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.148615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.149006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.150684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.154413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.172006 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1634/3303] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:35.174902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3d51dfae8346b5b0756ce610b0a7c8, user_id=943cc5b6e7b441ce81c6e87d6c9205a4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.178136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.178245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6f8d-4e80-4c1f-8a9a-c0e1541ee332 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.197530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01448891-5862-4cca-a3e5-31d5b60bad1b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.198820 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1670/3304] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:35 2022] PUT /identity/v3/projects/9f3d51dfae8346b5b0756ce610b0a7c8/users/943cc5b6e7b441ce81c6e87d6c9205a4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:35.210731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.211220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.211595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.249927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] MFA Rules not processed for user `943cc5b6e7b441ce81c6e87d6c9205a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:35.251298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.357860 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:35.393764 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1671/3305] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:35.394011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.395694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.395984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.396950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.397171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.399282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d131c-653c-4bf6-832c-89a57e7ae8b0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.422328 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1635/3306] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:35.427042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.447851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100c937-d845-46fc-98b8-6716cb50d76a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.454094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.455858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.456156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.456388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] PATH_INFO: `/v3/projects/90bf9b4eea0b4c43bbd2d44888e13f77/users/b2c41e924f694c789952302d70e75efd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.478298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bf9b4eea0b4c43bbd2d44888e13f77, user_id=b2c41e924f694c789952302d70e75efd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.481010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.523362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1672/3307] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:35 2022] PUT /identity/v3/projects/90bf9b4eea0b4c43bbd2d44888e13f77/users/b2c41e924f694c789952302d70e75efd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:35.529337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.536410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.536584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.546611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.547966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.583043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:35.584416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.653015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c622e-d941-41db-99e6-e64a3f0bb4de admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.660382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.661465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.661850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.662252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.710087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1636/3308] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:35.736930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.742578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.745644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.747760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.760078 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1673/3309] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:35.763574 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:35.833014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:35.844553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1453590-7d18-4fc2-8167-4498f30d0ec1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.851782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.853428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.853744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.854020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.856232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.857874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740022-0d28-45e3-843e-d23c89f49523 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:35.862768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:35.864372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.882727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.882727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.927324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.928962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:35.951490 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1637/3310] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:35.985726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:35.988359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b94a-6842-4855-9792-519fdb0df86d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:36.017084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1674/3311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:17:36.152391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:36.163034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a57f46-8174-4d71-a9a3-eee398d91188 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:36.169432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:36.170367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:36.170797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:36.171114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] PATH_INFO: `/v3/users/943cc5b6e7b441ce81c6e87d6c9205a4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:36.172366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=943cc5b6e7b441ce81c6e87d6c9205a4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:36.175273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:36.234041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943cc5b6e7b441ce81c6e87d6c9205a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:36.245091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943cc5b6e7b441ce81c6e87d6c9205a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:36.255667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943cc5b6e7b441ce81c6e87d6c9205a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:36.271917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943cc5b6e7b441ce81c6e87d6c9205a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:36.276580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943cc5b6e7b441ce81c6e87d6c9205a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:36.301255 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1638/3312] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:36 2022] DELETE /identity/v3/users/943cc5b6e7b441ce81c6e87d6c9205a4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:36.303149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5900d-35ec-43fc-9621-843bb500ddb2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:36.303355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5900d-35ec-43fc-9621-843bb500ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:36.303633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5900d-35ec-43fc-9621-843bb500ddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:36.309894 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:36.326185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-70f5900d-35ec-43fc-9621-843bb500ddb2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:36.327737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70f5900d-35ec-43fc-9621-843bb500ddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:36.467914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1675/3313] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:36.485974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:36.487656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:36.604817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d249f5-0d8a-4be8-8b64-0b662ae7dcec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:36.612099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:36.613152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:36.614222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:36.615402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:36.630066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:36.632965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:36.649305 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1639/3314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:36.842353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:36.842919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:36.843334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:36.870347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:36.878156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:36.974783 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1676/3315] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:37.096858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:37.098999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:37.126167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65e70c-899c-4bc3-9782-af0cac72a32c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:37.139081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:37.140035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.140465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.140792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] PATH_INFO: `/v3/users/256fc6648338427d83aeb6b6c9697877` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.142344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256fc6648338427d83aeb6b6c9697877)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:37.144707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:37.210111 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:37.263554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256fc6648338427d83aeb6b6c9697877'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.278554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256fc6648338427d83aeb6b6c9697877'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.293246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256fc6648338427d83aeb6b6c9697877'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.313843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256fc6648338427d83aeb6b6c9697877'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.314739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256fc6648338427d83aeb6b6c9697877'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.330219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1640/3316] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:37 2022] DELETE /identity/v3/users/256fc6648338427d83aeb6b6c9697877 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:37.517868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:37.520054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:37.563662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a7155-f1d6-4553-a8e1-094ae9325b15 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:37.703037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:37.704198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.704492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.705946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] PATH_INFO: `/v3/projects/9f3d51dfae8346b5b0756ce610b0a7c8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.710430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:37.712759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:37.714091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3d51dfae8346b5b0756ce610b0a7c8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:37.716217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:37.736355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed1ea-e2ad-41da-bd9a-77bf636435a4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:37.749284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:37.750293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.750587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.750865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] PATH_INFO: `/v3/projects/bf158623293e4d54b3201f00944210b2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.754440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf158623293e4d54b3201f00944210b2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:37.756702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:37.791488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3d51dfae8346b5b0756ce610b0a7c8', 'request_id': 'req-db6fb673-1a21-4074-a94e-8949ed84723a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.793376 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:37.805821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3d51dfae8346b5b0756ce610b0a7c8', 'request_id': 'req-db6fb673-1a21-4074-a94e-8949ed84723a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.816940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3d51dfae8346b5b0756ce610b0a7c8', 'request_id': 'req-db6fb673-1a21-4074-a94e-8949ed84723a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.843835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] The token cache is being invalidate because project 9f3d51dfae8346b5b0756ce610b0a7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:37.844451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.846839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db6fb673-1a21-4074-a94e-8949ed84723a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.849009 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1677/3317] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:37 2022] DELETE /identity/v3/projects/9f3d51dfae8346b5b0756ce610b0a7c8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:37.855526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2d49-75fa-41b1-954a-6f0ad3b736ae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.855970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2d49-75fa-41b1-954a-6f0ad3b736ae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.856751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc2d49-75fa-41b1-954a-6f0ad3b736ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.863555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf158623293e4d54b3201f00944210b2', 'request_id': 'req-ebcff39c-c195-42e2-8504-b0ef7e2a292d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.871629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf158623293e4d54b3201f00944210b2', 'request_id': 'req-ebcff39c-c195-42e2-8504-b0ef7e2a292d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.879866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2dfc2d49-75fa-41b1-954a-6f0ad3b736ae None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:37.881599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dfc2d49-75fa-41b1-954a-6f0ad3b736ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:37.881732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf158623293e4d54b3201f00944210b2', 'request_id': 'req-ebcff39c-c195-42e2-8504-b0ef7e2a292d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.906842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] The token cache is being invalidate because project bf158623293e4d54b3201f00944210b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:37.907144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.908047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ebcff39c-c195-42e2-8504-b0ef7e2a292d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:37.910350 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1641/3318] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:37 2022] DELETE /identity/v3/projects/bf158623293e4d54b3201f00944210b2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:17:37.916380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ff46-1b87-4d8c-9f94-2b65c2390629 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.916676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ff46-1b87-4d8c-9f94-2b65c2390629 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.916973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ff46-1b87-4d8c-9f94-2b65c2390629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.963369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fef2ff46-1b87-4d8c-9f94-2b65c2390629 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:37.966467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fef2ff46-1b87-4d8c-9f94-2b65c2390629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:37.973172 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1678/3319] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:37.988012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:37.988012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:37.988012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:37.997375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1642/3320] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:38.005577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.006622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.007612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.050075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:38.051572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:38.063382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:38.065240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:38.067433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1679/3321] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:38.078633 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1643/3322] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:38.078911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.079558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.100167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f566e-0341-4989-bb41-9227a1b84b92 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.105324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e73a9-70ee-47b8-97fd-027a05d30ba4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.110387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.111798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.112097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.112490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.113289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:38.113703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.118721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.122137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.123420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.123707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.124005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.125537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:38.125537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.127430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.145297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1644/3323] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:38.146535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.166121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f577b-50f4-42c4-af0b-f6a56be51914 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.179373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.181737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.182067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.182366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.182645 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1680/3324] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:38.183102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.186245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.193814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.212156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11d9f-4cd3-40de-93a1-5b7fe19128ca admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.218518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.219144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.219472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.219817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.220676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.222902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.245791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1645/3325] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:38.254075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.281447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1681/3326] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:38.286552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.456421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7711310-97a8-41ad-95d3-f5913192066d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.473105 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:38.484525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.485654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.485968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.486251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.490873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.503262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.583005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9649280-3881-4e93-90fe-4b2cb53e300c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.599315 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1682/3327] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/users => generated 299 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:17:38.600294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.610930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.611652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.612095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.613128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.620491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.622535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.635845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d033e2a-cf83-45b9-af3c-0b9145995edf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.653636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.654353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.654629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.654907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.655649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.657384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.672236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1646/3328] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/users => generated 294 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:38.677028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.684801 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1683/3329] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:38.688951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.699081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356355c0-6097-4389-bf9f-3df6027564d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.705577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.706291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.706596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.706832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.707636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.709360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.714170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e494-972b-4007-961e-fb207e954a72 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.732255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.732255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.732255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.732255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.732695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1647/3330] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:38.732789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.733340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.735301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.769177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1684/3331] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:38.772845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.776546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ce1fe-1dd9-4e01-b63a-0e418de269cc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.787601 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:38.799851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.803435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.804164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.805741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.806180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63e6b9-095c-4fa7-9a28-8c996057e9ed admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.809021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.812925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.818485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.819641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.820016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.820388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] PATH_INFO: `/v3/projects/a2eccf3ec34c4f978207110d7f2114d5/users/a656fbb600454a9a9916116092a26b24/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.853338 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1648/3332] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:38.861013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:38.866395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2eccf3ec34c4f978207110d7f2114d5, user_id=a656fbb600454a9a9916116092a26b24, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.872493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1051f7-5337-40f0-8519-694fa826317a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.880952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93edf7-0178-4474-99eb-634e1ebd90b6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:38.896464 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1685/3333] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:38 2022] PUT /identity/v3/projects/a2eccf3ec34c4f978207110d7f2114d5/users/a656fbb600454a9a9916116092a26b24/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:38.896977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:38.899808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.900407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.900784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] PATH_INFO: `/v3/projects/97fbef19413a4054aa808c676248fd27/users/c6d333d036f74225bf1afd3d36d8e339/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.912969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.913255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.913525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:38.936777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fbef19413a4054aa808c676248fd27, user_id=c6d333d036f74225bf1afd3d36d8e339, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:38.940574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139615d0-49bf-4a94-9147-953b33c7006a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:38.960350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] MFA Rules not processed for user `a656fbb600454a9a9916116092a26b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:38.961970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:38.972790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1649/3334] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:38 2022] PUT /identity/v3/projects/97fbef19413a4054aa808c676248fd27/users/c6d333d036f74225bf1afd3d36d8e339/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:17:38.974759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:38.975053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:38.975333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:39.015972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:39.017020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:39.092099 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1686/3335] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:39.101324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:39.103947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:39.183635 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1650/3336] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:39.190027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:39.194053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:39.218061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335ea30-8586-4b98-8917-0d518146d2f5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:39.226511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:39.228029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:39.228392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:39.228812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:39.240344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:39.242326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a1d9-c682-42cb-8282-820de525c6aa service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:39.255892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1687/3337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:39.342206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac19a-4ae7-4958-8d1b-43171eed4ff2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:39.354453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:39.355144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:39.355427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:39.355702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:39.376329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:39.378378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:39.414004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7b61-9fcf-428d-a8bd-fca12b5a9ecd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:39.415595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7b61-9fcf-428d-a8bd-fca12b5a9ecd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:39.416150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb7b61-9fcf-428d-a8bd-fca12b5a9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:39.440985 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1651/3338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:17:39.457800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-35eb7b61-9fcf-428d-a8bd-fca12b5a9ecd None None] MFA Rules not processed for user `a656fbb600454a9a9916116092a26b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:39.461032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-35eb7b61-9fcf-428d-a8bd-fca12b5a9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:39.490476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1688/3339] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:40.122751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:40.147582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63db1-f4a0-4e88-b9a7-ea717e628740 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:40.156449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:40.158965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:40.159600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:40.160326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] PATH_INFO: `/v3/users/a656fbb600454a9a9916116092a26b24` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:40.162065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a656fbb600454a9a9916116092a26b24)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:40.165911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:40.199463 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:40.275603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a656fbb600454a9a9916116092a26b24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:40.291304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a656fbb600454a9a9916116092a26b24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:40.312968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a656fbb600454a9a9916116092a26b24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:40.352380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a656fbb600454a9a9916116092a26b24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:40.354349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a656fbb600454a9a9916116092a26b24'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:40.380652 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1652/3340] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:40 2022] DELETE /identity/v3/users/a656fbb600454a9a9916116092a26b24 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:40.386069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:40.386589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:40.386697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:40.421111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:40.425997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:40.572223 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:40.607703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1689/3341] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:40.623965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:40.625612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:40.750921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45f50-e6eb-4415-a527-8096670d2c5c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:40.763903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:40.764842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:40.765340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:40.766351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:40.778831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:40.780576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0294b-8c83-47db-9f6d-828c65ef6bf7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:40.794700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1653/3342] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:41.404769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:41.406855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:41.447891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad31f8-4420-4ad3-a658-d6d0d985d947 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:41.455535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:41.457054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.457571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.458018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] PATH_INFO: `/v3/projects/a2eccf3ec34c4f978207110d7f2114d5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.460854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2eccf3ec34c4f978207110d7f2114d5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:41.463590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:41.574596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2eccf3ec34c4f978207110d7f2114d5', 'request_id': 'req-175cf178-3d05-4403-80bc-d9545697fc9e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:41.582784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2eccf3ec34c4f978207110d7f2114d5', 'request_id': 'req-175cf178-3d05-4403-80bc-d9545697fc9e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:41.598862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2eccf3ec34c4f978207110d7f2114d5', 'request_id': 'req-175cf178-3d05-4403-80bc-d9545697fc9e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:41.621620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] The token cache is being invalidate because project a2eccf3ec34c4f978207110d7f2114d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:41.621910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:41.622788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-175cf178-3d05-4403-80bc-d9545697fc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:41.630368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1690/3343] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:41 2022] DELETE /identity/v3/projects/a2eccf3ec34c4f978207110d7f2114d5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:41.630899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.631388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.631460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.652630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:41.653878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:41.736014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1654/3344] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:41.746673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.747102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.747482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.776740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:41.778333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:41.792168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1691/3345] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:41.793089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:41.803375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4526e29-0786-44f1-b80b-a11d59d9a575 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:41.809741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:41.810413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.810698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.810976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.811719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:41.812023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:41.813872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:41.829734 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1655/3346] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:41.833655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:41.845301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b76a-ee4c-46cb-8874-c5c7580e1401 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:41.851054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:41.851824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.853061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.855282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.855282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:41.856308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:41.889847 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1692/3347] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:41 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:41.893562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:41.907244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257bc39-0914-48d0-a34b-d80cbd8bc15f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:41.947873 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:41.991873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:41.994429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:41.994977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:41.995405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:41.996502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:41.998755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:42.033210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1656/3348] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:41 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:17:42.033934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:42.049502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232308ba-5606-4e90-a8ce-dbaeeeb9d9eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:42.059972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:42.060753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:42.061038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:42.061399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:42.062280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:42.064175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:42.080856 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1693/3349] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:42.085460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:42.104068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5524-2733-4940-9a9c-605377916f61 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:42.111192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:42.111900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:42.112183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:42.112459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:42.113482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:42.115854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff88bfa-2aab-4b08-9dcf-64227d6437d2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:42.136666 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1657/3350] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:42.137483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:42.148847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83f15-db99-41bc-8806-bbad3802f6f9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:42.155813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:42.156623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:42.157513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:42.157513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] PATH_INFO: `/v3/projects/56e7d7a1fe6f443181cd70ef18a84c83/users/6f643b01bb934b4ebacc4548721dba25/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:42.192274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e7d7a1fe6f443181cd70ef18a84c83, user_id=6f643b01bb934b4ebacc4548721dba25, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:42.197353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:42.219729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1694/3351] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:42 2022] PUT /identity/v3/projects/56e7d7a1fe6f443181cd70ef18a84c83/users/6f643b01bb934b4ebacc4548721dba25/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:42.227544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f735-a182-4538-9344-4e034fc8dfa2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:42.229200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f735-a182-4538-9344-4e034fc8dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:42.229497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262f735-a182-4538-9344-4e034fc8dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:42.250849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b262f735-a182-4538-9344-4e034fc8dfa2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:42.251947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b262f735-a182-4538-9344-4e034fc8dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:42.339070 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1658/3352] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:42.349169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:42.351156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:42.435807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca13cd5-1e8e-434c-958d-d79178fecf7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:42.441653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:42.442574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:42.443016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:42.443792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:42.460326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:42.467180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:42.490277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1695/3353] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:47.174610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bcfb0-9ca7-460d-91b8-e4d31f067f2a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:47.175508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bcfb0-9ca7-460d-91b8-e4d31f067f2a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:47.175944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bcfb0-9ca7-460d-91b8-e4d31f067f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:47.259331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4e5bcfb0-9ca7-460d-91b8-e4d31f067f2a None None] MFA Rules not processed for user `b2c41e924f694c789952302d70e75efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:47.260500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e5bcfb0-9ca7-460d-91b8-e4d31f067f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:47.452497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1659/3354] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:47.485548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:47.501490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa337f-9b4c-4393-8f9e-3bd0565b0c28 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:47.507766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:47.509325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:47.510215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:47.510645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:47.523823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:47.527552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055427c0-dc72-41d1-b229-13523b018a52 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:47.537643 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:47.554707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1696/3355] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:52.832378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:52.832818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:52.833011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:52.861445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] MFA Rules not processed for user `b2c41e924f694c789952302d70e75efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:52.863598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:52.885323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1660/3356] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:57.357157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b1c4-023c-4a07-b896-f893211e733f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:57.358276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b1c4-023c-4a07-b896-f893211e733f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:57.358709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b1c4-023c-4a07-b896-f893211e733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:57.418592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e731b1c4-023c-4a07-b896-f893211e733f None None] MFA Rules not processed for user `6f643b01bb934b4ebacc4548721dba25`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:57.420586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e731b1c4-023c-4a07-b896-f893211e733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:57.606675 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1697/3357] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:57.764912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:57.766403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:57.844663 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:57.954669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57708-3a6f-412b-8dec-2e6cfcb96d55 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:57.978950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:57.979607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:57.979914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:57.980256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:57.994843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:57.996710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:58.033702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1661/3358] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:58.652649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:58.653156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:58.653156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:58.706738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] MFA Rules not processed for user `c6d333d036f74225bf1afd3d36d8e339`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:58.708000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:58.853923 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1698/3359] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:17:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:58.869175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:58.870950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:58.906665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf9a5-1a98-42fc-bed2-ff52fbbe53be service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:58.923113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:58.923781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:58.925646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:58.927577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:58.951567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:58.956071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2b0c2-8dea-4d69-bfb8-e1f4feaf5708 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:58.974017 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1662/3360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:03.877657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:03.899171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe0fb9-622e-4c09-b152-7f9ad6f58b94 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:03.917458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:03.918194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:03.918479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:03.918775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:03.920773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:04.055891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:04.057646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01059126-910b-4815-b23c-ad1643fca4f8 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:04.088874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1699/3361] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:04.172775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e4c5-bea7-4a52-9fbe-8f9d0ce6ef7d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:04.173312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e4c5-bea7-4a52-9fbe-8f9d0ce6ef7d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:04.173312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9e4c5-bea7-4a52-9fbe-8f9d0ce6ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:04.215511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8db9e4c5-bea7-4a52-9fbe-8f9d0ce6ef7d None None] MFA Rules not processed for user `f3de9a749c874cfc8c34deffb1001a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:04.216847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8db9e4c5-bea7-4a52-9fbe-8f9d0ce6ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:04.235886 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1663/3362] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:05.715566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:05.717175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:05.717651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:05.741090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] MFA Rules not processed for user `6f643b01bb934b4ebacc4548721dba25`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:05.743432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:05.759533 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1700/3363] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:06.421625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:06.422466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:06.423068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:06.484921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] MFA Rules not processed for user `c6d333d036f74225bf1afd3d36d8e339`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:06.486813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:06.514448 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1664/3364] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:11.410684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:11.413293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:11.442358 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:11.539500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ec06d-f144-4c39-ba58-b5a6c1db9e06 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:11.546159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:11.547186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:11.547664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:11.548233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:11.552764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:11.574382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:11.577145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a432c-c498-40ac-bd94-2394cf695298 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:11.582005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:11.583567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:11.597377 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1701/3365] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:11.626585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282481e-ea01-4548-8c35-bba3c4d213d7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:11.635398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:11.636880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:11.637388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:11.638739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] PATH_INFO: `/v3/users/3428b2650a774c998b63ed06114872b0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:11.640278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3428b2650a774c998b63ed06114872b0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:11.642973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:11.770999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3428b2650a774c998b63ed06114872b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:11.788757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3428b2650a774c998b63ed06114872b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:11.802319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3428b2650a774c998b63ed06114872b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:11.828093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3428b2650a774c998b63ed06114872b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:11.829160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3428b2650a774c998b63ed06114872b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:11.865340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1665/3366] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:11 2022] DELETE /identity/v3/users/3428b2650a774c998b63ed06114872b0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:12.067942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652dc60-3eff-475b-8b9e-447af7c1b7ac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:12.068354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652dc60-3eff-475b-8b9e-447af7c1b7ac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:12.068952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652dc60-3eff-475b-8b9e-447af7c1b7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:12.113951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b652dc60-3eff-475b-8b9e-447af7c1b7ac None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:12.115440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b652dc60-3eff-475b-8b9e-447af7c1b7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:12.233755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1702/3367] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:12.820331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:12.822796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:12.951920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06dca0-c34e-4a84-8261-1f2f2cad91fa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:12.958543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:12.960081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:12.960471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:12.960934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] PATH_INFO: `/v3/projects/faa16a8779184f18afc0118c7581b9b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:12.962743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa16a8779184f18afc0118c7581b9b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:12.966125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:12.970024 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:13.104296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa16a8779184f18afc0118c7581b9b9', 'request_id': 'req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:13.136242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa16a8779184f18afc0118c7581b9b9', 'request_id': 'req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:13.161175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa16a8779184f18afc0118c7581b9b9', 'request_id': 'req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:13.195341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] The token cache is being invalidate because project faa16a8779184f18afc0118c7581b9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:18:13.195881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:13.196750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d7c811b-dd82-4cdd-8d36-6dcd25c335ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:13.199927 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1666/3368] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:12 2022] DELETE /identity/v3/projects/faa16a8779184f18afc0118c7581b9b9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:13.205068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:13.205929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:13.205929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:13.228921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:13.230540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:13.354513 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1703/3369] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:13.364161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:13.364161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:13.364953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:13.390487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:13.392939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:13.413223 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1667/3370] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:13.414814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:13.450624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e6dc-cbe9-4b03-880e-6b6f8d2e5810 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:13.465415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:13.466139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:13.470691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:13.471213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:13.472024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:13.472556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:13.476437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:13.519441 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1704/3371] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:13.525232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:13.537518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a827d3-1045-446e-a4a9-5966236271a3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:13.558695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:13.559218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:13.559503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:13.559772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:13.563658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:13.567392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:13.691853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1668/3372] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:13 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:13.696389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:13.722020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7258eb3-9974-4212-a209-fa6c516e288c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:13.865895 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:14.020192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:14.020895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.021190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.021464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.028217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:14.030253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:14.091678 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1705/3373] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:13 2022] POST /identity/v3/users => generated 291 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:14.093566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:14.125072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c03e23-453e-4db8-8e47-ac762001bbac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:14.156897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:14.157648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.158030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.160200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.161131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:14.163691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:14.202736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1669/3374] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:14.207445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:14.232914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0761cf-eb71-40ab-afc8-ae2b8b3cf49a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:14.245246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:14.247601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.247889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.252375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.256168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:14.261896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacbb9-32c0-4be4-be84-12837c18a4d3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:14.309744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1706/3375] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:14.313734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:14.329433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df959ad3-818b-4cb6-8a40-0bb11d909ff1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:14.355519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:14.356719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.358151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.361290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] PATH_INFO: `/v3/projects/4325ec434a874304a31c9de29d4c1fbc/users/2a53625b6a1148aa8ae55575516d7b77/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.387031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4325ec434a874304a31c9de29d4c1fbc, user_id=2a53625b6a1148aa8ae55575516d7b77, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:14.394026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:14.440725 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1670/3376] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:14 2022] PUT /identity/v3/projects/4325ec434a874304a31c9de29d4c1fbc/users/2a53625b6a1148aa8ae55575516d7b77/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:14.446509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.447027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.447675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.469279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:14.470773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:14.573307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1707/3377] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:14.622985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:14.624812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:14.732714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f4f0-8a14-434e-bb69-a122143c3918 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:14.739267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:14.740438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:14.740888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:14.741542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:14.760133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:14.762572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58b846-3ccb-4d68-a318-b3a380731142 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:14.809853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1671/3378] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:16.084816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:16.086858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:16.112905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d51b-8622-4eab-9b7d-714457380233 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:16.117283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:16.118231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:16.118875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:16.120129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:16.123806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:16.339618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:16.342207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fbad0-9663-4faa-8869-955112492471 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:16.364389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1708/3379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:18.800173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:18.802046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:18.802580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:18.806408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1672/3380] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:18:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:18.813438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:18.814467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:18.814930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:18.900212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:18.902985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:18.950517 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:19.075851 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1709/3381] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:19.110682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:19.113939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:19.140685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c827a-74a2-4f5a-8ee3-d6ae41c74e15 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:19.154004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:19.155567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:19.156175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:19.156772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:19.181002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:19.184831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:19.204814 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1673/3382] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:18:21.720322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:21.734354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418cd5c-0127-461b-80d3-e9ef583d85ee None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:21.755405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:21.760335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:21.762126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:21.763687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:21.769618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:21.817442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:21.819085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:21.834577 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1710/3383] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:29.197656 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:29.781797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:29.783482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:29.817713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ea55-44ae-4ba9-b397-12b50e05bdb7 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:29.837254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:29.840407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:29.841036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:29.841470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:29.849576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:30.060732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:30.062508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6b09-3aa0-4972-9568-6cf20bbe0ac4 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:30.095323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1674/3384] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:30.103674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:30.157533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48086f-c00c-4b57-9919-fb3f6dc71825 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:30.173876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:30.174568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:30.174864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:30.175120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:30.182904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:30.206826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:30.209218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:30.229736 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1711/3385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:32.076536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:32.077412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:32.078014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:32.179308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] MFA Rules not processed for user `2a53625b6a1148aa8ae55575516d7b77`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:32.181609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:32.380865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1675/3386] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:33.471623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:33.525590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f3329-7f7b-4171-ab4c-bb91184a7a23 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:33.539611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:33.540499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:33.540937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:33.542179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:33.559494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:33.561588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:33.582988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1712/3387] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:41.188051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:41.190202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:41.217332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa88946-8383-4eab-b594-43a9af1a9e22 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:41.240277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:41.241862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:41.243180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:41.243622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:41.247227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:41.263919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:41.267289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:41.282596 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1676/3388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:43.573993 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=37 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:45.693817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:45.709584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa11e-e7a4-4d07-a9af-aa1fdfe806f6 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:45.722745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:45.723749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:45.726582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:45.731582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] PATH_INFO: `/v3/users/2a53625b6a1148aa8ae55575516d7b77` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:45.733226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a53625b6a1148aa8ae55575516d7b77)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:45.736147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:45.908305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a53625b6a1148aa8ae55575516d7b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:45.909348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a53625b6a1148aa8ae55575516d7b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:45.926180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a53625b6a1148aa8ae55575516d7b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:45.939756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a53625b6a1148aa8ae55575516d7b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:45.967763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c2f7d1c-332c-4af6-9f41-4e81edbb5d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a53625b6a1148aa8ae55575516d7b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:46.002088 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1713/3389] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:45 2022] DELETE /identity/v3/users/2a53625b6a1148aa8ae55575516d7b77 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:46.935902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:46.950531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3f301-54a4-4ccd-a05c-8aeb5b8081c5 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:47.103245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:47.104588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.104987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.106159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] PATH_INFO: `/v3/projects/4325ec434a874304a31c9de29d4c1fbc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.110756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4325ec434a874304a31c9de29d4c1fbc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:47.117766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:47.177641 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:47.254562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4325ec434a874304a31c9de29d4c1fbc', 'request_id': 'req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:47.263864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4325ec434a874304a31c9de29d4c1fbc', 'request_id': 'req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:47.282118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4325ec434a874304a31c9de29d4c1fbc', 'request_id': 'req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:47.313485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] The token cache is being invalidate because project 4325ec434a874304a31c9de29d4c1fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:18:47.313949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:47.314683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18b8fc45-6760-41ba-a1fc-d2cc183fedb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:47.322784 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1677/3390] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:46 2022] DELETE /identity/v3/projects/4325ec434a874304a31c9de29d4c1fbc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:47.324610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.325383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.325843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.386010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:47.387499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:47.468314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1714/3391] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:18:47.477400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.477717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.478264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.518649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:47.520539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:47.544259 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1678/3392] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:47.546697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:47.562844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c758c-af99-4f52-b1fb-9ad01ced91d1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:47.569800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:47.571304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.571747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.572192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.573391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:47.573901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:47.576532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:47.598212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1715/3393] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:47.602712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:47.623790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3960db-b3c2-436b-b188-122edec27709 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:47.632423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:47.633465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.633830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.634112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.641473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:47.643531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:47.707724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1679/3394] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:47 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:47.708667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:47.732013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079c8e-0fcb-453c-8ab4-bf162aa10559 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:47.863299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:47.864297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.864583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.865431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.865573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:47.875263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:47.891013 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:47.923696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1716/3395] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:47 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:18:47.925257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:47.947823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cde1a1-0cd6-4ef8-855e-07e02bbeefc9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:47.958246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:47.959140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:47.959747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:47.960797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:47.962185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:47.964651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:47.998357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1680/3396] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:47.999187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:48.014266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c48ce-34b0-49c0-86f6-6518cf1dfc85 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:48.036135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:48.036846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:48.037127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:48.040548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:48.041355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:48.043025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb642b-d455-427b-bf83-f2ec4cf57aa5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:48.076404 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1717/3397] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:48.078160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:48.092217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58682223-33ae-4d13-8c31-144aa0a858a2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:48.106269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:48.107425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:48.107876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:48.108317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] PATH_INFO: `/v3/projects/a2a2d4b8e9034bbaa1fc00e258827b6f/users/058e8545da5b4f7fa7b243991ebc8170/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:48.158586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a2d4b8e9034bbaa1fc00e258827b6f, user_id=058e8545da5b4f7fa7b243991ebc8170, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:48.171537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:48.201604 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1681/3398] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:48 2022] PUT /identity/v3/projects/a2a2d4b8e9034bbaa1fc00e258827b6f/users/058e8545da5b4f7fa7b243991ebc8170/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:48.216718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:48.218183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:48.218665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:48.327798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] MFA Rules not processed for user `058e8545da5b4f7fa7b243991ebc8170`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:48.331269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:48.525735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1718/3399] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:48.997627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:48.999925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:49.050665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:49.053421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:49.222886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a068b2-ea4c-4835-b590-157caae57a6b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:49.239731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:49.242500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:49.243003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:49.243603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:49.251911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:49.330119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e7570-6cfc-4a8b-a705-e70f06ebbfff None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:49.343185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:49.344099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:49.344486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:49.344870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:49.365356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:49.367194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:49.406589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1719/3400] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:49.434259 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:49.457795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:49.461262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47470da-cc9b-4767-99d8-db73123c9f34 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:49.490148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1682/3401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:50.217701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:50.236658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882318-8bb2-43c3-91e7-bbe503cb979d service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:50.249431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:50.250711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:50.251619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:50.252374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] PATH_INFO: `/v3/users/058e8545da5b4f7fa7b243991ebc8170` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:50.254188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] RBAC: Authorizing `identity:delete_user(user_id=058e8545da5b4f7fa7b243991ebc8170)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:50.256377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:50.361369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058e8545da5b4f7fa7b243991ebc8170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:50.362115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058e8545da5b4f7fa7b243991ebc8170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:50.364537 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:50.379283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058e8545da5b4f7fa7b243991ebc8170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:50.391038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058e8545da5b4f7fa7b243991ebc8170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:50.422589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058e8545da5b4f7fa7b243991ebc8170'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:50.430696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1720/3402] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:50 2022] DELETE /identity/v3/users/058e8545da5b4f7fa7b243991ebc8170 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:50.435024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:50.435520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:50.435792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:50.466717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:50.468653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:50.618753 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1683/3403] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:18:50.629689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:50.631557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:50.741787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ccd5-369a-4183-ad27-addf08a4800f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:50.746032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:50.746947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:50.747545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:50.748066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:50.760226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:50.761940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83e61-11b3-4fce-8eb3-1df7f0897bc8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:50.787032 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1721/3404] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:51.411717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:51.413795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:51.435817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a819-3367-4d30-82db-5568f4a7bbcc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:51.449488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:51.450709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.451215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.451499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] PATH_INFO: `/v3/projects/a2a2d4b8e9034bbaa1fc00e258827b6f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.452984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a2d4b8e9034bbaa1fc00e258827b6f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:51.463191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:51.526475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a2d4b8e9034bbaa1fc00e258827b6f', 'request_id': 'req-adf16c42-f429-4118-a6ab-298976eac81e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:51.534104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a2d4b8e9034bbaa1fc00e258827b6f', 'request_id': 'req-adf16c42-f429-4118-a6ab-298976eac81e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:51.542704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a2d4b8e9034bbaa1fc00e258827b6f', 'request_id': 'req-adf16c42-f429-4118-a6ab-298976eac81e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:51.557658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] The token cache is being invalidate because project a2a2d4b8e9034bbaa1fc00e258827b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:18:51.558320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:51.559162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-adf16c42-f429-4118-a6ab-298976eac81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:51.561898 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1684/3405] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:51 2022] DELETE /identity/v3/projects/a2a2d4b8e9034bbaa1fc00e258827b6f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:51.566710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702365-0f51-4a27-8ff6-c73d44628e2e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.567177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702365-0f51-4a27-8ff6-c73d44628e2e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.567411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702365-0f51-4a27-8ff6-c73d44628e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.587343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8702365-0f51-4a27-8ff6-c73d44628e2e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:51.588569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8702365-0f51-4a27-8ff6-c73d44628e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:51.677749 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1722/3406] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:51.687284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.688418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.688933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.695906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.696212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.696473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.716049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:51.717156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:51.724418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:51.726681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:51.744012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1685/3407] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:51.748425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:51.762700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcbd37-b7b2-4165-8237-a735ca272a7d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:51.771827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:51.773394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.773695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.773996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.774858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:51.775219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:51.777537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:51.795799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1686/3408] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:18:51.800618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:51.813602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1723/3409] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:18:51.824706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54759-be42-4689-9774-9c10ea6a370d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:51.830907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:51.831598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.832039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.832325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.834240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:51.838262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:51.880650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1687/3410] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:51.882004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:51.895707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e605d31-7572-4c2c-9750-30bca3f3662e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:51.906714 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:52.044036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.044661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.044943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.045217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.045950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.047921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.090252 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1724/3411] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/users => generated 282 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:52.094516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.111777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f821-6a0f-40b5-96f9-9fad733a256f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:52.134298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.135262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.135811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.136319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.137297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.145911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.187467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1688/3412] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:52.192882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.238969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777b54e-d618-4af6-8ab3-a6e217c1a087 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:52.252468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.253535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.253845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.254123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.254985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.256610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55b781-c5c9-417d-af29-ad771c906fca admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.274001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1725/3413] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:52.277595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.292315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1a277-3e28-4463-b653-146300a557f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:52.297731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.298597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.298948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.299234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493/users/b15f555fdc39478493fa58dc657fe83e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.328525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff091d0cae8c4b98a837398bc263c493, user_id=b15f555fdc39478493fa58dc657fe83e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.331001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.344245 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:52.365021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1689/3414] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:52 2022] PUT /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493/users/b15f555fdc39478493fa58dc657fe83e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:52.368354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8420a-99fb-474d-abf6-f16cb503e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.368751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8420a-99fb-474d-abf6-f16cb503e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.369159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8420a-99fb-474d-abf6-f16cb503e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.400156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-71b8420a-99fb-474d-abf6-f16cb503e2a4 None None] MFA Rules not processed for user `b15f555fdc39478493fa58dc657fe83e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:52.401485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-71b8420a-99fb-474d-abf6-f16cb503e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:52.484985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1726/3415] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:52.649779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.652800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:52.764560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e36cb-6305-4817-a188-1fbdb32a4846 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:52.774814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.776485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.777114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.777619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.799598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.804382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.822924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1690/3416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:52.841849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.842325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.842404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.844321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1727/3417] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:52.863786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:18:52.886639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.909912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360cc2-616a-4bc6-bb80-e9538d679f22 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:52.920911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:52.922928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:52.935753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b15f555fdc39478493fa58dc657fe83e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff091d0cae8c4b98a837398bc263c493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:52.936489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:52.936775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:52.937051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:52.938520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorizing `identity:get_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:52.940332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d60a-5085-42d6-9d1f-a47a71227ade tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:52.953832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1691/3418] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:18:52 2022] GET /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 363 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:53.029471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c4e8-3719-412c-89d2-82a8ec20b2f6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:53.036138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:53.036810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:53.037151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:53.037558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:53.040071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:53.066278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:53.070419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:53.086602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1728/3419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:53.161477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f0a4-1253-4a26-a4c3-c5b51d3a9601 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:53.162200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f0a4-1253-4a26-a4c3-c5b51d3a9601 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:53.163245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728f0a4-1253-4a26-a4c3-c5b51d3a9601 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:53.166226 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1692/3420] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:18:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:53.171975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:18:53.200437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:53.220691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b45b4-fe31-41eb-93ea-ff4f040e25ed service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:53.226681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b15f555fdc39478493fa58dc657fe83e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff091d0cae8c4b98a837398bc263c493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:53.228499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:53.229041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:53.229530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:53.231998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorizing `identity:get_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:53.234116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:53.237710 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1729/3421] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:18:53 2022] GET /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 363 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:53.651513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfff63-ff90-4837-9fef-e609e69956d4 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:53.651513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfff63-ff90-4837-9fef-e609e69956d4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:53.652175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfff63-ff90-4837-9fef-e609e69956d4 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:53.653645 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1693/3422] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:53.673610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:18:53.675446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:53.692246 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:53.711693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:53.735878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced2d9-1381-4e89-b143-f131c56902bd tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:53.745856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b15f555fdc39478493fa58dc657fe83e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff091d0cae8c4b98a837398bc263c493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:53.746730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:53.747016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:53.747476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:53.749397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorizing `identity:get_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:53.758526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:53.774535 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1730/3423] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:18:53 2022] GET /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 363 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:54.141565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d372-ce24-4416-9a02-dac448dbdf52 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.142017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d372-ce24-4416-9a02-dac448dbdf52 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.142303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d372-ce24-4416-9a02-dac448dbdf52 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:54.144011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1694/3424] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:54.155437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:18:54.175325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:54.189755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1717e-c1a1-4253-92d3-b3e324a80fae tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:54.198484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b15f555fdc39478493fa58dc657fe83e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff091d0cae8c4b98a837398bc263c493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:54.199419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.199707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.199988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:54.202415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorizing `identity:get_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:54.208983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:54.215025 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1731/3425] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:18:54 2022] GET /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 363 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:54.333996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03c3-6e72-455b-a02b-5ed9cef32ba6 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.334192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03c3-6e72-455b-a02b-5ed9cef32ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.334460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03c3-6e72-455b-a02b-5ed9cef32ba6 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:54.337650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1695/3426] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:18:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:18:54.362035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 01:18:54.413554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:54.425149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca677f-3b99-4da1-9587-5e5c70dabcb8 tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:54.433261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b15f555fdc39478493fa58dc657fe83e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff091d0cae8c4b98a837398bc263c493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:54.435172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.435172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.435172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:54.441610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorizing `identity:get_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:54.443567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1e787-ceb0-4586-918b-46f0a996449b tempest-QuotasTestJSON-937714530 tempest-QuotasTestJSON-937714530-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:54.464420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1732/3427] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 01:18:54 2022] GET /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 363 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:54.515731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b03c3-6e72-455b-a02b-5ed9cef32ba6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:54.695243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b03c3-6e72-455b-a02b-5ed9cef32ba6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:54.714226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:54.715462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.715826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.716921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] PATH_INFO: `/v3/users/b15f555fdc39478493fa58dc657fe83e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:54.721414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15f555fdc39478493fa58dc657fe83e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:54.730003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:54.888049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15f555fdc39478493fa58dc657fe83e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:54.908227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15f555fdc39478493fa58dc657fe83e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:54.931891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15f555fdc39478493fa58dc657fe83e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:54.944106 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:54.949391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15f555fdc39478493fa58dc657fe83e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:54.967508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15f555fdc39478493fa58dc657fe83e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:54.983435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1696/3428] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:54 2022] DELETE /identity/v3/users/b15f555fdc39478493fa58dc657fe83e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:54.987108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:54.987398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:54.987717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:55.032436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:55.033954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:55.219920 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1733/3429] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:55.241034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:55.243571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:55.376924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec34d5-8a93-40ad-b01b-676d7863469c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:55.394568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:55.395266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:55.395545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:55.395817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:55.417756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:55.419255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e361a-bd88-4070-8b12-1b966e6710b1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:55.441100 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1697/3430] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:56.391664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:56.393308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:56.416598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f497-1a3d-4ed7-9d53-6b69f8176589 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:56.429192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:56.430974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:56.431633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:56.435019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] PATH_INFO: `/v3/projects/ff091d0cae8c4b98a837398bc263c493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:56.440471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff091d0cae8c4b98a837398bc263c493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:56.443748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:56.603484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff091d0cae8c4b98a837398bc263c493', 'request_id': 'req-90c23e30-d0d7-47ae-81ea-bf4a0e712887'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:56.618306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff091d0cae8c4b98a837398bc263c493', 'request_id': 'req-90c23e30-d0d7-47ae-81ea-bf4a0e712887'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:56.635564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff091d0cae8c4b98a837398bc263c493', 'request_id': 'req-90c23e30-d0d7-47ae-81ea-bf4a0e712887'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:56.658218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] The token cache is being invalidate because project ff091d0cae8c4b98a837398bc263c493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:18:56.658749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:56.660647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90c23e30-d0d7-47ae-81ea-bf4a0e712887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:56.663319 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1734/3431] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:56 2022] DELETE /identity/v3/projects/ff091d0cae8c4b98a837398bc263c493 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:56.674221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:56.674807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:56.674807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:56.744776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:56.749253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:56.910286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1698/3432] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:56.921574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:56.921858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:56.922139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:56.949051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:56.950811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:56.973864 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1735/3433] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:56.979683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:56.994423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66ca3-14d8-4f44-aa5b-705ca0ff655a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.002460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.003400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.003861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.004286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.005188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:57.005846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.008479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.047234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1699/3434] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:57.051434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.064419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba90536-0ce1-43b9-a6da-039680345143 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.070345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.072147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.072550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.072901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.073709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.077340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.122933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1736/3435] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:57 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:57.126363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.159899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9210376-675d-4715-a71a-35389acde8e6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.316027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.316617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.317438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.317438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.317908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.320425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.349080 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1700/3436] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:57 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:57.353937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.372330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7f29-afc9-4fce-93e6-9302fcdd967c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.405817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.407460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.408156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.408665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.409838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.412113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.427007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1737/3437] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:57.431367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.443130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8b8cf-24ef-41ca-81d7-c8073ce29ad7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.450044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.450821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.451114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.451394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.452158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.453977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c05d4-e6ae-4dc7-8acb-2f14d638d4b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.481854 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1701/3438] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:57.483709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.496731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d276207-9c4a-475a-b661-b1bce2a58e0f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.506359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.507195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.507301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.507784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] PATH_INFO: `/v3/projects/416b906516b24aee9fc642adb7384b41/users/96476918fd444eb2993c0883f443b6d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.543190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416b906516b24aee9fc642adb7384b41, user_id=96476918fd444eb2993c0883f443b6d5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.546382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.556036 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:57.577175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1738/3439] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:57 2022] PUT /identity/v3/projects/416b906516b24aee9fc642adb7384b41/users/96476918fd444eb2993c0883f443b6d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:57.592885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.593178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.593465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.602320 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:57.635421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] MFA Rules not processed for user `96476918fd444eb2993c0883f443b6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:57.650542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:57.775632 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1702/3440] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:57.779970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.865180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94474c07-61d5-49d7-9fed-3088467ad517 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:57.870714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:57.871963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:57.872392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:57.872677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:57.873396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:57.875398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:57.921044 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1739/3441] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:57 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:18:57.925950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:57.945963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cc683-ce77-4583-b485-83d28cd9a2e4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.036682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.037293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.037580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.038545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.039281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.041550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.072994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.081330 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1703/3442] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:57 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:58.087307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb96d8-b9b5-46bc-a9b1-b3eae059d7db admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.092772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.094461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.094877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.095015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.095767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.097443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.110937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1740/3443] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:58.123355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.143206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd849a-ad0e-434f-821c-d0ed41d88afb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.150092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.150910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.151283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.151567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] PATH_INFO: `/v3/projects/78626cf346054398885c7be840104804/users/f3ee142544bc48229451da0e38de8142/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.171516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78626cf346054398885c7be840104804, user_id=f3ee142544bc48229451da0e38de8142, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.175135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.198408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1704/3444] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:58 2022] PUT /identity/v3/projects/78626cf346054398885c7be840104804/users/f3ee142544bc48229451da0e38de8142/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:58.199646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.218378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a2b90-8547-48f8-8194-2cf2705e1e05 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.325618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.326696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.326985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.327263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.329726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.331374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f014-8325-425f-8c89-a383f66b174b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.355971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1741/3445] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:58.359838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.372215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0209867-d56b-48e9-9b3a-44b9fc3ca977 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.377408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.378356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.378642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.378922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] PATH_INFO: `/v3/projects/78626cf346054398885c7be840104804/users/f3ee142544bc48229451da0e38de8142/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.381164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78626cf346054398885c7be840104804, user_id=f3ee142544bc48229451da0e38de8142, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.384457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.408601 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1705/3446] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:58 2022] PUT /identity/v3/projects/78626cf346054398885c7be840104804/users/f3ee142544bc48229451da0e38de8142/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:58.409021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.409479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.409645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.454587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] MFA Rules not processed for user `f3ee142544bc48229451da0e38de8142`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:58.455847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:58.569636 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:58.604258 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1742/3447] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:58.608597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.626375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e745-99af-40b1-b2cf-f874ead472a3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.632309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.633096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.633457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.633848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.634782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.636849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.681305 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1706/3448] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:58 2022] POST /identity/v3/projects => generated 334 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:58.682867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.696255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211606-0b52-4e8a-ace5-24c739228edf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:58.852848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:58.854165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:58.854628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:58.855264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:58.856282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:58.860389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:58.932108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:58.937988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1743/3449] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:18:58 2022] POST /identity/v3/projects => generated 333 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:58.955511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b601-ca43-49e2-ab07-14ace0ab9767 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.009058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.011137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:59.011689 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:59.125952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.127172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.127491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.128030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.128755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.133728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.205580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8aa3-a570-468a-89ea-0b8563e8e2ee tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.220107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.221246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.221374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.221646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] PATH_INFO: `/v3/users/f3de9a749c874cfc8c34deffb1001a79` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.223046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3de9a749c874cfc8c34deffb1001a79)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.224125 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1707/3450] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:58 2022] POST /identity/v3/projects => generated 358 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:59.227339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.243601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.323408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3de9a749c874cfc8c34deffb1001a79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:59.324263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3de9a749c874cfc8c34deffb1001a79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:59.341101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3de9a749c874cfc8c34deffb1001a79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:59.358120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3de9a749c874cfc8c34deffb1001a79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:59.384654 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:59.387327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3de9a749c874cfc8c34deffb1001a79'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:59.415154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1744/3451] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:59 2022] DELETE /identity/v3/users/f3de9a749c874cfc8c34deffb1001a79 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:18:59.450049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8ed8-40aa-45b8-b764-67f03c05af12 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.477319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.479304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:59.653661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc64b-4a97-44f1-921d-6d4fb4bf4c92 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.666256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.667226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.668247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.668827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.678742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.678742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.678742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.679445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.679445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.685640 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:18:59.685640 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:18:59.685640 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:18:59.687746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.697439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:59.715476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.718135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.721378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1708/3452] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:18:59 2022] GET /identity/v3/projects => generated 7982 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:59.728608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.730580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:59.731272 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1745/3453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:18:59.750549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecdad-cdc9-4cf4-aed3-5bb67e6df856 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.759163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.760295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.760586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.760859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.763076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:59.763076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.764212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.799244 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1709/3454] 10.222.0.27 () {58 vars in 1157 bytes} [Sun Jul 24 01:18:59 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:59.808015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.824721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f96a3-d223-4065-8691-74b0e0d1bcad service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.831133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.833952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.834347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.835398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.836290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Adding query filter params (parent_id=50eeb98318cf4a9289d75c66a5ad729a) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:59.836838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.839982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.867448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1746/3455] 10.222.0.27 () {58 vars in 1215 bytes} [Sun Jul 24 01:18:59 2022] GET /identity/v3/projects?parent_id=50eeb98318cf4a9289d75c66a5ad729a => generated 498 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:18:59.873931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.889623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b78c2-3c39-45db-a718-27a11658351c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:59.896289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:59.898388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:59.899042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:59.899600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects/819395fcc175430e945cd8ca633e5342` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:59.901075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:delete_project(project_id=819395fcc175430e945cd8ca633e5342)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:59.903236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:59.953016 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:59.978963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:59.980700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.029447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819395fcc175430e945cd8ca633e5342', 'request_id': 'req-e8b6824f-8468-4173-b697-5355e0e722d3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.065271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819395fcc175430e945cd8ca633e5342', 'request_id': 'req-e8b6824f-8468-4173-b697-5355e0e722d3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.083560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819395fcc175430e945cd8ca633e5342', 'request_id': 'req-e8b6824f-8468-4173-b697-5355e0e722d3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.122423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] The token cache is being invalidate because project 819395fcc175430e945cd8ca633e5342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:00.122612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.125218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.130277 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1710/3456] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:59 2022] DELETE /identity/v3/projects/819395fcc175430e945cd8ca633e5342 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:00.133255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:00.137924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.167567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce25e-a605-4e62-b467-34f8bf773f74 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:00.293770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6824f-8468-4173-b697-5355e0e722d3 tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:00.304728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:00.306187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.306472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.307249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects/50eeb98318cf4a9289d75c66a5ad729a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.309230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:delete_project(project_id=50eeb98318cf4a9289d75c66a5ad729a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:00.311898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:00.343305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:00.344516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.344771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.345231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] PATH_INFO: `/v3/projects/8336a5a8ae294f77aba940d67364b0b8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.349080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8336a5a8ae294f77aba940d67364b0b8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:00.373067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:00.427722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50eeb98318cf4a9289d75c66a5ad729a', 'request_id': 'req-7087255f-9613-4ade-9ee3-1a6bceb1be9f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.440809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50eeb98318cf4a9289d75c66a5ad729a', 'request_id': 'req-7087255f-9613-4ade-9ee3-1a6bceb1be9f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.441652 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:00.452057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50eeb98318cf4a9289d75c66a5ad729a', 'request_id': 'req-7087255f-9613-4ade-9ee3-1a6bceb1be9f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.457148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8336a5a8ae294f77aba940d67364b0b8', 'request_id': 'req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.466965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8336a5a8ae294f77aba940d67364b0b8', 'request_id': 'req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.474569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] The token cache is being invalidate because project 50eeb98318cf4a9289d75c66a5ad729a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:00.474920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.476187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.478850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8336a5a8ae294f77aba940d67364b0b8', 'request_id': 'req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.482425 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1711/3457] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:00 2022] DELETE /identity/v3/projects/50eeb98318cf4a9289d75c66a5ad729a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:00.483359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:00.484926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.496774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] The token cache is being invalidate because project 8336a5a8ae294f77aba940d67364b0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:00.497224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.498315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f3bdc0a-a7e2-45e4-802e-719f6c8cd5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.503667 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1747/3458] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:59 2022] DELETE /identity/v3/projects/8336a5a8ae294f77aba940d67364b0b8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:00.505355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03340349-b8ae-4a1c-b684-c9c920493560 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.505731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03340349-b8ae-4a1c-b684-c9c920493560 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.506077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03340349-b8ae-4a1c-b684-c9c920493560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.545032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-03340349-b8ae-4a1c-b684-c9c920493560 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:00.546500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-03340349-b8ae-4a1c-b684-c9c920493560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.557434 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:00.590465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087255f-9613-4ade-9ee3-1a6bceb1be9f tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:00.703494 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1748/3459] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:00.712587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.714233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.715435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.738060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ee142544bc48229451da0e38de8142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78626cf346054398885c7be840104804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:00.738935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.739217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.739490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] PATH_INFO: `/v3/projects/cc8c4ce059ec410eab63ee20257eb6af` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.742041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc8c4ce059ec410eab63ee20257eb6af)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:00.744641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:00.761863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:00.763469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.791396 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1749/3460] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:00.793069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:00.819590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda78d-b1ca-4c59-a648-36606286ac3d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:00.837706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8c4ce059ec410eab63ee20257eb6af', 'request_id': 'req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.849196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8c4ce059ec410eab63ee20257eb6af', 'request_id': 'req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.876690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8c4ce059ec410eab63ee20257eb6af', 'request_id': 'req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.899712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] The token cache is being invalidate because project cc8c4ce059ec410eab63ee20257eb6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:00.900914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.902648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:00.910551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1712/3461] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:00 2022] DELETE /identity/v3/projects/cc8c4ce059ec410eab63ee20257eb6af => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:00.911740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:00.916317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:00.976807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:00.977504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:00.977826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:00.978369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:00.979131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:00.979441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:00.981078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.032962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1750/3462] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:01.037449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.057983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.088202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38c13f-284a-443c-83fc-b5bd1ef56b0c tempest-ListProjectsTestJSON-158319717 tempest-ListProjectsTestJSON-158319717-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.098717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6666c3-4be9-4029-8078-b1d18f209419 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.101560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.103506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.105995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.108794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] PATH_INFO: `/v3/users/96476918fd444eb2993c0883f443b6d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.110508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96476918fd444eb2993c0883f443b6d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.113219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.136801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.137391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.137690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.137969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.138687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.144895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.160169 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:01.222472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1751/3463] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:01 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:01.223376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.247975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96476918fd444eb2993c0883f443b6d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:01.272174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96476918fd444eb2993c0883f443b6d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:01.296905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96476918fd444eb2993c0883f443b6d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:01.325114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96476918fd444eb2993c0883f443b6d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:01.326709 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:01.326828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b8dc8ec-d8c0-460a-ab50-5f8f19eb90f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96476918fd444eb2993c0883f443b6d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:01.340576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1713/3464] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:00 2022] DELETE /identity/v3/users/96476918fd444eb2993c0883f443b6d5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:01.342211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.342503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.342781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.383298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:01.385020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.401952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a040f-1c3d-4525-9eee-6e828abeb4b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.516340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.517860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.518292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.518715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.519749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.525121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.529005 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1714/3465] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:01.537889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.539493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.565711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1752/3466] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:01 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:01.567678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.571895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.588413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663f0f-ee98-4be5-a7c1-8ad4b24785eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.593907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.594927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.596040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.596525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.597739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.599829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.619744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1753/3467] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:01.623717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.638436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be86c3-0b6a-4e2a-9ae9-e8ad1239c0d6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.649206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.650164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.650617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.651308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.652268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.654516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.674789 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1754/3468] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:01.675943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.692348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365296-ec96-4701-bf4e-3493e2897a55 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.707639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.710804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.711145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167262a4-bea2-4d7d-9f0a-2743fb61ac78 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:01.714599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.715167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] PATH_INFO: `/v3/projects/a2a0554a2bdf40009b895620212a11f1/users/bba4323f452d409eaf42a1d7d60df35c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.719416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:01.720212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.720502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.720776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.748244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a0554a2bdf40009b895620212a11f1, user_id=bba4323f452d409eaf42a1d7d60df35c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.748244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aaad1-8ff4-40cc-9512-70a92ce0d75f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.756690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:01.758590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:01.770379 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1755/3469] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:01 2022] PUT /identity/v3/projects/a2a0554a2bdf40009b895620212a11f1/users/bba4323f452d409eaf42a1d7d60df35c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:01.773933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:01.774111 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1715/3470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:19:01.781919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:01.782248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:01.816534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:01.818049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.935191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1756/3471] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:01.950546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:01.952124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:01.972058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021b1af-9d10-412a-a864-15ecfc7b0021 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:02.034464 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:02.052606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:02.055292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:02.055681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:02.055974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:02.067461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:02.071184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:02.111315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1716/3472] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:02.191571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:02.193808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:02.223890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf06a1-b3db-4d09-a4d1-7f2ab38e925e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:02.230082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:02.231957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:02.232499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:02.233277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] PATH_INFO: `/v3/projects/416b906516b24aee9fc642adb7384b41` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:02.234864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416b906516b24aee9fc642adb7384b41)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:02.236962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:02.284617 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:02.364748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416b906516b24aee9fc642adb7384b41', 'request_id': 'req-121eb6e9-a4e5-4e61-afe5-f0d464c24885'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.373769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416b906516b24aee9fc642adb7384b41', 'request_id': 'req-121eb6e9-a4e5-4e61-afe5-f0d464c24885'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.384570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416b906516b24aee9fc642adb7384b41', 'request_id': 'req-121eb6e9-a4e5-4e61-afe5-f0d464c24885'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.402320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] The token cache is being invalidate because project 416b906516b24aee9fc642adb7384b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:02.402571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.403249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.405609 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1757/3473] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:02 2022] DELETE /identity/v3/projects/416b906516b24aee9fc642adb7384b41 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:02.410376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:02.424235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a70c1-0316-4c8d-8ddd-4ed5d1a4d79a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:02.462837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:02.464318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:02.578910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:02.580361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:02.580798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:02.581250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] PATH_INFO: `/v3/users/f3ee142544bc48229451da0e38de8142` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:02.583970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ee142544bc48229451da0e38de8142)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:02.586198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:02.623508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb6e9-a4e5-4e61-afe5-f0d464c24885 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:02.634717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:02.635611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:02.635895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:02.636421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:02.639367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:02.675471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ee142544bc48229451da0e38de8142'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.687556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ee142544bc48229451da0e38de8142'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.708025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ee142544bc48229451da0e38de8142'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.726725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:02.728703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:02.735279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ee142544bc48229451da0e38de8142'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.736309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66b036e6-a8f6-42dd-9324-a22133b125ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ee142544bc48229451da0e38de8142'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:02.741895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1758/3474] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:19:02.745588 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1717/3475] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:02 2022] DELETE /identity/v3/users/f3ee142544bc48229451da0e38de8142 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:03.527028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:03.528618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:03.554329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe91ce-2623-4f2d-9dd5-017238ad18da service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:03.643194 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:03.691808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:03.692729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:03.693112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:03.693272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] PATH_INFO: `/v3/projects/78626cf346054398885c7be840104804` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:03.701906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78626cf346054398885c7be840104804)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:03.704713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:03.818144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78626cf346054398885c7be840104804', 'request_id': 'req-c22d1264-4111-43ec-88a2-542ab0ffdf00'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:03.834105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78626cf346054398885c7be840104804', 'request_id': 'req-c22d1264-4111-43ec-88a2-542ab0ffdf00'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:03.847927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78626cf346054398885c7be840104804', 'request_id': 'req-c22d1264-4111-43ec-88a2-542ab0ffdf00'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:03.871292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] The token cache is being invalidate because project 78626cf346054398885c7be840104804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:03.871590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:03.872315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c22d1264-4111-43ec-88a2-542ab0ffdf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:03.874124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1759/3476] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:03 2022] DELETE /identity/v3/projects/78626cf346054398885c7be840104804 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:03.879539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:03.880032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:03.880295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:03.917387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:03.918959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:04.056937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1718/3477] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:04.064454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.064746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.065032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.092843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:04.098264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:04.121786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1760/3478] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:04.126006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.133119 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:04.139823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df781-6981-44bd-9ca3-d6d30e80b6d1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.154054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.154487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.155781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.156383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.156849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:04.157158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.160447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.183657 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1719/3479] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:04.184423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.211304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501bf5-e52b-4f98-a28a-cd10b9b492cb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.231979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.232724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.233028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.234988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.235753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.237794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0162180-6071-4a96-826b-2e619a5af8ed admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.295683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1761/3480] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:04.297114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.323109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf55c91-66a4-41e6-85ac-dd004bee40fd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.471664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b6d-a5ce-4347-85ed-8dbe700b7e05 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.471958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b6d-a5ce-4347-85ed-8dbe700b7e05 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.472249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b6d-a5ce-4347-85ed-8dbe700b7e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.489355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.490420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.492774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.492774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.493826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.499896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.545904 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1720/3481] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:04.547404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-59991b6d-a5ce-4347-85ed-8dbe700b7e05 None None] MFA Rules not processed for user `bba4323f452d409eaf42a1d7d60df35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:04.549563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.550682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-59991b6d-a5ce-4347-85ed-8dbe700b7e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:04.568394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdd91-a50c-4410-a8ba-c6980a048220 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.585056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.586057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.586564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.588497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.596938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.602105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.632604 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1721/3482] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:04.636678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.659980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83b75-c015-40d0-a3dc-ee6c39ed67f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.671164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.672129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.674130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.675505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.676452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.680321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.705046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1722/3483] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:04.706479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:04.734608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1762/3484] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:04.738839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc43e6-2b6d-4410-98f4-28b322e428e1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.739129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc43e6-2b6d-4410-98f4-28b322e428e1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.739410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc43e6-2b6d-4410-98f4-28b322e428e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.764051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105974-4f5b-4664-857c-8bba5f67993f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:04.780619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:04.784294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.784594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.784880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] PATH_INFO: `/v3/projects/f80f3d5e573f46b4b2773c59b9410e44/users/eef3e0171de8449b8538eb1444e0b6ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.786200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f1cc43e6-2b6d-4410-98f4-28b322e428e1 None None] MFA Rules not processed for user `bba4323f452d409eaf42a1d7d60df35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:04.788821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f1cc43e6-2b6d-4410-98f4-28b322e428e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:04.809904 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1763/3485] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:04.811585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682d05-c772-4051-9538-9eb0307a7209 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.812016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682d05-c772-4051-9538-9eb0307a7209 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.812341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73682d05-c772-4051-9538-9eb0307a7209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:04.840947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-73682d05-c772-4051-9538-9eb0307a7209 None None] MFA Rules not processed for user `bba4323f452d409eaf42a1d7d60df35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:04.842950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73682d05-c772-4051-9538-9eb0307a7209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:04.855215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80f3d5e573f46b4b2773c59b9410e44, user_id=eef3e0171de8449b8538eb1444e0b6ac, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:04.862835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:04.865221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1764/3486] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:04.929773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1723/3487] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:04 2022] PUT /identity/v3/projects/f80f3d5e573f46b4b2773c59b9410e44/users/eef3e0171de8449b8538eb1444e0b6ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:04.935921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:04.936878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:04.937362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.001805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] MFA Rules not processed for user `eef3e0171de8449b8538eb1444e0b6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:05.003594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:05.017631 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:05.038469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.042228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:05.265953 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1765/3488] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:05.267783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.371762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75be2-8f34-48e3-afb2-cf071238e19f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:05.382302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:05.383758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.384308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.385259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.412511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664967b0-b466-4ae3-b6a0-c9f42b43143f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:05.419316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd70f-b670-4402-abce-59364de519da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:05.420424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd70f-b670-4402-abce-59364de519da admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.420804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd70f-b670-4402-abce-59364de519da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.421180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd70f-b670-4402-abce-59364de519da admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.422243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd70f-b670-4402-abce-59364de519da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:05.424427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd70f-b670-4402-abce-59364de519da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:05.444510 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:05.464627 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1766/3489] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:05 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:05.469440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd70f-b670-4402-abce-59364de519da admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.482054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:05.484532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:05.518350 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1724/3490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:05.579649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd70f-b670-4402-abce-59364de519da admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:05.593550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:05.597581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.597900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.598184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.599686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:05.607031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5184ea-2c64-4cce-a731-cc2b1ec2da61 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:05.657567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1767/3491] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:05 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:05.658308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.697978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e5097-8019-4a6e-932c-6ed698ffca66 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:05.698761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.699050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.699327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.713597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:05.714568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.716117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.718567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.720445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:05.722306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:05.736868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] MFA Rules not processed for user `b2c41e924f694c789952302d70e75efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:05.742362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:05.758525 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1725/3492] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:05.764758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.773858 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:05.797047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae008f9-fa59-49f7-a08b-2933bbc73aac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:05.811731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:05.813317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:05.813778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:05.814207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] PATH_INFO: `/v3/projects/565f181735f240888d2a239ea0460eb0/users/f46ac7ebd4194f32950bff917b1e0fb3/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:05.856500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f181735f240888d2a239ea0460eb0, user_id=f46ac7ebd4194f32950bff917b1e0fb3, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:05.865301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:05.874793 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1768/3493] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:05.902309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1726/3494] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:05 2022] PUT /identity/v3/projects/565f181735f240888d2a239ea0460eb0/users/f46ac7ebd4194f32950bff917b1e0fb3/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:05.907028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:05.927182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40c79-a6c0-461c-bb7f-7d5c03df5b85 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.034124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.038594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.038999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.039356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.040161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.044446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.082632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.085465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1769/3495] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:06.091454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.099582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:06.099808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34409a28-6733-4e1c-afe3-585b6081bc7d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.118381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.119299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.119582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.119859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] PATH_INFO: `/v3/projects/565f181735f240888d2a239ea0460eb0/users/f46ac7ebd4194f32950bff917b1e0fb3/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.133154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f181735f240888d2a239ea0460eb0, user_id=f46ac7ebd4194f32950bff917b1e0fb3, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.142567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0746-9761-4412-9f5b-6c5d36ed6f10 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.208510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0e239-75bd-4cd1-a2a1-5f9655b006b7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.223447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1727/3496] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:06 2022] PUT /identity/v3/projects/565f181735f240888d2a239ea0460eb0/users/f46ac7ebd4194f32950bff917b1e0fb3/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:06.235756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.236254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.236839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.331475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.332324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.332809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.333194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.349273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:06.353582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] MFA Rules not processed for user `f46ac7ebd4194f32950bff917b1e0fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:06.358993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:06.377498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.389587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.411034 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1770/3497] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:06.558654 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1728/3498] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:06.564124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.579287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e249da-575b-4e96-a1fc-12d1d8c2888f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.588075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.589164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.590322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.590848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.592332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.595032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.634567 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:06.656866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.658029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1771/3499] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:06 2022] POST /identity/v3/projects => generated 329 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:06.677603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1831e1-20ee-4694-ab85-99ceebb61baa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.795370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.796063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.796379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.796670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.797506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.799408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.832163 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:06.845541 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1729/3500] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:06 2022] POST /identity/v3/users => generated 416 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:06.847058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.889275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4b1fd-619d-4eac-975c-323c8997fb5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.902671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.903661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.906300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.906820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.909827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.911801 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:06.911801 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:19:06.911801 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:19:06.914128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:06.938411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1772/3501] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:06 2022] POST /identity/v3/roles => generated 243 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:06.942496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:06.957456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf048a2e-2da3-423a-baea-87bb9fa90c40 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:06.975278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:06.975883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:06.976261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:06.976541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:06.977301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:06.978848 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:06.978848 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:19:06.978848 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:19:06.979510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:07.020896 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1730/3502] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:06 2022] POST /identity/v3/roles => generated 246 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:07.021603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:07.041902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2cb5-3d2e-487d-8b4b-8c43c8f493ed tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:07.058211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:07.060785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.061295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.061514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/58242602141944b5aa6128bc1fceb1cb/users/d9abd13619264f568eb23d5c86192eaf/roles/4d50248e45164a0488b2811597cf82c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:07.088825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58242602141944b5aa6128bc1fceb1cb, user_id=d9abd13619264f568eb23d5c86192eaf, role_id=4d50248e45164a0488b2811597cf82c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:07.092196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252861f-a2de-49c0-a17a-c8bbeae137b0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:07.123696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1773/3503] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:07 2022] PUT /identity/v3/projects/58242602141944b5aa6128bc1fceb1cb/users/d9abd13619264f568eb23d5c86192eaf/roles/4d50248e45164a0488b2811597cf82c5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:07.127613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:07.146189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dea49-1955-4f03-afed-fd91918b1826 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:07.209962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b783e-66fd-42ea-90b8-b5968e63b45b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.209962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b783e-66fd-42ea-90b8-b5968e63b45b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.210800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b783e-66fd-42ea-90b8-b5968e63b45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:07.293798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d05b783e-66fd-42ea-90b8-b5968e63b45b None None] MFA Rules not processed for user `bba4323f452d409eaf42a1d7d60df35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:07.298867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d05b783e-66fd-42ea-90b8-b5968e63b45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:07.320901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:07.322376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.322869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.323441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/58242602141944b5aa6128bc1fceb1cb/users/d9abd13619264f568eb23d5c86192eaf/roles/3a262991a9f94bd7b8fdc0e796e43d3d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:07.329231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58242602141944b5aa6128bc1fceb1cb, user_id=d9abd13619264f568eb23d5c86192eaf, role_id=3a262991a9f94bd7b8fdc0e796e43d3d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:07.332928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:07.358379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1731/3504] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:07 2022] PUT /identity/v3/projects/58242602141944b5aa6128bc1fceb1cb/users/d9abd13619264f568eb23d5c86192eaf/roles/3a262991a9f94bd7b8fdc0e796e43d3d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:07.363117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:07.474077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1774/3505] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:07.505569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d25-36be-405a-a556-095fed5813d7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:07.516430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:07.517444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.517870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.518270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:07.519162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:07.520282 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:07.520282 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:19:07.520282 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:19:07.522918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c1efc-69dc-4d64-8673-b423097795fa tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:07.621246 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1732/3506] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:07 2022] GET /identity/v3/users => generated 8936 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:07.623287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.623579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.623857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:07.743948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] MFA Rules not processed for user `d9abd13619264f568eb23d5c86192eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:07.743948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:07.946031 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1775/3507] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:07.955366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:07.956026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:07.956417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.009405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] MFA Rules not processed for user `d9abd13619264f568eb23d5c86192eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:08.012855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:08.032518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1733/3508] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:08.036683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.051402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a381ceb-0ae7-4839-a7cd-d9a39c5307ce None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.067168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9abd13619264f568eb23d5c86192eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58242602141944b5aa6128bc1fceb1cb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-239096744', 'tempest-NotDelegatedRole-398550995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.067859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.068150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.068432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.069236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: Authorizing `identity:create_trust()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:08.070818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:08.248895 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:08.296675 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1776/3509] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:08.301536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.322376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7641-515f-4829-b99c-75c62d952f12 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.337211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.340534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.341487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.341903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.343127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:08.346762 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:08.346762 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:19:08.346762 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:19:08.347993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:08.358704 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1734/3510] 10.222.0.27 () {58 vars in 1154 bytes} [Sun Jul 24 01:19:08 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:08.362396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.384268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae1d4-15b4-4520-be80-b6efd2cb4aa9 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.390512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9abd13619264f568eb23d5c86192eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58242602141944b5aa6128bc1fceb1cb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-239096744', 'tempest-NotDelegatedRole-398550995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.391483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.391771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.392056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] PATH_INFO: `/v3/OS-TRUST/trusts/36706bd815934020a47b29f3db3297cc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.441059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: Authorizing `identity:delete_trust(trust_id=36706bd815934020a47b29f3db3297cc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:08.442586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:08.498192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '36706bd815934020a47b29f3db3297cc', 'request_id': 'req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:08.509478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '36706bd815934020a47b29f3db3297cc', 'request_id': 'req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:08.510440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '36706bd815934020a47b29f3db3297cc', 'request_id': 'req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:08.528124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1777/3511] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:19:08 2022] DELETE /identity/v3/OS-TRUST/trusts/36706bd815934020a47b29f3db3297cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:08.532618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.534965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:08.564454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402beedc-5aeb-45e4-bde0-0e1e9643486e tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.579140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9abd13619264f568eb23d5c86192eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58242602141944b5aa6128bc1fceb1cb', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-239096744', 'tempest-NotDelegatedRole-398550995'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.581103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.581631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.582080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] PATH_INFO: `/v3/OS-TRUST/trusts/36706bd815934020a47b29f3db3297cc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Could not find trust: 36706bd815934020a47b29f3db3297cc.: keystone.exception.TrustNotFound: Could not find trust: 36706bd815934020a47b29f3db3297cc. Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 24 01:19:08.632125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 36706bd815934020a47b29f3db3297cc. Jul 24 01:19:08.633469 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:19:08.634283 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1735/3512] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:08 2022] GET /identity/v3/OS-TRUST/trusts/36706bd815934020a47b29f3db3297cc => generated 111 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:08.638331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.639993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:08.662247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39ddde-1fa8-47ca-bc9f-cfb0cbae56e6 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.680001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.680899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.681184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.681459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/3a262991a9f94bd7b8fdc0e796e43d3d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.685910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a262991a9f94bd7b8fdc0e796e43d3d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:08.686964 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:08.686964 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:19:08.686964 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:19:08.687858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:08.769508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 3a262991a9f94bd7b8fdc0e796e43d3d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:08.769830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:08.772924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:08.778127 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1778/3513] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:08 2022] DELETE /identity/v3/roles/3a262991a9f94bd7b8fdc0e796e43d3d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:08.782362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:08.784500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:08.829287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b462f-23d2-4ea2-a447-24be542ec8c3 tempest-TrustsV3TestJSON-1978194430 tempest-user-1644728651] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:08.951774 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:08.977526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:08.981759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:08.982412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:08.984213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/4d50248e45164a0488b2811597cf82c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:08.987636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d50248e45164a0488b2811597cf82c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:08.992113 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:08.992113 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:19:08.992113 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:19:08.994222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:09.092397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 4d50248e45164a0488b2811597cf82c5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:09.092880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.093754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.101044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1736/3514] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:08 2022] DELETE /identity/v3/roles/4d50248e45164a0488b2811597cf82c5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:09.105403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:09.117496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bad7-db40-4859-a70f-02191b42fe27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:09.345149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:09.346361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:09.346795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:09.347221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/d9abd13619264f568eb23d5c86192eaf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:09.349057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d9abd13619264f568eb23d5c86192eaf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:09.351776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:09.509433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9abd13619264f568eb23d5c86192eaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.514181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9abd13619264f568eb23d5c86192eaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.528148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9abd13619264f568eb23d5c86192eaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.535416 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:09.541070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9abd13619264f568eb23d5c86192eaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.575396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9abd13619264f568eb23d5c86192eaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:09.589706 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1779/3515] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:09 2022] DELETE /identity/v3/users/d9abd13619264f568eb23d5c86192eaf => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:09.590889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:09.592727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:09.615652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ed937-afbd-419d-9209-9449949ea4c8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:09.899358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:09.900335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:09.900625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:09.900903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/58242602141944b5aa6128bc1fceb1cb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:09.911897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58242602141944b5aa6128bc1fceb1cb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:09.930864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:10.144047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58242602141944b5aa6128bc1fceb1cb', 'request_id': 'req-d6049967-13c9-4d8d-b914-1df2ae97551d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:10.159181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58242602141944b5aa6128bc1fceb1cb', 'request_id': 'req-d6049967-13c9-4d8d-b914-1df2ae97551d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:10.175246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58242602141944b5aa6128bc1fceb1cb', 'request_id': 'req-d6049967-13c9-4d8d-b914-1df2ae97551d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:10.262562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project 58242602141944b5aa6128bc1fceb1cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:10.262861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:10.268531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:10.272842 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1737/3516] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:09 2022] DELETE /identity/v3/projects/58242602141944b5aa6128bc1fceb1cb => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:10.278737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:10.295371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:10.326194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498cfa-5b12-4a17-8aeb-129019dfa9a4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:10.518171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:10.518865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:10.519152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:10.519429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:10.520137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:10.523631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:10.615379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:10.616797 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1780/3517] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:10 2022] POST /identity/v3/projects => generated 328 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:10.619578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:10.650924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6049967-13c9-4d8d-b914-1df2ae97551d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:10.807352 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:10.849317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:10.851237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:10.851535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:10.851958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:10.852826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:10.869209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b690-90c4-4028-af79-12d7e443e5b7 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:10.919878 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1738/3518] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:10 2022] POST /identity/v3/users => generated 413 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:10.921481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:10.933091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d75b2-f42d-4c6f-b450-9a418ee44fc2 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:10.950426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:10.951278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:10.951567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:10.951946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:10.952720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:10.954425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:10.964581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:10.965564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:10.966177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.013292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] MFA Rules not processed for user `bba4323f452d409eaf42a1d7d60df35c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:11.019062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:11.020563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1781/3519] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:10 2022] POST /identity/v3/roles => generated 244 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:11.024338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:11.053069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db107a-1b90-4e9a-adb1-513bb9ec715f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:11.071096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:11.072538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.073049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.073607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.077409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:11.083179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:11.143724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1782/3520] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:11 2022] POST /identity/v3/roles => generated 247 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:11.145141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:11.187424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ccafc-48f4-415a-8122-c99f889d22fb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:11.200226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:11.201143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.201431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.201761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/6c4aa10e97a94f21a6dad0d99266358e/users/5e649208bced4491a7b55c088977bb38/roles/3c48f07d06e64da2b7d18d583f5bc14e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.230548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1739/3521] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:11.265019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6c4aa10e97a94f21a6dad0d99266358e, user_id=5e649208bced4491a7b55c088977bb38, role_id=3c48f07d06e64da2b7d18d583f5bc14e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:11.268123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:11.328526 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1783/3522] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:11 2022] PUT /identity/v3/projects/6c4aa10e97a94f21a6dad0d99266358e/users/5e649208bced4491a7b55c088977bb38/roles/3c48f07d06e64da2b7d18d583f5bc14e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:11.332327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:11.355882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f3168-dd8a-4a51-9895-fa9cd1e31a8d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:11.619677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:11.620982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.621272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.621550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/6c4aa10e97a94f21a6dad0d99266358e/users/5e649208bced4491a7b55c088977bb38/roles/67ee5339c4dd4ec0a63148cc1fdf2e4e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.629073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6c4aa10e97a94f21a6dad0d99266358e, user_id=5e649208bced4491a7b55c088977bb38, role_id=67ee5339c4dd4ec0a63148cc1fdf2e4e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:11.633586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:11.665946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1740/3523] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:11 2022] PUT /identity/v3/projects/6c4aa10e97a94f21a6dad0d99266358e/users/5e649208bced4491a7b55c088977bb38/roles/67ee5339c4dd4ec0a63148cc1fdf2e4e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:11.669914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:11.682919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ad27-2631-4fdd-922a-8aa99f0701ea tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:11.696024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:11.698335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:11.862531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:11.864605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.864605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.864605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.866663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:11.867733 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:19:11.867733 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:19:11.867733 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:19:11.868889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73470505-f0f1-4de0-9b31-b826b65a244d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:11.952798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12a3b4-9e2c-42ee-9236-fc47c4c59a5b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:11.964041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1784/3524] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:11 2022] GET /identity/v3/users => generated 8933 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:11.969739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.970152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.970541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.971467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:11.972731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:11.973625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:11.973625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:11.976426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:11.995023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:11.996829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57da4-ba97-4710-84b0-496918d2a2c9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:12.005620 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:12.017641 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:12.023233 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1741/3525] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:19:12.082365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] MFA Rules not processed for user `5e649208bced4491a7b55c088977bb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:12.083634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:12.293537 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1785/3526] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:12.307025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:12.307478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:12.308065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:12.332846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] MFA Rules not processed for user `5e649208bced4491a7b55c088977bb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:12.335886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:12.358603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1742/3527] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:12.359334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:12.372475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffe8a9-2795-402a-ac64-cd8c9f148038 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:12.382702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e649208bced4491a7b55c088977bb38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4aa10e97a94f21a6dad0d99266358e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2079758184', 'tempest-DelegatedRole-1642320208'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:12.383370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:12.383651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:12.383928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:12.384671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorizing `identity:create_trust()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:12.390372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:12.617468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1786/3528] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:12.619298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:12.633125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9504477-dc61-47df-ac00-e90ebcf46459 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:12.654022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e649208bced4491a7b55c088977bb38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4aa10e97a94f21a6dad0d99266358e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2079758184', 'tempest-DelegatedRole-1642320208'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:12.656108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:12.656508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:12.658147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:12.659527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:12.665395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:12.688483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:12.688844 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1743/3529] 10.222.0.27 () {58 vars in 1251 bytes} [Sun Jul 24 01:19:12 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=5e649208bced4491a7b55c088977bb38 => generated 611 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:12.702510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289308-9ae7-461a-b63c-d0574236cbee tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:12.727792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e649208bced4491a7b55c088977bb38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4aa10e97a94f21a6dad0d99266358e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2079758184', 'tempest-DelegatedRole-1642320208'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:12.728921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:12.729206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:12.733915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] PATH_INFO: `/v3/OS-TRUST/trusts/46847ae2a1fa484e93eecab186e32ed7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:12.766585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorizing `identity:delete_trust(trust_id=46847ae2a1fa484e93eecab186e32ed7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:12.771341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:12.847413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '46847ae2a1fa484e93eecab186e32ed7', 'request_id': 'req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:12.862175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '46847ae2a1fa484e93eecab186e32ed7', 'request_id': 'req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:12.863070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '46847ae2a1fa484e93eecab186e32ed7', 'request_id': 'req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:12.878479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1787/3530] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:19:12 2022] DELETE /identity/v3/OS-TRUST/trusts/46847ae2a1fa484e93eecab186e32ed7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:12.879855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:12.883065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:12.909566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bd7a-93d9-4c93-90e7-27b0e2179697 tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:12.918907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e649208bced4491a7b55c088977bb38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4aa10e97a94f21a6dad0d99266358e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2079758184', 'tempest-DelegatedRole-1642320208'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:12.922877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:12.928390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:12.930327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] PATH_INFO: `/v3/OS-TRUST/trusts/46847ae2a1fa484e93eecab186e32ed7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Could not find trust: 46847ae2a1fa484e93eecab186e32ed7.: keystone.exception.TrustNotFound: Could not find trust: 46847ae2a1fa484e93eecab186e32ed7. Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 24 01:19:12.975892 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 46847ae2a1fa484e93eecab186e32ed7. Jul 24 01:19:12.976815 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:19:12.981638 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1744/3531] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:12 2022] GET /identity/v3/OS-TRUST/trusts/46847ae2a1fa484e93eecab186e32ed7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:12.985903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:12.987447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:13.016858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f97aeb-35fc-4225-a63e-dd8378c1fe6e tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:13.031850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:13.032749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:13.033035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:13.033303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/67ee5339c4dd4ec0a63148cc1fdf2e4e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:13.036937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=67ee5339c4dd4ec0a63148cc1fdf2e4e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:13.038696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:13.138553 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:13.147094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 67ee5339c4dd4ec0a63148cc1fdf2e4e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:13.147955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.151509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.170332 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1788/3532] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:12 2022] DELETE /identity/v3/roles/67ee5339c4dd4ec0a63148cc1fdf2e4e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:13.171493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:13.175644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:13.223489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810fe92-bc5c-477d-92ed-7d063afe1aea tempest-TrustsV3TestJSON-387047098 tempest-user-187777327] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:13.421641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:13.422858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:13.423303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:13.424086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/3c48f07d06e64da2b7d18d583f5bc14e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:13.427658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c48f07d06e64da2b7d18d583f5bc14e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:13.430982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:13.562894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 3c48f07d06e64da2b7d18d583f5bc14e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:13.563601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.566746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.571787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1745/3533] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:13 2022] DELETE /identity/v3/roles/3c48f07d06e64da2b7d18d583f5bc14e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:13.576808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:13.605597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe027d6e-b55e-449a-bc12-a3bc0b11de01 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:13.866521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:13.867525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:13.867806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:13.868076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/5e649208bced4491a7b55c088977bb38` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:13.870896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5e649208bced4491a7b55c088977bb38)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:13.872863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:13.976705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e649208bced4491a7b55c088977bb38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.979357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e649208bced4491a7b55c088977bb38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:13.998891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e649208bced4491a7b55c088977bb38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.011693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e649208bced4491a7b55c088977bb38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.087082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e649208bced4491a7b55c088977bb38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.117592 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1789/3534] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:13 2022] DELETE /identity/v3/users/5e649208bced4491a7b55c088977bb38 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:14.118418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:14.120145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:14.185304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574769-7009-405f-b0ff-e518390b9ee0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:14.435085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:14.436078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:14.436266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:14.436542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/6c4aa10e97a94f21a6dad0d99266358e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:14.443326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c4aa10e97a94f21a6dad0d99266358e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:14.445773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:14.585565 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:14.620059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4aa10e97a94f21a6dad0d99266358e', 'request_id': 'req-73b36d4e-779c-4399-8d29-ddc2d7a7c514'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.640897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4aa10e97a94f21a6dad0d99266358e', 'request_id': 'req-73b36d4e-779c-4399-8d29-ddc2d7a7c514'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.682032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4aa10e97a94f21a6dad0d99266358e', 'request_id': 'req-73b36d4e-779c-4399-8d29-ddc2d7a7c514'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.726285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project 6c4aa10e97a94f21a6dad0d99266358e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:14.728414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.733722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:14.747195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1746/3535] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:14 2022] DELETE /identity/v3/projects/6c4aa10e97a94f21a6dad0d99266358e => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:14.748972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:14.752526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:14.783120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09195d-0be3-413e-af75-8a8760184634 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:14.852578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:14.855044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:14.989317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b36d4e-779c-4399-8d29-ddc2d7a7c514 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:14.999378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.000807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.001257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.001747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.004037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:15.004171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.004856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.005134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.005414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.006266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.019230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.025312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.028141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.047226 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1747/3536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:15.086093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1790/3537] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:14 2022] POST /identity/v3/projects => generated 328 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:15.091058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:15.092545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:15.145100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dd99-7669-4c9b-9969-8f370079d841 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:15.343034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.344129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.344563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.344998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.346052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.348241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.385917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:15.386154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1748/3538] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:15 2022] POST /identity/v3/users => generated 416 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:15.394506 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:15.402035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e1b31-9260-4441-9cb0-e79706b82c6a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:15.421222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.422178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.422463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.422742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.423504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.440924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.491145 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1791/3539] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:15 2022] POST /identity/v3/roles => generated 244 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:15.495298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:15.512508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a59702-e6bb-49c7-919b-4867c9e05305 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:15.530885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.530885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.530885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.531457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.531457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.534543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.574471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:15.575210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1749/3540] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:15 2022] POST /identity/v3/roles => generated 246 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:15.592483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1ddd-f998-429a-92e3-5a5e5a67d0e3 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:15.608896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.610289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.610900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.611295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/67cde3860b1e4764afb622ea8923327c/users/722155b2cc904322922120750c067f03/roles/7206377ee69e461fbd70c6fc704f7b36` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.648199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=67cde3860b1e4764afb622ea8923327c, user_id=722155b2cc904322922120750c067f03, role_id=7206377ee69e461fbd70c6fc704f7b36)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.650895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.676678 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1792/3541] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:15 2022] PUT /identity/v3/projects/67cde3860b1e4764afb622ea8923327c/users/722155b2cc904322922120750c067f03/roles/7206377ee69e461fbd70c6fc704f7b36 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:15.682895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:15.714530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25000-4239-4687-bedc-557ff5db77c9 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:15.820395 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:UPDATE=1,keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:15.940968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:15.940968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:15.941376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:15.941783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/67cde3860b1e4764afb622ea8923327c/users/722155b2cc904322922120750c067f03/roles/da53c6f632c64771a841cfb4d06b4579` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:15.949595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=67cde3860b1e4764afb622ea8923327c, user_id=722155b2cc904322922120750c067f03, role_id=da53c6f632c64771a841cfb4d06b4579)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:15.953793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a98791-e13f-48a2-9492-d1711ae905b8 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:15.995926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1750/3542] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:15 2022] PUT /identity/v3/projects/67cde3860b1e4764afb622ea8923327c/users/722155b2cc904322922120750c067f03/roles/da53c6f632c64771a841cfb4d06b4579 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:15.998331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:16.020331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f236fa-aa81-4faa-a164-f53ba5507658 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:16.189927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:16.192088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:16.192811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:16.195565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:16.198736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:16.203754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f9e2-0477-44bb-a5cd-971e1c26f320 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:16.276439 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1793/3543] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:15 2022] GET /identity/v3/users => generated 8936 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:16.281192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:16.282133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:16.283251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:16.431571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] MFA Rules not processed for user `722155b2cc904322922120750c067f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:16.433657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:16.587386 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1751/3544] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:16.590570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:16.590875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:16.591348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:16.643032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] MFA Rules not processed for user `722155b2cc904322922120750c067f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:16.645236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:16.670934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:16.672378 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1794/3545] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:16.686382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4f3ad-2b08-4e33-83ee-6653782f4c36 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:16.694931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:16.695747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:16.696139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:16.696520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:16.697503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:create_trust()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:16.708723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:16.924680 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1752/3546] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:16 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:16.928189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:16.938227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c0ea-5d22-4981-8ceb-2829fa4be543 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:16.949429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:16.950319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:16.950599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:16.950918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:16.966890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:get_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:16.968368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.002001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1795/3547] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:16 2022] GET /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586 => generated 859 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:17.006627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.024629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df676-f68c-4cbe-aecf-36bc89ab217f tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.035679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.040290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.042539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.043001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.071709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.073649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.132432 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1753/3548] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:19:17 2022] GET /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles => generated 371 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:17.135920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.152954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006bfa-eced-4f58-9717-5d621fd57b53 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.168624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.169647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.170195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.170716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/7206377ee69e461fbd70c6fc704f7b36` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.186384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:get_role_for_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586, role_id=7206377ee69e461fbd70c6fc704f7b36)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.188020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.236602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1796/3549] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:17 2022] GET /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/7206377ee69e461fbd70c6fc704f7b36 => generated 244 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:17.241934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.258622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe4096-f08d-472c-89c4-d8e2800dc217 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.270242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.272756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.272756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.278108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/7206377ee69e461fbd70c6fc704f7b36` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.291632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:get_role_for_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586, role_id=7206377ee69e461fbd70c6fc704f7b36)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.293099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.297842 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:17.303328 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1754/3550] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:17 2022] HEAD /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/7206377ee69e461fbd70c6fc704f7b36 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 24 01:19:17.308414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.318750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09e99c-1eb8-4ef0-8f48-8430b4bbac33 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.324448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.325418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.325870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.326512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/da53c6f632c64771a841cfb4d06b4579` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.336925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:get_role_for_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586, role_id=da53c6f632c64771a841cfb4d06b4579)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.339124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d16ccf7e-feed-4342-b024-053874a1d5f3 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Could not find role: da53c6f632c64771a841cfb4d06b4579.: keystone.exception.RoleNotFound: Could not find role: da53c6f632c64771a841cfb4d06b4579. Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:17.358833 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:17.359714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: da53c6f632c64771a841cfb4d06b4579. Jul 24 01:19:17.359714 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:17.377767 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1797/3551] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:17 2022] GET /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/da53c6f632c64771a841cfb4d06b4579 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:17.379114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.383642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.384146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.384598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.391121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526fd67-46fe-4d48-97b9-5bad473d519e tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.396393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.398099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.398565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.399015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/da53c6f632c64771a841cfb4d06b4579` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.411890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:get_role_for_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586, role_id=da53c6f632c64771a841cfb4d06b4579)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.416106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.430595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:17.432271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Could not find role: da53c6f632c64771a841cfb4d06b4579.: keystone.exception.RoleNotFound: Could not find role: da53c6f632c64771a841cfb4d06b4579. Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:17.451094 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:17.452018 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: da53c6f632c64771a841cfb4d06b4579. Jul 24 01:19:17.452018 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:19:17.463970 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1755/3552] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:17 2022] HEAD /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586/roles/da53c6f632c64771a841cfb4d06b4579 => generated 0 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 24 01:19:17.465190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.486041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a39e5-dff6-473a-b696-3b3bc2026e5a tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.499435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.500436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.500826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.501204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.512713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorizing `identity:delete_trust(trust_id=70c0252b2d274d09af8d934dbd5bb586)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.514399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.555029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '70c0252b2d274d09af8d934dbd5bb586', 'request_id': 'req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:17.556530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '70c0252b2d274d09af8d934dbd5bb586', 'request_id': 'req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:17.566961 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1798/3553] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:17.571468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '70c0252b2d274d09af8d934dbd5bb586', 'request_id': 'req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:17.589725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.591623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1756/3554] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:19:17 2022] DELETE /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:17.604318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ec223-aa5f-4abc-8193-3e979838534f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.611364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722155b2cc904322922120750c067f03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67cde3860b1e4764afb622ea8923327c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1375285272', 'tempest-NotDelegatedRole-475719968'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.612683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.613265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.613800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] PATH_INFO: `/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.619854 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Could not find trust: 70c0252b2d274d09af8d934dbd5bb586.: keystone.exception.TrustNotFound: Could not find trust: 70c0252b2d274d09af8d934dbd5bb586. Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 24 01:19:17.646319 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 70c0252b2d274d09af8d934dbd5bb586. Jul 24 01:19:17.648252 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:17.650131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1799/3555] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:17 2022] GET /identity/v3/OS-TRUST/trusts/70c0252b2d274d09af8d934dbd5bb586 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:17.654875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.656538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:17.698113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd907e2-49dc-46b9-84c8-5c55dd6a5d5b tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.712924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.715839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.717869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.718319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/da53c6f632c64771a841cfb4d06b4579` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.721144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da53c6f632c64771a841cfb4d06b4579)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.726379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:17.804932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role da53c6f632c64771a841cfb4d06b4579 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:17.805723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:17.806654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:17.830089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:17.831065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1757/3556] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:17 2022] DELETE /identity/v3/roles/da53c6f632c64771a841cfb4d06b4579 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:17.833113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:17.855431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebced2a2-fdaa-4b8a-9426-4a05e04e7e39 tempest-TrustsV3TestJSON-915709858 tempest-user-1538728073] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:17.993585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:17.994326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:17.994645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:17.994994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/7206377ee69e461fbd70c6fc704f7b36` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:17.996766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7206377ee69e461fbd70c6fc704f7b36)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:17.999829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:18.054544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 7206377ee69e461fbd70c6fc704f7b36 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:18.055938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.063967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.067237 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1800/3557] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:17 2022] DELETE /identity/v3/roles/7206377ee69e461fbd70c6fc704f7b36 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:18.072627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:18.104664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db36c5-2b48-4a93-8fed-a9072ee7a728 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:18.304164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:18.304823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:18.304823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:18.305013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/722155b2cc904322922120750c067f03` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:18.306240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=722155b2cc904322922120750c067f03)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:18.308688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:18.428751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722155b2cc904322922120750c067f03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.448597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722155b2cc904322922120750c067f03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.480006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722155b2cc904322922120750c067f03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.482655 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:18.516289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722155b2cc904322922120750c067f03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.517165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722155b2cc904322922120750c067f03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.536208 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1758/3558] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:18 2022] DELETE /identity/v3/users/722155b2cc904322922120750c067f03 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:18.537418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:18.539309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:18.565008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969b20-fdbe-437d-99e8-13cf18a3196a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:18.701221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:18.702156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:18.702446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:18.702725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/67cde3860b1e4764afb622ea8923327c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:18.704891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=67cde3860b1e4764afb622ea8923327c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:18.707023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:18.783807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cde3860b1e4764afb622ea8923327c', 'request_id': 'req-5c842b30-7354-4347-a6ad-46decab5ee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.791305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cde3860b1e4764afb622ea8923327c', 'request_id': 'req-5c842b30-7354-4347-a6ad-46decab5ee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.801427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cde3860b1e4764afb622ea8923327c', 'request_id': 'req-5c842b30-7354-4347-a6ad-46decab5ee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.804183 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:18.828679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project 67cde3860b1e4764afb622ea8923327c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:18.829229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.829983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:18.838893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:18.840539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:18.842652 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1801/3559] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:18 2022] DELETE /identity/v3/projects/67cde3860b1e4764afb622ea8923327c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:18.856770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e96b8-bc1f-4e65-b913-46c226b9e178 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:18.938853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:18.939450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:18.941416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:18.941732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:18.942455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:18.945057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:18.986848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1759/3560] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:18 2022] POST /identity/v3/projects => generated 328 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:18.990914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:18.992912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:19.028456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c842b30-7354-4347-a6ad-46decab5ee5d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.114093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.114905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.115084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.115396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.116137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.118158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.161419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1802/3561] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:18 2022] POST /identity/v3/users => generated 416 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:19.165827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:19.185503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d888d0-14c8-4043-8898-55ec4896da99 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.192796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.196077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.196738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.197242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.198804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.202317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.236003 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1760/3562] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:19 2022] POST /identity/v3/roles => generated 243 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:19.239653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:19.266023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39541e-16f1-416a-a14e-63f7bbd8bf27 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.286428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.287414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.287707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.288674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.295349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.297555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.337354 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1803/3563] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:19 2022] POST /identity/v3/roles => generated 246 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:19.341406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:19.360675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed88db0-f3e7-400e-a8bc-609598ec6a98 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.380363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.382684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.382970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.383252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853/users/94a556ac67864d988c0504b030d4e0ec/roles/046ff1fdb01c479faf829e206f96e493` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.443989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=64b6a5cd1b124bfb9a5ac17dfed68853, user_id=94a556ac67864d988c0504b030d4e0ec, role_id=046ff1fdb01c479faf829e206f96e493)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.462358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.496150 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1761/3564] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:19 2022] PUT /identity/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853/users/94a556ac67864d988c0504b030d4e0ec/roles/046ff1fdb01c479faf829e206f96e493 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:19.500127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:19.527584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068ead-7587-47a1-b568-0e27c1343f0b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.670361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.671634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.672103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.672411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853/users/94a556ac67864d988c0504b030d4e0ec/roles/1a2f7aee1c074c8480ce6aebd86b7c09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.680204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=64b6a5cd1b124bfb9a5ac17dfed68853, user_id=94a556ac67864d988c0504b030d4e0ec, role_id=1a2f7aee1c074c8480ce6aebd86b7c09)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.683329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc68913-f436-4031-9312-feaffbc93821 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.716482 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1804/3565] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:19 2022] PUT /identity/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853/users/94a556ac67864d988c0504b030d4e0ec/roles/1a2f7aee1c074c8480ce6aebd86b7c09 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:19.717779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:19.738101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dfc25-2b10-4b41-ba54-ebb95ef724bc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:19.870604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:19.871242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.871608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.871961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:19.872838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:19.875144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1de7d-f060-430f-b877-5dbbb16e73b6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:19.974341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1762/3566] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:19 2022] GET /identity/v3/users => generated 8936 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:19.976872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:19.977166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:19.977514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:20.070897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] MFA Rules not processed for user `94a556ac67864d988c0504b030d4e0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:20.072157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:20.175012 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:20.215933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1805/3567] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:20.227669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:20.229150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:20.229659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:20.273431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] MFA Rules not processed for user `94a556ac67864d988c0504b030d4e0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:20.280357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:20.312567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:20.314106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1763/3568] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:20.324702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe36704-3e70-41d2-8d50-fa0d2bb6bda7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:20.349318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94a556ac67864d988c0504b030d4e0ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b6a5cd1b124bfb9a5ac17dfed68853', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-410479451', 'tempest-DelegatedRole-385854612'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:20.350638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:20.350966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:20.351326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:20.352177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] RBAC: Authorizing `identity:create_trust()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:20.356746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 24 01:19:20.558725 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 24 01:19:20.559913 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 24 01:19:20.561119 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:20.563351 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1806/3569] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 251 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 24 01:19:20.568079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:20.596628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d060-5ff5-47af-b1cc-069b30f39483 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:20.623658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:20.625247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:20.626523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:20.627250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/1a2f7aee1c074c8480ce6aebd86b7c09` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:20.630846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1a2f7aee1c074c8480ce6aebd86b7c09)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:20.634083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:20.665051 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:20.741466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 1a2f7aee1c074c8480ce6aebd86b7c09 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:20.745162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:20.746940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:20.754011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1764/3570] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:20 2022] DELETE /identity/v3/roles/1a2f7aee1c074c8480ce6aebd86b7c09 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:20.759175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:20.761578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:20.802679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a1485-7a21-45cd-9f2b-9767c033d319 tempest-TrustsV3TestJSON-908158799 tempest-user-1300499911] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:21.013397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:21.014363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:21.014651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:21.014932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/046ff1fdb01c479faf829e206f96e493` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:21.017006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=046ff1fdb01c479faf829e206f96e493)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:21.018420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:21.110196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 046ff1fdb01c479faf829e206f96e493 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:21.110505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.112695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.118738 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1807/3571] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:20 2022] DELETE /identity/v3/roles/046ff1fdb01c479faf829e206f96e493 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:21.126008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:21.151178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec716e-0a2d-4f0d-85be-021fc060af05 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:21.344673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:21.345495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:21.345862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:21.346102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/94a556ac67864d988c0504b030d4e0ec` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:21.351824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=94a556ac67864d988c0504b030d4e0ec)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:21.354288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:21.435793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a556ac67864d988c0504b030d4e0ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.450351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a556ac67864d988c0504b030d4e0ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.463078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a556ac67864d988c0504b030d4e0ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.493410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a556ac67864d988c0504b030d4e0ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.495136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a556ac67864d988c0504b030d4e0ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.508274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1765/3572] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:21 2022] DELETE /identity/v3/users/94a556ac67864d988c0504b030d4e0ec => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:21.512227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:21.514036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:21.547333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7129e-e711-4f3a-9fd6-1bc6ec01047d tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:21.684045 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:21.707344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:21.708269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:21.708558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:21.709997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:21.714194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64b6a5cd1b124bfb9a5ac17dfed68853)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:21.716211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:21.819773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b6a5cd1b124bfb9a5ac17dfed68853', 'request_id': 'req-ff16d189-9772-43fb-aa3c-2f62feaf7013'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.826816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b6a5cd1b124bfb9a5ac17dfed68853', 'request_id': 'req-ff16d189-9772-43fb-aa3c-2f62feaf7013'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.836775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b6a5cd1b124bfb9a5ac17dfed68853', 'request_id': 'req-ff16d189-9772-43fb-aa3c-2f62feaf7013'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.864047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project 64b6a5cd1b124bfb9a5ac17dfed68853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:21.864352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.871891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:21.874669 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1808/3573] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:21 2022] DELETE /identity/v3/projects/64b6a5cd1b124bfb9a5ac17dfed68853 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:21.882469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:21.884642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:21.928904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ad00-ce26-4df3-a3b7-f22502ec89e0 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.068315 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:22.081032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.083035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.085755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.086053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.088296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.090491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.170421 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1766/3574] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:21 2022] POST /identity/v3/projects => generated 329 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:22.174836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.176802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:22.212592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16d189-9772-43fb-aa3c-2f62feaf7013 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.305392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.306485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.306934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.307364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.308232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.311185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.342784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1809/3575] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:22 2022] POST /identity/v3/users => generated 416 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:22.346664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.359698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02d26-2bd6-40d0-bd04-7ef68fb08390 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.364812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.365934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.366303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.366657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.367649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.370352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.400199 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1767/3576] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:22 2022] POST /identity/v3/roles => generated 244 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:22.403929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.417929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569ee0-649e-4a34-bfec-9d1e1cc121db tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.423969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.424823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.425176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.425524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.426395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.428955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.450444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1810/3577] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:22 2022] POST /identity/v3/roles => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:22.451737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.465797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f140b-601a-42f2-8295-7ac82cfae145 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.472052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.473334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.473932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.474318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/b9cd75c233d2427d83115fa61ef71e49/users/7c874358ebae4af89d31cc1440d4806d/roles/eddf3482a55a4c129b7fea17598eab60` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.495889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd75c233d2427d83115fa61ef71e49, user_id=7c874358ebae4af89d31cc1440d4806d, role_id=eddf3482a55a4c129b7fea17598eab60)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.498700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.515945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1768/3578] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:22 2022] PUT /identity/v3/projects/b9cd75c233d2427d83115fa61ef71e49/users/7c874358ebae4af89d31cc1440d4806d/roles/eddf3482a55a4c129b7fea17598eab60 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:22.519855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.531053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729072-167c-4993-95b0-b20df54113cb tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.603992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.605283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.605890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.606272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/b9cd75c233d2427d83115fa61ef71e49/users/7c874358ebae4af89d31cc1440d4806d/roles/43b741cab3ea4286a8b3e47a4dba0327` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.608746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd75c233d2427d83115fa61ef71e49, user_id=7c874358ebae4af89d31cc1440d4806d, role_id=43b741cab3ea4286a8b3e47a4dba0327)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.612085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e54adc-b970-436e-b432-14316107892f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.615292 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:22.633144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1811/3579] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:22 2022] PUT /identity/v3/projects/b9cd75c233d2427d83115fa61ef71e49/users/7c874358ebae4af89d31cc1440d4806d/roles/43b741cab3ea4286a8b3e47a4dba0327 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:22.637073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:22.650666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5213-8945-4106-a346-04a773905184 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:22.720316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:22.721018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.721315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.722098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.722653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:22.725603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f2731-1ff7-48e9-9df5-be9880ed96fc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:22.799085 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1769/3580] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:22 2022] GET /identity/v3/users => generated 8936 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:22.800608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:22.801248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:22.801861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:22.864020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] MFA Rules not processed for user `7c874358ebae4af89d31cc1440d4806d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:22.865171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:22.948446 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1812/3581] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:23.030776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.031324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.031324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.054708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] MFA Rules not processed for user `7c874358ebae4af89d31cc1440d4806d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:23.055950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:23.068881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.070028 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1770/3582] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:23.079440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3cc5-ad5f-4f3a-8a6a-38e14c97c825 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.085185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.086093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.086574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.087029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.088439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:create_trust()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.090002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.190964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1813/3583] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:23 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:23.192201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.202234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc71c-a8b3-407e-a9c8-cb93171ac68d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.207621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.208779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.210380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.210840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.219144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:get_trust(trust_id=0f8bd308463a4893af2f290f27a09769)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.220963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.232094 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1771/3584] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:23 2022] GET /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769 => generated 834 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:23.236196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.252139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9971b-88ed-4def-acdf-75f89a8a37a1 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.282578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.284283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.284716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.285140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.294551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0f8bd308463a4893af2f290f27a09769)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.298907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.320764 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1814/3585] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:19:23 2022] GET /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles => generated 371 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:23.324701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.336608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44887053-1b2f-4596-8387-d62f68537e8b tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.343591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.344592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.344977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.345319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/eddf3482a55a4c129b7fea17598eab60` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.354634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f8bd308463a4893af2f290f27a09769, role_id=eddf3482a55a4c129b7fea17598eab60)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.356229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.366518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1772/3586] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:23 2022] GET /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/eddf3482a55a4c129b7fea17598eab60 => generated 244 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:23.371047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.385168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591bce-8380-40e6-8fc1-2f88aab0cda2 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.391972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.394174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.394679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.395158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/eddf3482a55a4c129b7fea17598eab60` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.404606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f8bd308463a4893af2f290f27a09769, role_id=eddf3482a55a4c129b7fea17598eab60)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.406234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.416292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1815/3587] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:23 2022] HEAD /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/eddf3482a55a4c129b7fea17598eab60 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 24 01:19:23.420469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.432816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56199d-58b2-4429-972f-0aa810300a6d tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.441911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.442901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.444636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.444636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/43b741cab3ea4286a8b3e47a4dba0327` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.452383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f8bd308463a4893af2f290f27a09769, role_id=43b741cab3ea4286a8b3e47a4dba0327)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.454049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Could not find role: 43b741cab3ea4286a8b3e47a4dba0327.: keystone.exception.RoleNotFound: Could not find role: 43b741cab3ea4286a8b3e47a4dba0327. Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:23.475945 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:23.477047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 43b741cab3ea4286a8b3e47a4dba0327. Jul 24 01:19:23.477047 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:19:23.480767 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1773/3588] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:23 2022] GET /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/43b741cab3ea4286a8b3e47a4dba0327 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:23.482501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.493843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ab5b5-3f5e-4e7f-9ff7-d36e6ebf2413 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.501027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.501991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.502375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.502709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/43b741cab3ea4286a8b3e47a4dba0327` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.511469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f8bd308463a4893af2f290f27a09769, role_id=43b741cab3ea4286a8b3e47a4dba0327)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.514157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Could not find role: 43b741cab3ea4286a8b3e47a4dba0327.: keystone.exception.RoleNotFound: Could not find role: 43b741cab3ea4286a8b3e47a4dba0327. Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:23.534955 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:23.536547 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 43b741cab3ea4286a8b3e47a4dba0327. Jul 24 01:19:23.536547 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:23.536547 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1816/3589] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:23 2022] HEAD /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769/roles/43b741cab3ea4286a8b3e47a4dba0327 => generated 0 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:23.540686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.558705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd66850-bfb0-4e40-a59a-71708727e486 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.566805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.567804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.569158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.569460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.587712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorizing `identity:delete_trust(trust_id=0f8bd308463a4893af2f290f27a09769)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.589308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.613494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0f8bd308463a4893af2f290f27a09769', 'request_id': 'req-41027c1a-4be5-4519-83c3-83359d21a3ff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:23.614698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0f8bd308463a4893af2f290f27a09769', 'request_id': 'req-41027c1a-4be5-4519-83c3-83359d21a3ff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:23.627687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0f8bd308463a4893af2f290f27a09769', 'request_id': 'req-41027c1a-4be5-4519-83c3-83359d21a3ff'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:23.631562 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:23.639393 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1774/3590] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:19:23 2022] DELETE /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:23.651856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.651856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:23.687499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5144692-b594-44bd-8c34-43f504b6f2ed tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.702054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c874358ebae4af89d31cc1440d4806d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cd75c233d2427d83115fa61ef71e49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-866582157', 'tempest-DelegatedRole-1838691874'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.703046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.703433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.703941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] PATH_INFO: `/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Could not find trust: 0f8bd308463a4893af2f290f27a09769.: keystone.exception.TrustNotFound: Could not find trust: 0f8bd308463a4893af2f290f27a09769. Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 24 01:19:23.723412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0f8bd308463a4893af2f290f27a09769. Jul 24 01:19:23.724618 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:23.729839 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1817/3591] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:23 2022] GET /identity/v3/OS-TRUST/trusts/0f8bd308463a4893af2f290f27a09769 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:23.732631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.735551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:23.764750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027c1a-4be5-4519-83c3-83359d21a3ff tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:23.782541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:23.785115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:23.785428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:23.785743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/43b741cab3ea4286a8b3e47a4dba0327` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:23.788249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=43b741cab3ea4286a8b3e47a4dba0327)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:23.790364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:23.860855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 43b741cab3ea4286a8b3e47a4dba0327 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:23.861078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:23.862801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:23.867869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1775/3592] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:23 2022] DELETE /identity/v3/roles/43b741cab3ea4286a8b3e47a4dba0327 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:23.871821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:23.874233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:23.902258 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:23.910483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671024-ed7f-4d7e-8f8f-01a09fff4d57 tempest-TrustsV3TestJSON-1085590901 tempest-user-1867075950] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:24.043129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:24.044261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:24.044741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:24.045258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/eddf3482a55a4c129b7fea17598eab60` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:24.047299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eddf3482a55a4c129b7fea17598eab60)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:24.059002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:24.138761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role eddf3482a55a4c129b7fea17598eab60 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:24.139362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.140319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.144154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1818/3593] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:23 2022] DELETE /identity/v3/roles/eddf3482a55a4c129b7fea17598eab60 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:24.149508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:24.165894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14c51e-49a8-4efe-9f68-e73bce9db95a tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:24.264639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:24.265732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:24.266128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:24.266644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/7c874358ebae4af89d31cc1440d4806d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:24.268280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7c874358ebae4af89d31cc1440d4806d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:24.270459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:24.351313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c874358ebae4af89d31cc1440d4806d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.371416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c874358ebae4af89d31cc1440d4806d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.387629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c874358ebae4af89d31cc1440d4806d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.413626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c874358ebae4af89d31cc1440d4806d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.414406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c874358ebae4af89d31cc1440d4806d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.423281 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1776/3594] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:24 2022] DELETE /identity/v3/users/7c874358ebae4af89d31cc1440d4806d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:24.427143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:24.429298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:24.474511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b621-025b-41c7-bbed-423aa9cf60c6 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:24.611115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:24.620843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:24.621399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:24.621864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/b9cd75c233d2427d83115fa61ef71e49` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:24.627680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9cd75c233d2427d83115fa61ef71e49)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:24.634616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:24.828600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cd75c233d2427d83115fa61ef71e49', 'request_id': 'req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.844671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cd75c233d2427d83115fa61ef71e49', 'request_id': 'req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.859889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cd75c233d2427d83115fa61ef71e49', 'request_id': 'req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.869713 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:24.878123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project b9cd75c233d2427d83115fa61ef71e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:24.878602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.883424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:24.899008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1819/3595] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:24 2022] DELETE /identity/v3/projects/b9cd75c233d2427d83115fa61ef71e49 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:24.900149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:24.901630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:24.929501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f04a5-3181-42b7-bae1-23767f4e2e33 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.010424 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:25.059332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.060037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.060325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.060615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.064200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.065842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.158780 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1777/3596] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:19:24 2022] POST /identity/v3/projects => generated 328 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:25.163174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.164736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:25.183648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea1719-7cb4-4619-b71e-c8a2aa5918ce tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.284382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.285062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.285356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.285637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.286440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.289794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.323621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1820/3597] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:25 2022] POST /identity/v3/users => generated 413 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:25.324189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.339509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996b43c-5bc0-4a03-9b71-4b9679a417be tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.345024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.345961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.346916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.346916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.347507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.349301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.380470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.393156 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1778/3598] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:25 2022] POST /identity/v3/roles => generated 244 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:25.399123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a853-9797-4c57-acf5-63de87293678 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.409424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.412314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.412757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.415041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.416154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.418734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.439867 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1821/3599] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:19:25 2022] POST /identity/v3/roles => generated 246 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:25.444432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.460968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a69e3-8be7-4d73-95af-84bc4cb51fcc tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.473908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.474865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.475160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.475441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/bc782f5733894f0381363fc1bd858d93/users/6a0124691c614800b35a2efd17c83a12/roles/6a1328eb277f430786f23414e3693900` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.514996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bc782f5733894f0381363fc1bd858d93, user_id=6a0124691c614800b35a2efd17c83a12, role_id=6a1328eb277f430786f23414e3693900)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.520925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.551284 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1779/3600] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:25 2022] PUT /identity/v3/projects/bc782f5733894f0381363fc1bd858d93/users/6a0124691c614800b35a2efd17c83a12/roles/6a1328eb277f430786f23414e3693900 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:25.556358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.582976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bebcf-9cce-43a5-aad4-2ce0132801e4 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.714236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.716983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.717766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.718234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/bc782f5733894f0381363fc1bd858d93/users/6a0124691c614800b35a2efd17c83a12/roles/4d7db3a4ad58488685d0dce14f4b0ff9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.727021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bc782f5733894f0381363fc1bd858d93, user_id=6a0124691c614800b35a2efd17c83a12, role_id=4d7db3a4ad58488685d0dce14f4b0ff9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.731955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44c71-716b-4b8e-be0e-8b199ebb232f tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.754529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1822/3601] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:25 2022] PUT /identity/v3/projects/bc782f5733894f0381363fc1bd858d93/users/6a0124691c614800b35a2efd17c83a12/roles/4d7db3a4ad58488685d0dce14f4b0ff9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:25.759327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:25.784179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370a4a-f492-427a-8a37-8c0b74c23c7c tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:25.909235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:25.909983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.910277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.911048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.912984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:25.915668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b2bc0-7e58-437e-b646-cdb42a411a88 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:25.967181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:25.967473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:25.967758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:25.980948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1780/3602] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:25 2022] GET /identity/v3/users => generated 8933 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:26.033958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] MFA Rules not processed for user `6a0124691c614800b35a2efd17c83a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:26.035264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:26.163917 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:26.231609 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1823/3603] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:26.242601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.243476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.244077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.264378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] MFA Rules not processed for user `6a0124691c614800b35a2efd17c83a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:26.266033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:26.275729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1781/3604] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:26.279745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.295488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa240-a5b4-451f-9673-c047159851a5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.307696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.308558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.308857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.309135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.310703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:create_trust()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.311905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.432052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.433550 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1824/3605] 10.222.0.27 () {60 vars in 1173 bytes} [Sun Jul 24 01:19:26 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:26.446323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b0352-64bb-44a0-9a80-873f4396a3de None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.454787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.460009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.460294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.460745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.473606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:get_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.475715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.490625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1782/3606] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:26 2022] GET /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1 => generated 835 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:26.494654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.508842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b1b3d-0711-4ef3-960f-bcf12cefc403 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.510735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.511700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.512099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.512492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.520305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.522638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.535397 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1825/3607] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:19:26 2022] GET /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:26.536251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.550220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae6650-be26-4c4a-8481-424abc398235 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.556444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.558249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.558610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.558902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/6a1328eb277f430786f23414e3693900` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.571474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1, role_id=6a1328eb277f430786f23414e3693900)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.572980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.587551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1783/3608] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:26 2022] GET /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/6a1328eb277f430786f23414e3693900 => generated 244 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:26.594110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.617438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0ca0-9bfb-44e8-a0c8-8914d922c266 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.625068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.626227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.626748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.627253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/6a1328eb277f430786f23414e3693900` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.636050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1, role_id=6a1328eb277f430786f23414e3693900)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.637944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.651802 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1826/3609] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:26 2022] HEAD /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/6a1328eb277f430786f23414e3693900 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 24 01:19:26.652283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.668432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612102d-0012-47a3-a934-e44c62ba6a24 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.685743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.689562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.690049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.690336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/4d7db3a4ad58488685d0dce14f4b0ff9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.710100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1, role_id=4d7db3a4ad58488685d0dce14f4b0ff9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.715085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9.: keystone.exception.RoleNotFound: Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9. Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:26.743932 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:26.745050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9. Jul 24 01:19:26.745050 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:19:26.749563 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1784/3610] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:19:26 2022] GET /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/4d7db3a4ad58488685d0dce14f4b0ff9 => generated 110 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:26.750839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.767659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9eb7-72e5-4fc2-939e-890d2ab2d6f1 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.781859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.783036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.783324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.783607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/4d7db3a4ad58488685d0dce14f4b0ff9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.795883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1, role_id=4d7db3a4ad58488685d0dce14f4b0ff9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.798798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9.: keystone.exception.RoleNotFound: Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9. Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 24 01:19:26.825214 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:19:26.826227 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4d7db3a4ad58488685d0dce14f4b0ff9. Jul 24 01:19:26.826227 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:26.830935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1827/3611] 10.222.0.27 () {58 vars in 1368 bytes} [Sun Jul 24 01:19:26 2022] HEAD /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1/roles/4d7db3a4ad58488685d0dce14f4b0ff9 => generated 0 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 24 01:19:26.832325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.845829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8f611-75bd-484f-9eb0-642ae0b9138b tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.853222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.854842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.855284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.855713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:26.864619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorizing `identity:delete_trust(trust_id=14b2f5e553a54a73b8950adc0b872ad1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:26.867310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:26.890576 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:26.923272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '14b2f5e553a54a73b8950adc0b872ad1', 'request_id': 'req-88613415-c182-4911-b3ad-b94ff6249d16'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:26.924227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '14b2f5e553a54a73b8950adc0b872ad1', 'request_id': 'req-88613415-c182-4911-b3ad-b94ff6249d16'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:26.939544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '14b2f5e553a54a73b8950adc0b872ad1', 'request_id': 'req-88613415-c182-4911-b3ad-b94ff6249d16'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:26.949110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1785/3612] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:19:26 2022] DELETE /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:26.954231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:26.957597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:26.980670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfad85-eca6-4e7a-adde-e20d0aa3347a tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:26.995120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0124691c614800b35a2efd17c83a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc782f5733894f0381363fc1bd858d93', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1611346612', 'tempest-NotDelegatedRole-423853029'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:26.996094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:26.996477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:26.997111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] PATH_INFO: `/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Could not find trust: 14b2f5e553a54a73b8950adc0b872ad1.: keystone.exception.TrustNotFound: Could not find trust: 14b2f5e553a54a73b8950adc0b872ad1. Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 24 01:19:27.026120 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 14b2f5e553a54a73b8950adc0b872ad1. Jul 24 01:19:27.027218 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:27.029907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1828/3613] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:19:26 2022] GET /identity/v3/OS-TRUST/trusts/14b2f5e553a54a73b8950adc0b872ad1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:19:27.033852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:27.035644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:27.072921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613415-c182-4911-b3ad-b94ff6249d16 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:27.089719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:27.090705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:27.091000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:27.091279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/4d7db3a4ad58488685d0dce14f4b0ff9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.092868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d7db3a4ad58488685d0dce14f4b0ff9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:27.094566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:27.229750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 4d7db3a4ad58488685d0dce14f4b0ff9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:27.230064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.232609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.236781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1786/3614] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:27 2022] DELETE /identity/v3/roles/4d7db3a4ad58488685d0dce14f4b0ff9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:27.241905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:27.244111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:27.285027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99813d27-648f-4b41-bbca-891e42814949 tempest-TrustsV3TestJSON-371335716 tempest-user-549656411] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:27.494574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:27.499639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:27.500658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:27.501159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/roles/6a1328eb277f430786f23414e3693900` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.503640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6a1328eb277f430786f23414e3693900)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:27.508183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:27.557325 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:27.587323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invalidating the token cache because role 6a1328eb277f430786f23414e3693900 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:27.587972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.589010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.593067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1829/3615] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:27 2022] DELETE /identity/v3/roles/6a1328eb277f430786f23414e3693900 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:27.597501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:27.612784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645be4d8-2a8d-4809-af3c-d78a504b6528 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:27.684313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:27.685273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:27.685566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:27.685890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/users/6a0124691c614800b35a2efd17c83a12` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.687602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a0124691c614800b35a2efd17c83a12)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:27.689609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:27.763090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0124691c614800b35a2efd17c83a12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.776438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0124691c614800b35a2efd17c83a12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.786782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0124691c614800b35a2efd17c83a12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.810894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0124691c614800b35a2efd17c83a12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.812670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0124691c614800b35a2efd17c83a12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:27.821030 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1787/3616] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:27 2022] DELETE /identity/v3/users/6a0124691c614800b35a2efd17c83a12 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:27.824810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:27.827230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:27.847691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0da77-5992-4386-879f-2d0c6cc290f1 tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:27.937757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46ac7ebd4194f32950bff917b1e0fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '565f181735f240888d2a239ea0460eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:27.939129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:27.939690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:27.940196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] PATH_INFO: `/v3/projects/bc782f5733894f0381363fc1bd858d93` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:27.942231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc782f5733894f0381363fc1bd858d93)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:27.944748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:28.052398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc782f5733894f0381363fc1bd858d93', 'request_id': 'req-e910e381-012d-49c8-b975-69bbf13424ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.063446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc782f5733894f0381363fc1bd858d93', 'request_id': 'req-e910e381-012d-49c8-b975-69bbf13424ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.079361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc782f5733894f0381363fc1bd858d93', 'request_id': 'req-e910e381-012d-49c8-b975-69bbf13424ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.134598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] The token cache is being invalidate because project bc782f5733894f0381363fc1bd858d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:28.134984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.135740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e910e381-012d-49c8-b975-69bbf13424ad tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.141937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1830/3617] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:27 2022] DELETE /identity/v3/projects/bc782f5733894f0381363fc1bd858d93 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:28.143599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:28.147618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:28.187221 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:28.311518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd653ea-3891-4415-9ccf-3c18a6bd855b tempest-TrustsV3TestJSON-1935549083 tempest-TrustsV3TestJSON-1935549083-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:28.488231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:28.489155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:28.489705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:28.489705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] PATH_INFO: `/v3/users/eef3e0171de8449b8538eb1444e0b6ac` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:28.493517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef3e0171de8449b8538eb1444e0b6ac)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:28.495550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:28.587877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef3e0171de8449b8538eb1444e0b6ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.597489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef3e0171de8449b8538eb1444e0b6ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.609501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef3e0171de8449b8538eb1444e0b6ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.626679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef3e0171de8449b8538eb1444e0b6ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.627511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef3e0171de8449b8538eb1444e0b6ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:28.636796 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1788/3618] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:28 2022] DELETE /identity/v3/users/eef3e0171de8449b8538eb1444e0b6ac => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:28.641216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe392d-8106-41f8-85c8-e521795b0a2e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:28.641543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe392d-8106-41f8-85c8-e521795b0a2e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:28.641838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe392d-8106-41f8-85c8-e521795b0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:28.677998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2dfe392d-8106-41f8-85c8-e521795b0a2e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:28.679263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dfe392d-8106-41f8-85c8-e521795b0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:28.761430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1831/3619] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:28.811928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:28.814262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:28.957086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:28.958342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:28.959147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:28.973418 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:28.989841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c047d-39b1-4f0e-bb25-9dedcf9de162 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:28.994640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] MFA Rules not processed for user `735a3f7d7e454f14a7a4ed229affd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:29.005272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:29.006963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:29.007263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:29.007545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:29.016698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:29.030275 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:29.030479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:29.032543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:29.059676 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1789/3620] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:29.110180 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1832/3621] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:30.296777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:30.300157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:30.330969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b20-f988-41dc-9e4e-80e957798b0d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:30.344652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:30.345773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:30.346178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:30.346561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] PATH_INFO: `/v3/projects/f80f3d5e573f46b4b2773c59b9410e44` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:30.350102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80f3d5e573f46b4b2773c59b9410e44)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:30.354624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:30.479861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80f3d5e573f46b4b2773c59b9410e44', 'request_id': 'req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.491965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80f3d5e573f46b4b2773c59b9410e44', 'request_id': 'req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.507210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80f3d5e573f46b4b2773c59b9410e44', 'request_id': 'req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.528377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] The token cache is being invalidate because project f80f3d5e573f46b4b2773c59b9410e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:30.528658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.529372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.532147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1790/3622] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:30 2022] DELETE /identity/v3/projects/f80f3d5e573f46b4b2773c59b9410e44 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:30.536156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:30.553076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f7102-9d1a-413a-8623-dcdf627eab32 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:30.728228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:30.733111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:30.733597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:30.734580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] PATH_INFO: `/v3/users/f46ac7ebd4194f32950bff917b1e0fb3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:30.739778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46ac7ebd4194f32950bff917b1e0fb3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:30.744825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:30.864645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46ac7ebd4194f32950bff917b1e0fb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.865953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46ac7ebd4194f32950bff917b1e0fb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.897445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46ac7ebd4194f32950bff917b1e0fb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.926772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46ac7ebd4194f32950bff917b1e0fb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.955098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-307871f6-26eb-4932-ae57-b2de945c553b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46ac7ebd4194f32950bff917b1e0fb3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:30.971819 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1833/3623] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:30 2022] DELETE /identity/v3/users/f46ac7ebd4194f32950bff917b1e0fb3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:33.235445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:33.239160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:33.283697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c62fa4-6c65-4758-94c7-3320c0ec30f7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:33.496583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:33.500696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:33.501015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:33.501388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] PATH_INFO: `/v3/projects/565f181735f240888d2a239ea0460eb0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:33.506597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] RBAC: Authorizing `identity:delete_project(project_id=565f181735f240888d2a239ea0460eb0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:33.509348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:33.642281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565f181735f240888d2a239ea0460eb0', 'request_id': 'req-2e3bf802-f158-410e-8139-525f51c4893b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:33.651574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565f181735f240888d2a239ea0460eb0', 'request_id': 'req-2e3bf802-f158-410e-8139-525f51c4893b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:33.660520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565f181735f240888d2a239ea0460eb0', 'request_id': 'req-2e3bf802-f158-410e-8139-525f51c4893b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:33.706448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] The token cache is being invalidate because project 565f181735f240888d2a239ea0460eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:33.707539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:33.711060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2e3bf802-f158-410e-8139-525f51c4893b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:33.720931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:33.722266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:33.722739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:33.725528 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1791/3624] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:33 2022] DELETE /identity/v3/projects/565f181735f240888d2a239ea0460eb0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:33.759498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:33.763393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:33.847371 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:33.908974 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1834/3625] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:33.920522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:33.920819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:33.921101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:33.930929 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:33.961510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:33.967984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:33.996022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1792/3626] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:33.999060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.017369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dda5-9147-49ed-8911-716b958d9f4a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.031456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.035077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.035458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.035759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.037967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:34.038435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.041871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.086475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1835/3627] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:34.092357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.109284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44658a-3759-4868-bdf3-c03d8075ed3d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.139736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.140578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.140780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.141087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.141968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.147267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.252045 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1793/3628] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:34 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:34.254882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.290528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938feef4-3d3b-44f6-8cc6-5bfabfbfe0ae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.499905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.501246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.501998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.504425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.505381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.509620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.551023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1836/3629] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:34 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:34.554830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.575345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7d092-09c7-4408-b544-aae4a4e140b2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.593206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.594953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.595425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.595962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.596884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.606623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.662862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.675949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1794/3630] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:34.686779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809fdce-1ed7-4bf5-ab1d-ab777f3481a1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.710551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.711213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.711503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.712166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.712552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.714327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cee715-8c4f-43fd-af4e-bb97da7749b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.740907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1837/3631] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:34.742385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:34.759472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f73b5-89b3-41ff-8dae-8eddaf679d22 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:34.772463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:34.775851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.776150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.776432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] PATH_INFO: `/v3/projects/387a400a8ffe44b787883768224a2d1c/users/47e9f36a781d43b1a9c5753b21845cb1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.829951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=387a400a8ffe44b787883768224a2d1c, user_id=47e9f36a781d43b1a9c5753b21845cb1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:34.848774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:34.881194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1795/3632] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:34 2022] PUT /identity/v3/projects/387a400a8ffe44b787883768224a2d1c/users/47e9f36a781d43b1a9c5753b21845cb1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:34.893050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:34.893366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:34.893627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:34.955006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] MFA Rules not processed for user `47e9f36a781d43b1a9c5753b21845cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:34.956308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:35.165843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.173724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1838/3633] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:35.179365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816097-8d63-4409-af1d-8283c20f9f7b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.184545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.185810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.186254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.186860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.187774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:create_application_credential(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.189411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.470842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.480232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1796/3634] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:19:35 2022] POST /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials => generated 920 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:35.483847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808b32d-e731-47c6-ba84-43e0bb58caaf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.493596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.496406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.496406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.496406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/f25ae96c5db049068cc49a0a79c31d44` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.498490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:delete_access_rule(user_id=47e9f36a781d43b1a9c5753b21845cb1, access_rule_id=f25ae96c5db049068cc49a0a79c31d44)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.499886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application session.delete(ref) Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application yield resource Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:19:35.574461 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise self.value Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application session.commit() Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.flush() Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:19:35.575585 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application compat.raise_( Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._synchronize( Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise AssertionError( Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 24 01:19:35.576463 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:19:35.577380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:19:35.578301 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1839/3635] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Jul 24 01:19:35 2022] DELETE /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/f25ae96c5db049068cc49a0a79c31d44 => generated 89 bytes in 106 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:19:35.580297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.595368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfbed-942e-44fa-8428-7ce7233c23c6 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.602369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.603793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.604070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.604359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials/ba4b174509144f68b73dbe6c329fa693` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.626790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:delete_application_credential(user_id=47e9f36a781d43b1a9c5753b21845cb1, application_credential_id=ba4b174509144f68b73dbe6c329fa693)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.628488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.678679 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1797/3636] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:19:35 2022] DELETE /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials/ba4b174509144f68b73dbe6c329fa693 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:35.682766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.698251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd7f1-e9b6-4dec-92fd-b5664ab22e16 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.712651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.713536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.715726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.716025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.717853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:list_access_rules(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.720918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.729232 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1840/3637] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:19:35 2022] GET /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules => generated 369 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:35.733250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.745364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050de00-080b-48e2-9506-cffbac02478d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.752099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.753156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.753555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.753831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/f25ae96c5db049068cc49a0a79c31d44` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.755524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:delete_access_rule(user_id=47e9f36a781d43b1a9c5753b21845cb1, access_rule_id=f25ae96c5db049068cc49a0a79c31d44)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.757825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.791626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1798/3638] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Jul 24 01:19:35 2022] DELETE /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/f25ae96c5db049068cc49a0a79c31d44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:35.797183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.814879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f434c79-b499-4aa8-ab6d-0b6b9192638d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.838003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.838894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.839180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.839457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.841435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:list_access_rules(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.842976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.859451 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1841/3639] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:19:35 2022] GET /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules => generated 158 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:35.863913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:35.876970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4438bd8-e96d-4ce5-a909-ee1322912af8 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:35.886483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:35.888145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:35.889233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:35.890235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:35.892019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:create_application_credential(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:35.893486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:35.963079 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:36.090923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1799/3640] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:19:35 2022] POST /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials => generated 920 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:36.092438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:36.102129 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:36.122669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dd83d-707c-446b-94fc-9d7b5e17b79a tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:36.137974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:36.139047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:36.139223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:36.139503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:36.142417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:list_access_rules(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:36.148478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:36.165319 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1842/3641] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:19:36 2022] GET /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules => generated 369 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:19:36.169281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:36.186582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566b6cb-4b61-4f2e-adbd-352550f9d503 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:36.195287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:36.196562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:36.196936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:36.197225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:36.202679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:create_application_credential(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:36.206275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:36.375121 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1800/3642] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:19:36 2022] POST /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/application_credentials => generated 920 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:36.378803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:36.391677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc473b21-87c4-49c4-a0f1-b2ba69fe4a9d tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:36.404149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47e9f36a781d43b1a9c5753b21845cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '387a400a8ffe44b787883768224a2d1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:36.406457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:36.407620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:36.409029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/748f7d7564344ee8b83b95550ca34e47` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:36.411984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorizing `identity:get_access_rule(user_id=47e9f36a781d43b1a9c5753b21845cb1, access_rule_id=748f7d7564344ee8b83b95550ca34e47)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:36.415346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d8085-cf7a-45cc-9661-17dd23225a52 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:36.434261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1843/3643] 10.222.0.27 () {58 vars in 1358 bytes} [Sun Jul 24 01:19:36 2022] GET /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1/access_rules/748f7d7564344ee8b83b95550ca34e47 => generated 229 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:19:36.439332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:36.621357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90d033-b9a1-43f8-8ce7-32940ea9abe3 tempest-AccessRulesV3Test-1769881719 tempest-AccessRulesV3Test-1769881719-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:36.637706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:36.639094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:36.639664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:36.640093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] PATH_INFO: `/v3/users/47e9f36a781d43b1a9c5753b21845cb1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:36.643572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e9f36a781d43b1a9c5753b21845cb1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:36.648357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:36.773104 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:36.777997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e9f36a781d43b1a9c5753b21845cb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:36.793782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e9f36a781d43b1a9c5753b21845cb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:36.815309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e9f36a781d43b1a9c5753b21845cb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:36.940093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e9f36a781d43b1a9c5753b21845cb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:36.941591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e9f36a781d43b1a9c5753b21845cb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:36.974357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1801/3644] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:36 2022] DELETE /identity/v3/users/47e9f36a781d43b1a9c5753b21845cb1 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:36.976544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:36.977028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:36.977119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:37.033542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:37.034787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:37.255226 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1844/3645] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:37.716759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:37.718426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:37.905615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f055-8594-4995-bcf4-e081ac2728ab admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:37.921329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:37.922383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:37.922926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:37.923474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:37.936409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:37.938598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cfa29-160b-4425-96c2-8cfb90db9fb2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:37.954300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1802/3646] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:39.063058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.065427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.115649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8489f4-9444-410d-9200-03de06bc774f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:39.134168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:39.136102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.136571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.136994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] PATH_INFO: `/v3/projects/387a400a8ffe44b787883768224a2d1c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.138467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] RBAC: Authorizing `identity:delete_project(project_id=387a400a8ffe44b787883768224a2d1c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:39.142849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:39.257412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387a400a8ffe44b787883768224a2d1c', 'request_id': 'req-ba801728-1fd9-4092-9f6d-ead48ff8283a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.272365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387a400a8ffe44b787883768224a2d1c', 'request_id': 'req-ba801728-1fd9-4092-9f6d-ead48ff8283a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.282994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387a400a8ffe44b787883768224a2d1c', 'request_id': 'req-ba801728-1fd9-4092-9f6d-ead48ff8283a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.305176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] The token cache is being invalidate because project 387a400a8ffe44b787883768224a2d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:39.305465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.306390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.309081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1845/3647] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:39 2022] DELETE /identity/v3/projects/387a400a8ffe44b787883768224a2d1c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:39.315197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.315745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.316067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.333473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.336228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.361373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:39.364809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.462631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba801728-1fd9-4092-9f6d-ead48ff8283a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:39.473168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:39.487680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.488939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.489225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.501007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.517834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1803/3648] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:39.518838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.526253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.530984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:39.535038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26505d99-9d28-44ae-b3fb-9fc4a3367344 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:39.551573 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:39.561123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac028628-83c4-4c36-9a31-edd00ee27464 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:39.567235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1846/3649] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:39.569584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.569890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.570165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.571953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:39.572913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.573201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.573986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] PATH_INFO: `/v3/users/6f643b01bb934b4ebacc4548721dba25` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.575229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f643b01bb934b4ebacc4548721dba25)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:39.584321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:39.611077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:39.614501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.644588 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1847/3650] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:39.648966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.672746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01136a2-635e-4639-8898-60b4e8f666c8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:39.679130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:39.680023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.680420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.680792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.681949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:39.682349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:39.683209 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:39.684156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:39.707538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f643b01bb934b4ebacc4548721dba25'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.711430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1848/3651] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:19:39.717482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.717657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f643b01bb934b4ebacc4548721dba25'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.728908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f643b01bb934b4ebacc4548721dba25'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.731982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d586c6e-c0cb-438f-9fd5-e471c49b024a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:39.737033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:39.738254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:39.738608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:39.739072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:39.740116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:39.744282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f643b01bb934b4ebacc4548721dba25'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.745042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f643b01bb934b4ebacc4548721dba25'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:39.746660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:39.751937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1804/3652] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:39 2022] DELETE /identity/v3/users/6f643b01bb934b4ebacc4548721dba25 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:39.791472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1849/3653] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:39 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:39.795695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:39.797146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:39.955086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fce0b9-cc58-4989-ac07-230e69c3d9f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.118907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.134992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.134992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.134992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.134992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.134992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.170471 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1805/3654] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:39 2022] POST /identity/v3/users => generated 283 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:40.172177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.174244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:40.184909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.202697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677f00-5266-480d-a230-5cb998640053 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.210996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f4934-521f-4014-88c1-09ec631a1de9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.217061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.218001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.218100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.218382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.219129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.221133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.222201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.225623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.225952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.226241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] PATH_INFO: `/v3/projects/56e7d7a1fe6f443181cd70ef18a84c83` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.227615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e7d7a1fe6f443181cd70ef18a84c83)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.233643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.240387 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1806/3655] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:40.241715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.257756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf8d15-bb18-4be0-a725-99798be20466 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.264031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.265068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.265257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.265513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.266836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.269578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.289783 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1807/3656] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:40.293889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.311735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3f52-d81b-4f70-b5bd-350efb26b154 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.346653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e7d7a1fe6f443181cd70ef18a84c83', 'request_id': 'req-822ce1cb-514d-4e05-83c8-e36a1b79acfb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:40.355723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e7d7a1fe6f443181cd70ef18a84c83', 'request_id': 'req-822ce1cb-514d-4e05-83c8-e36a1b79acfb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:40.366283 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:40.370955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e7d7a1fe6f443181cd70ef18a84c83', 'request_id': 'req-822ce1cb-514d-4e05-83c8-e36a1b79acfb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:40.390039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] The token cache is being invalidate because project 56e7d7a1fe6f443181cd70ef18a84c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:40.390463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:40.391174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-822ce1cb-514d-4e05-83c8-e36a1b79acfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:40.394041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1850/3657] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:40 2022] DELETE /identity/v3/projects/56e7d7a1fe6f443181cd70ef18a84c83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:40.399607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099af7-50d4-4458-b7fd-58c945968b95 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.400354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099af7-50d4-4458-b7fd-58c945968b95 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.400851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099af7-50d4-4458-b7fd-58c945968b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.432811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.434943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.435393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.436348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] PATH_INFO: `/v3/projects/71fcacdcb4a9423685e7fd157110faac/users/1e402d93ffd34704afcbfc10a7292876/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.452466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e6099af7-50d4-4458-b7fd-58c945968b95 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:40.453749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6099af7-50d4-4458-b7fd-58c945968b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:40.484123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fcacdcb4a9423685e7fd157110faac, user_id=1e402d93ffd34704afcbfc10a7292876, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.486977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e5683-d517-4a56-9884-420421755bed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.488278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1851/3658] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:40.490271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.490565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.490956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.511525 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1808/3659] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:40 2022] PUT /identity/v3/projects/71fcacdcb4a9423685e7fd157110faac/users/1e402d93ffd34704afcbfc10a7292876/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:40.524315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11774-c982-4474-9e55-27658452b043 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.524825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11774-c982-4474-9e55-27658452b043 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.525202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a11774-c982-4474-9e55-27658452b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.536901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:40.538339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:40.573461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-21a11774-c982-4474-9e55-27658452b043 None None] MFA Rules not processed for user `1e402d93ffd34704afcbfc10a7292876`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:40.574787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-21a11774-c982-4474-9e55-27658452b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:40.725522 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1852/3660] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:40.731801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.757396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569845ff-351a-432c-94bc-1ac5b6de33db None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.770131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.770894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.773000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.773999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.774953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:40.776268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.778677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.796462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1809/3661] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:40.798974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a11774-c982-4474-9e55-27658452b043 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.804335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-21a11774-c982-4474-9e55-27658452b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:40.810732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1853/3662] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:40.813443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.836553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a468-7a5a-4f01-8fd5-f3d56dfe4d99 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.855339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:40.856283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:40.856598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:40.856988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:40.857970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:40.860813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:40.888374 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:40.905760 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1854/3663] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:40 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:40.906938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:40.924249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a11774-c982-4474-9e55-27658452b043 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.992756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b30e-e0eb-4913-8be7-daca54308366 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:40.999894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.000856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.001165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.001452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.002207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.003709 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:41.006193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.032636 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1855/3664] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:40 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:41.038120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:41.041985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.042989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.043348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.043821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.056214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d025e-f993-401e-8825-7d046b935c76 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:41.065740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.066567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.066920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.067307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.068806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.071184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.091451 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1856/3665] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:41.096724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:41.117981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544e29-57f0-4b15-b3e6-409c916273d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:41.125113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.126277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.126640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.126999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.127742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.129365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.139035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.140790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d43e-7b03-48db-a22c-8ce579e6d685 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.147797 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1857/3666] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:41.152703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:41.164530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb96a9-8581-40ad-8729-32867e421407 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:41.168392 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1810/3667] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:41.176178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.177485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.178731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.179013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] PATH_INFO: `/v3/projects/e5025d6267ba40509d642d51a559f217/users/3172ec09985048558fe0f3adf9c067fd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.205447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5025d6267ba40509d642d51a559f217, user_id=3172ec09985048558fe0f3adf9c067fd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.208272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.243114 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1858/3668] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:41 2022] PUT /identity/v3/projects/e5025d6267ba40509d642d51a559f217/users/3172ec09985048558fe0f3adf9c067fd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:41.246335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.246653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.247108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.297403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:41.299886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:41.428859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1811/3669] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:41.441425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:41.444218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:41.543111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015224a9-b038-4d0c-9fc7-1661309547f9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:41.548187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:41.549205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:41.549604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:41.550640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:41.592576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:41.597837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1da3-7809-4e8a-9b06-ca13b1316232 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:41.658076 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1859/3670] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:41.971256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:41.972768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:41.992354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba2abf-aba4-4478-8656-ed89208188a2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:42.006808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:42.007971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:42.009505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:42.012522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] PATH_INFO: `/v3/users/1e402d93ffd34704afcbfc10a7292876` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:42.017172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e402d93ffd34704afcbfc10a7292876)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:42.019724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:42.128763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e402d93ffd34704afcbfc10a7292876'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:42.149868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e402d93ffd34704afcbfc10a7292876'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:42.205341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e402d93ffd34704afcbfc10a7292876'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:42.247243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e402d93ffd34704afcbfc10a7292876'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:42.248170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e402d93ffd34704afcbfc10a7292876'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:42.260622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1812/3671] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:41 2022] DELETE /identity/v3/users/1e402d93ffd34704afcbfc10a7292876 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:42.264716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:42.265274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:42.265274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:42.291914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:42.293228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:42.362119 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:42.393589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1860/3672] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:42.406015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:42.407988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:42.416063 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:42.503707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2f5bb-ec7f-4975-85b3-171b100c05a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:42.508042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:42.508953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:42.508953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:42.509243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:42.519842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:42.522449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bd860-66bd-469c-b95e-2a78a58d397d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:42.537789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1813/3673] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:43.088029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:43.094256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:43.117313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82e2eb-dfd7-42e7-9e2c-b4af794c5d05 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:43.126851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:43.128755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.129048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.129320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] PATH_INFO: `/v3/projects/71fcacdcb4a9423685e7fd157110faac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.136554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fcacdcb4a9423685e7fd157110faac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:43.143091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:43.282839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fcacdcb4a9423685e7fd157110faac', 'request_id': 'req-f92462df-ca43-43be-84c9-6aac08b9e6ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:43.314034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fcacdcb4a9423685e7fd157110faac', 'request_id': 'req-f92462df-ca43-43be-84c9-6aac08b9e6ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:43.326056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fcacdcb4a9423685e7fd157110faac', 'request_id': 'req-f92462df-ca43-43be-84c9-6aac08b9e6ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:43.348446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] The token cache is being invalidate because project 71fcacdcb4a9423685e7fd157110faac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:43.348763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:43.349564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f92462df-ca43-43be-84c9-6aac08b9e6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:43.352180 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1861/3674] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:43 2022] DELETE /identity/v3/projects/71fcacdcb4a9423685e7fd157110faac => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:43.357255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.357552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.357874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.389261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:43.391362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:43.523857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.524172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.524604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.524716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1814/3675] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:43.570327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:43.575609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:43.603885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1862/3676] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:43.610359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:43.627019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9984e-6e62-4912-b33e-83a3902a1841 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:43.641895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:43.642892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.643176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.643451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.644587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:43.644587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:43.646176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:43.669577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1815/3677] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:43.672438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:43.685516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec86bc-bf8b-4219-9c4e-7dfb90223d48 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:43.694326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:43.696279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.697895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.698561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.699778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:43.703548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:43.752006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1863/3678] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:43 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:43.754085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:43.772416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11debb-d520-4cf3-88fa-86a2d3ebb40e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:43.984986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:43.987326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:43.990185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:43.995145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:43.996710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:44.009409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:44.065914 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1816/3679] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:43 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:44.066812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:44.114131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72e43f-6c80-4576-afe4-edc491c8b123 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:44.132479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:44.133168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:44.133448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:44.138043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:44.139103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:44.140837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:44.169759 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1864/3680] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:19:44.174487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:44.210424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe590-1def-43ff-b1dd-e9768dfea905 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:44.229145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:44.229928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:44.230624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:44.230624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:44.231683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:44.236853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4fd7a-449b-4656-b15d-bb213dae16b8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:44.253779 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1817/3681] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:44.258194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:44.273024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147804cf-aeb9-4334-a378-439402e23b94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:44.283634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:44.284560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:44.284846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:44.285183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] PATH_INFO: `/v3/projects/12fcf53bab754b51aff0f33ea3ece4b3/users/f031f67e8620440ea7d1763e41aa801d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:44.327284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fcf53bab754b51aff0f33ea3ece4b3, user_id=f031f67e8620440ea7d1763e41aa801d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:44.331870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:44.358431 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1865/3682] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:44 2022] PUT /identity/v3/projects/12fcf53bab754b51aff0f33ea3ece4b3/users/f031f67e8620440ea7d1763e41aa801d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:44.370594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:44.370819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:44.371021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:44.429825 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:44.440169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] MFA Rules not processed for user `f031f67e8620440ea7d1763e41aa801d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:44.441609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:44.607348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:44.608177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1818/3683] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:44.766649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab224b09-4233-4d56-892c-1b350252daf0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:44.788273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:44.790483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:44.790772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:44.791048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:44.791772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:44.797561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:44.830132 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:44.874139 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1866/3684] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:44 2022] POST /identity/v3/projects => generated 391 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:44.875594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:44.891681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a3b14-e846-4a56-a47d-efc64b638201 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:45.030265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:45.030979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.031261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.031538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.032243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:45.034865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:45.088873 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1819/3685] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:44 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:45.090868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:45.128913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42675dcd-38ef-45e9-b943-de8d645bbcdf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:45.164943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:45.166242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.168365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.170003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.171034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:45.178339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:45.204778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1867/3686] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:45.215607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:45.233255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbe30-6ec0-4940-857b-18458c8b942f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:45.245455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:45.246449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.246728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.247018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] PATH_INFO: `/v3/projects/f998ac6c71444e979239190794e5810a/users/be92fa43837743c3a6b5f40432d37321/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.275728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f998ac6c71444e979239190794e5810a, user_id=be92fa43837743c3a6b5f40432d37321, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:45.278608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:45.310763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1820/3687] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:45 2022] PUT /identity/v3/projects/f998ac6c71444e979239190794e5810a/users/be92fa43837743c3a6b5f40432d37321/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:45.315823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:45.346415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979503e9-63e3-4120-aacd-1083e581e9f1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:45.555576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:45.556292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.559359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.560825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.562969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:45.569491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5e68-5c20-4ddf-bb3a-21a3c1d97be2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:45.605733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:45.606757 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1868/3688] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:19:45.624878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668a60-06ef-4905-9516-42b5370a65c7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:45.641889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:45.642925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.643306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.643657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] PATH_INFO: `/v3/projects/f998ac6c71444e979239190794e5810a/users/be92fa43837743c3a6b5f40432d37321/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.647914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f998ac6c71444e979239190794e5810a, user_id=be92fa43837743c3a6b5f40432d37321, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:45.651029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:45.693716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1821/3689] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:45 2022] PUT /identity/v3/projects/f998ac6c71444e979239190794e5810a/users/be92fa43837743c3a6b5f40432d37321/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:45.701361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1a43-c80a-429d-a819-af962978342e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:45.701886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1a43-c80a-429d-a819-af962978342e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:45.702320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1a43-c80a-429d-a819-af962978342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:45.769454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e3bb1a43-c80a-429d-a819-af962978342e None None] MFA Rules not processed for user `be92fa43837743c3a6b5f40432d37321`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:45.771921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3bb1a43-c80a-429d-a819-af962978342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:45.914929 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1869/3690] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:45.921798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:45.923954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:46.047380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607733d1-8691-4942-b9e1-c8e5ae64bd33 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:46.058096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:46.058782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:46.059067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:46.059345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:46.076497 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:46.231790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:46.233628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502ca0-bd0d-4461-9f1c-48319d4bdf4e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:46.251154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1822/3691] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:52.699409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11d4b-82eb-411b-947e-0032c15f6163 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:52.699923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11d4b-82eb-411b-947e-0032c15f6163 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:52.699923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11d4b-82eb-411b-947e-0032c15f6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:52.777259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e2f11d4b-82eb-411b-947e-0032c15f6163 None None] MFA Rules not processed for user `7033c900a87241779c10097a9c494e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:52.781817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e2f11d4b-82eb-411b-947e-0032c15f6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:52.933554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1870/3692] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:53.787270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.790266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.790564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.841518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] MFA Rules not processed for user `3172ec09985048558fe0f3adf9c067fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:53.844484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:53.955265 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1823/3693] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:53.970348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.971407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.971873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:54.003984 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:54.014292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] MFA Rules not processed for user `3172ec09985048558fe0f3adf9c067fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:54.015963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:54.031929 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1871/3694] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:54.110520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:54.112422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:54.288481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1804ca1-1f41-42d4-8ce3-b45c09a1e885 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:54.299173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:54.300199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:54.300719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:54.301252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:54.340779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:54.343830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:54.416849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1824/3695] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:55.373457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:55.392764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18bcae-4ca2-4631-b77e-32f595ea7125 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:55.401372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:55.402375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:55.402656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:55.402932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:55.438775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:55.440252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:55.477611 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1872/3696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:56.822453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.824065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:56.856323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9b00-f62e-437d-83fc-d187be37c6bf service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.882012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.882691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.882977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.883293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.885561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:56.995475 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:57.160728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:57.166208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7921639-ae7e-4e23-8965-56e512e3d828 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:57.196929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1825/3697] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:05.458662 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:06.405398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:06.438740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4edf5-a545-439a-8181-91264c742312 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:06.474495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:06.483144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:06.485513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:06.486080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] PATH_INFO: `/v3/users/f031f67e8620440ea7d1763e41aa801d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:06.488004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f031f67e8620440ea7d1763e41aa801d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:06.492483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:06.592302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f031f67e8620440ea7d1763e41aa801d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:06.593159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f031f67e8620440ea7d1763e41aa801d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:06.607638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f031f67e8620440ea7d1763e41aa801d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:06.619996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f031f67e8620440ea7d1763e41aa801d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:06.641477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f031f67e8620440ea7d1763e41aa801d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:06.650377 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1873/3698] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:06 2022] DELETE /identity/v3/users/f031f67e8620440ea7d1763e41aa801d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:06.654760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:06.655215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:06.655215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:06.683303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:06.684560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:06.776437 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1826/3699] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:06.805017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:06.806957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:06.897158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6106c12-1ccd-4431-a34b-ae4deaafd925 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:06.906457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:06.907557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:06.908186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:06.908706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:06.924301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:06.927270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:07.027235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1874/3700] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:07.718473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:07.720132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:07.750269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf75b-4247-4e33-abad-fefc540e7221 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:07.786486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:07.787409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:07.787693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:07.787972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] PATH_INFO: `/v3/projects/12fcf53bab754b51aff0f33ea3ece4b3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:07.792248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fcf53bab754b51aff0f33ea3ece4b3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:07.799697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:07.964848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fcf53bab754b51aff0f33ea3ece4b3', 'request_id': 'req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:07.985500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fcf53bab754b51aff0f33ea3ece4b3', 'request_id': 'req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.025932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fcf53bab754b51aff0f33ea3ece4b3', 'request_id': 'req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.074078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] The token cache is being invalidate because project 12fcf53bab754b51aff0f33ea3ece4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:08.075039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.077767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.111512 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1827/3701] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:07 2022] DELETE /identity/v3/projects/12fcf53bab754b51aff0f33ea3ece4b3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:08.113426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:08.132490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4284-0fe7-4be0-a887-cae6d8b5c52c service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:08.279366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:08.280585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:08.281032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:08.281517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] PATH_INFO: `/v3/users/be92fa43837743c3a6b5f40432d37321` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:08.283345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be92fa43837743c3a6b5f40432d37321)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:08.286454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:08.314259 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:08.378475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be92fa43837743c3a6b5f40432d37321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.379177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be92fa43837743c3a6b5f40432d37321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.391092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be92fa43837743c3a6b5f40432d37321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.403001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be92fa43837743c3a6b5f40432d37321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.422369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00a369a4-efc1-4aa3-9e83-3090cb1dff1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be92fa43837743c3a6b5f40432d37321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:08.432390 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1875/3702] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:08 2022] DELETE /identity/v3/users/be92fa43837743c3a6b5f40432d37321 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:09.268484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:09.269970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:09.295565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8eff1-b1d5-46e0-92fc-12f8563775c5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:09.397212 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:09.457241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:09.459348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:09.459633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:09.460110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] PATH_INFO: `/v3/projects/f998ac6c71444e979239190794e5810a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:09.461890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f998ac6c71444e979239190794e5810a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:09.464235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:09.539690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f998ac6c71444e979239190794e5810a', 'request_id': 'req-459e0a25-e8c7-4d5d-ac1b-c031781ef063'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:09.549799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f998ac6c71444e979239190794e5810a', 'request_id': 'req-459e0a25-e8c7-4d5d-ac1b-c031781ef063'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:09.558766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f998ac6c71444e979239190794e5810a', 'request_id': 'req-459e0a25-e8c7-4d5d-ac1b-c031781ef063'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:09.589261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] The token cache is being invalidate because project f998ac6c71444e979239190794e5810a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:09.592005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:09.593581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-459e0a25-e8c7-4d5d-ac1b-c031781ef063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:09.603527 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1828/3703] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:09 2022] DELETE /identity/v3/projects/f998ac6c71444e979239190794e5810a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:09.608549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:09.611289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:09.612013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:09.653489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:09.656078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:09.779920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:09.780226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:09.780484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:09.780597 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1876/3704] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:09.818585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:09.819752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:09.834451 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1829/3705] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:09.840016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:09.855102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cdf20-a50d-45e8-827e-922909095fcf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:09.871682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:09.872920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:09.873376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:09.873911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:09.874972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:09.876421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:09.881747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:09.917615 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1877/3706] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:09.922308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:09.938000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a91a7-039a-4c4d-b379-29b323c61a39 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:09.954644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:09.957340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:09.959272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:09.959827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:09.962200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:09.966579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.028467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1830/3707] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:09 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:10.034799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.051570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ba62e-de02-41c0-bb42-070485320b2a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:10.184066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:10.186543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.187077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.187594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.190190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:10.195584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.238681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1878/3708] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:10 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:10.242708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.255395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71357d1-dffb-42e6-82dd-00b76cb60106 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:10.261466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:10.262349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.262637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.263142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.263708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:10.265383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.278157 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1831/3709] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:10.284362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.298144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b885-7b9a-4dd5-8ab4-485885f50b03 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:10.316061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:10.317138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.317983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.318424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.319393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:10.321961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a55c1-25c0-43f1-a87f-5492a54f4c55 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.332072 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:10.345480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.346525 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1879/3710] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:10.363619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b72e8-bede-4026-b683-5cc1ff5664e6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:10.376148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:10.377123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.377408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.377829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] PATH_INFO: `/v3/projects/d32fc467771e4579bd0e23874cc3ddc5/users/9ea6cb4c68a544dd8fb6bd2fa6b76fc1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.425522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32fc467771e4579bd0e23874cc3ddc5, user_id=9ea6cb4c68a544dd8fb6bd2fa6b76fc1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:10.435441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.466378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1832/3711] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:10 2022] PUT /identity/v3/projects/d32fc467771e4579bd0e23874cc3ddc5/users/9ea6cb4c68a544dd8fb6bd2fa6b76fc1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:10.480328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.480596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.480927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.514386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] MFA Rules not processed for user `9ea6cb4c68a544dd8fb6bd2fa6b76fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:10.515637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:10.697613 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1880/3712] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:10.702280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.852891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5679d-ea27-4d40-8755-9555482e1994 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:10.860152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:10.861286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:10.861791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:10.862226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:10.863105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:10.866636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:10.895561 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:10.925239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:10.937959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1833/3713] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:10 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:10.943276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f0358-5ffb-401a-a409-43e8cedadd22 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:11.035048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:11.037841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.038296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.038749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.039743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:11.042268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:11.074516 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1881/3714] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:10 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:11.075162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:11.091735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce307f1-afcd-497d-b7fb-e818a4d407fb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:11.100297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:11.101140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.101421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.101883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.102634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:11.104935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:11.125290 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1834/3715] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:11.134347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:11.151735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862268d4-1bff-4a85-a21d-a46044372622 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:11.162415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:11.163506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.163796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.164076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] PATH_INFO: `/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734/users/7ad600b1d955456da749ba5619394853/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.238756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b58fcb2c14a4d4e8e3de40c08a9c734, user_id=7ad600b1d955456da749ba5619394853, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:11.242862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:11.266527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1882/3716] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:11 2022] PUT /identity/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734/users/7ad600b1d955456da749ba5619394853/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:11.272511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:11.302838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d055de-e016-4b65-adb8-a8738c52cf17 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:11.453138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:11.454259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.455078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.455595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.458609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:11.460681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b854543-635e-4a1f-af18-e7179f6fd360 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:11.474565 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1835/3717] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:11.478676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:11.495637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56511e-a4a0-4a3b-87ac-22f77bd30b7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:11.519131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:11.520069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.520925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.521360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] PATH_INFO: `/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734/users/7ad600b1d955456da749ba5619394853/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.529396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b58fcb2c14a4d4e8e3de40c08a9c734, user_id=7ad600b1d955456da749ba5619394853, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:11.532120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:11.559429 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1883/3718] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:11 2022] PUT /identity/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734/users/7ad600b1d955456da749ba5619394853/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:11.572742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:11.573197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:11.573587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:11.657193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] MFA Rules not processed for user `7ad600b1d955456da749ba5619394853`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:11.660277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:11.845545 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1836/3719] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:11.924914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:11.926719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:12.032453 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:12.053215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba496-98f7-4ad1-be94-53647150fa6c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:12.058617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:12.059695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:12.060053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:12.060470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:12.166946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:12.168635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:12.191995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1884/3720] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:15.177420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:15.180101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:15.409711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9188a-a6fa-43a8-8a35-5d9fcc94651e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:15.419681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:15.420592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:15.420871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:15.421650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] PATH_INFO: `/v3/users/f71f3d66b27b471d9772a0a01d3c89ed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:15.423107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71f3d66b27b471d9772a0a01d3c89ed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:15.430950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:15.438735 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:15.544046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71f3d66b27b471d9772a0a01d3c89ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:15.561872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71f3d66b27b471d9772a0a01d3c89ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:15.575542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71f3d66b27b471d9772a0a01d3c89ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:15.601274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71f3d66b27b471d9772a0a01d3c89ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:15.604182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71f3d66b27b471d9772a0a01d3c89ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:15.617709 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1837/3721] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:15 2022] DELETE /identity/v3/users/f71f3d66b27b471d9772a0a01d3c89ed => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:15.908310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:15.932794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d12325-12df-4000-af2b-2077161be827 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:16.029658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:16.035008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:16.075715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:16.076936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:16.079095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:16.079883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] PATH_INFO: `/v3/projects/651fa7eea7a04e8d83d2264c1638f8f2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:16.084970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=651fa7eea7a04e8d83d2264c1638f8f2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:16.089962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:16.205134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d7d69-57d2-4be7-9bf3-86e8aeb4ce37 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:16.211427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:16.211718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:16.211909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:16.212192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:16.214908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:16.242813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651fa7eea7a04e8d83d2264c1638f8f2', 'request_id': 'req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.252897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651fa7eea7a04e8d83d2264c1638f8f2', 'request_id': 'req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.266634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651fa7eea7a04e8d83d2264c1638f8f2', 'request_id': 'req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.301024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] The token cache is being invalidate because project 651fa7eea7a04e8d83d2264c1638f8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:16.301447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.303018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.305728 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1885/3722] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:15 2022] DELETE /identity/v3/projects/651fa7eea7a04e8d83d2264c1638f8f2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:16.309663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:16.311380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:16.322946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:16.324577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:16.340578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1838/3723] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:16.361087 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:16.415940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b36e6-4288-4bcf-9ebe-ff54e1e7b369 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:16.429057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:16.430174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:16.430987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:16.431481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] PATH_INFO: `/v3/users/b5ec9085d4c943c78624add7f32f974c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:16.433413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ec9085d4c943c78624add7f32f974c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:16.436086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:16.535639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ec9085d4c943c78624add7f32f974c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.536806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ec9085d4c943c78624add7f32f974c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.554250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ec9085d4c943c78624add7f32f974c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.572340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ec9085d4c943c78624add7f32f974c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.592347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-15f0f90c-2a1e-40f4-a8cb-34c1d8fbda3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ec9085d4c943c78624add7f32f974c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:16.602004 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1886/3724] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:16 2022] DELETE /identity/v3/users/b5ec9085d4c943c78624add7f32f974c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:18.744970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:18.748042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:18.777694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28e808-cfa1-4fef-8e42-6cc95b4a599f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:18.846428 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:18.976123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:18.979849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:18.983327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:18.983824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] PATH_INFO: `/v3/projects/1a9bde1ab6334854a2aec193c95ddc33` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:18.987093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9bde1ab6334854a2aec193c95ddc33)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:18.989980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:19.118238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9bde1ab6334854a2aec193c95ddc33', 'request_id': 'req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:19.126785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9bde1ab6334854a2aec193c95ddc33', 'request_id': 'req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:19.145736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9bde1ab6334854a2aec193c95ddc33', 'request_id': 'req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:19.175907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] The token cache is being invalidate because project 1a9bde1ab6334854a2aec193c95ddc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:19.176854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:19.177540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26b54f5a-dfd6-483e-8b4a-a2d6f4e4ca12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:19.183089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1839/3725] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:18 2022] DELETE /identity/v3/projects/1a9bde1ab6334854a2aec193c95ddc33 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:19.185778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.186252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.186348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.220081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:19.226128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:19.415420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1887/3726] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:19.417201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.417431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.417736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.461377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:19.463273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:19.473694 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1840/3727] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:19.478214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:19.496201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53533d8-075e-431a-a71a-e1f4632de1ff None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:19.509745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:19.510432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.510712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.511104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.511714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:19.512016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:19.513639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:19.545198 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1888/3728] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:19.547025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:19.560850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556da3-5c8c-4e2f-ab4c-0fb56d8e55a3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:19.576538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:19.577217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.577501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.577797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.578506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:19.580440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:19.619789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1841/3729] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:19 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:19.621056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:19.635886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb9411-e8b2-4469-8c74-e15fb127954f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:19.722790 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:19.781429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:19.795236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.795680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.796118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.797268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:19.809307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:19.881011 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1889/3730] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:19 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:19.883644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:19.901087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f0de6-8436-4429-8ec6-f6ca36457fe5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:19.913760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:19.914717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.915174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.915804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.917979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:19.919953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:19.951078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1842/3731] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:19.952276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:19.967210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee02f-869a-4f6a-b5a5-43bfd1efedb5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:19.978617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:19.981766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:19.982171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:19.982610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:19.983483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:19.987971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564aeaa-b75d-4185-9239-7dd7a00ae955 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:20.018756 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1890/3732] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:20.025345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:20.043424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd0f5-48fc-4ec9-be86-2e6ebacda9b8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:20.059123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:20.060303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:20.060742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:20.062924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] PATH_INFO: `/v3/projects/bc7258055b514ebe9ff24d33f1915e7d/users/4f49f16f91654ff99ac19029e4fe228a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:20.140808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7258055b514ebe9ff24d33f1915e7d, user_id=4f49f16f91654ff99ac19029e4fe228a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:20.144341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f8184-e54e-40ef-a10d-0f812d044f8d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:20.206456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1843/3733] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:20 2022] PUT /identity/v3/projects/bc7258055b514ebe9ff24d33f1915e7d/users/4f49f16f91654ff99ac19029e4fe228a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:20.208238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:20.208730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:20.209024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:20.299552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:20.305908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:20.467081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1891/3734] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:20.478288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa703b6-8ec9-4a10-9904-d82ddd8218bc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:20.479109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa703b6-8ec9-4a10-9904-d82ddd8218bc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:20.479594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa703b6-8ec9-4a10-9904-d82ddd8218bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:20.521091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-afa703b6-8ec9-4a10-9904-d82ddd8218bc None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:20.522924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-afa703b6-8ec9-4a10-9904-d82ddd8218bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:20.542830 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1844/3735] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:20.560565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:20.562443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:20.774341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca035801-9472-4a11-a595-1cda6a4364be None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:20.786757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:20.787568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:20.787957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:20.788340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:20.813452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:20.817864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0724-ea03-44be-a3ae-1909f727b82a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:20.857608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1892/3736] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:20.892305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab71e-258c-4908-8a89-bd75d0d91d88 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:20.894348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab71e-258c-4908-8a89-bd75d0d91d88 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:20.895433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab71e-258c-4908-8a89-bd75d0d91d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:20.933407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-365ab71e-258c-4908-8a89-bd75d0d91d88 None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:20.935737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-365ab71e-258c-4908-8a89-bd75d0d91d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:20.952683 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1845/3737] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:21.793353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96a92-e9b9-4bbd-bb4f-6e9a8a8e81be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:21.793905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96a92-e9b9-4bbd-bb4f-6e9a8a8e81be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:21.793995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f96a92-e9b9-4bbd-bb4f-6e9a8a8e81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:21.836441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-11f96a92-e9b9-4bbd-bb4f-6e9a8a8e81be None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:21.837710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-11f96a92-e9b9-4bbd-bb4f-6e9a8a8e81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:21.868670 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1893/3738] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:22.318885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:22.319353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:22.319466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:22.356822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:22.358453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:22.380182 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1846/3739] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:22.601252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e5-c13a-4719-9225-f2b61df39d70 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:22.601845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e5-c13a-4719-9225-f2b61df39d70 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:22.602314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e5-c13a-4719-9225-f2b61df39d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:22.637238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-44f7c5e5-c13a-4719-9225-f2b61df39d70 None None] MFA Rules not processed for user `4f49f16f91654ff99ac19029e4fe228a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:22.640820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44f7c5e5-c13a-4719-9225-f2b61df39d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:22.666617 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1894/3740] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:22.983970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:23.089006 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:23.132256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566aa0-ed4d-4366-aa94-b45cdb3da628 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:23.137377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:23.138773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:23.139243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:23.140043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] PATH_INFO: `/v3/users/4f49f16f91654ff99ac19029e4fe228a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:23.141576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f49f16f91654ff99ac19029e4fe228a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:23.144297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:23.274494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f49f16f91654ff99ac19029e4fe228a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:23.293942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f49f16f91654ff99ac19029e4fe228a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:23.314421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f49f16f91654ff99ac19029e4fe228a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:23.335237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f49f16f91654ff99ac19029e4fe228a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:23.336204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f49f16f91654ff99ac19029e4fe228a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:23.348946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1847/3741] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:22 2022] DELETE /identity/v3/users/4f49f16f91654ff99ac19029e4fe228a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:23.352060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:23.352605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:23.352605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:23.372878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:23.374181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:23.386118 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:23.500142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1895/3742] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:23.565817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:23.568558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:23.754063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb5a3-f63f-4c19-b00f-ec8bdf30285b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:23.759729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:23.760413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:23.760701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:23.760979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:23.821897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:23.821897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:23.858397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1848/3743] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:25.143990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:25.146399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:25.180522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5eb66-ae6d-4470-8dd5-96b6d560b885 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:25.190343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:25.191497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:25.192005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:25.192441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] PATH_INFO: `/v3/users/b2c41e924f694c789952302d70e75efd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:25.195432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c41e924f694c789952302d70e75efd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:25.197648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:25.326858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c41e924f694c789952302d70e75efd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:25.327776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c41e924f694c789952302d70e75efd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:25.344269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c41e924f694c789952302d70e75efd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:25.363805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c41e924f694c789952302d70e75efd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:25.393085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c41e924f694c789952302d70e75efd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:25.405536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1896/3744] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:25 2022] DELETE /identity/v3/users/b2c41e924f694c789952302d70e75efd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:26.448112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:26.450151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:26.456510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:26.458772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:26.494680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e06e-abf9-4e54-b8c0-ec713ff7d356 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:26.668623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250d73-bbe4-4790-804f-c359508a9c9d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:26.685992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:26.690216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:26.690964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:26.692305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] PATH_INFO: `/v3/projects/90bf9b4eea0b4c43bbd2d44888e13f77` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:26.695003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bf9b4eea0b4c43bbd2d44888e13f77)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:26.697192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:26.737822 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:26.771541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bf9b4eea0b4c43bbd2d44888e13f77', 'request_id': 'req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.781414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bf9b4eea0b4c43bbd2d44888e13f77', 'request_id': 'req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.795906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bf9b4eea0b4c43bbd2d44888e13f77', 'request_id': 'req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.809553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:26.810939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:26.813805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:26.815329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] PATH_INFO: `/v3/projects/bc7258055b514ebe9ff24d33f1915e7d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:26.820957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] The token cache is being invalidate because project 90bf9b4eea0b4c43bbd2d44888e13f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:26.821330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.822101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-accb29b6-fc1e-4f3a-bbde-5c8a5f55e23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.828022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1897/3745] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:26 2022] DELETE /identity/v3/projects/90bf9b4eea0b4c43bbd2d44888e13f77 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:26.832618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7258055b514ebe9ff24d33f1915e7d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:26.838127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e800dc-28ba-48ae-b7af-4511127c91fb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:26.838461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e800dc-28ba-48ae-b7af-4511127c91fb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:26.839167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e800dc-28ba-48ae-b7af-4511127c91fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:26.840846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:26.850255 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:26.922603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-28e800dc-28ba-48ae-b7af-4511127c91fb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:26.925793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-28e800dc-28ba-48ae-b7af-4511127c91fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:26.993606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7258055b514ebe9ff24d33f1915e7d', 'request_id': 'req-b200400d-bcc2-42fb-9200-0e40bf2892e8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.011813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7258055b514ebe9ff24d33f1915e7d', 'request_id': 'req-b200400d-bcc2-42fb-9200-0e40bf2892e8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.044327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7258055b514ebe9ff24d33f1915e7d', 'request_id': 'req-b200400d-bcc2-42fb-9200-0e40bf2892e8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.076960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] The token cache is being invalidate because project bc7258055b514ebe9ff24d33f1915e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:27.077940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.079107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b200400d-bcc2-42fb-9200-0e40bf2892e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.087200 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1849/3746] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:26 2022] DELETE /identity/v3/projects/bc7258055b514ebe9ff24d33f1915e7d => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:27.088800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19ee3-f58a-4fda-9638-c99146881438 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.089096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19ee3-f58a-4fda-9638-c99146881438 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.089376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19ee3-f58a-4fda-9638-c99146881438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.127247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1898/3747] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:27.127375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-19c19ee3-f58a-4fda-9638-c99146881438 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:27.129769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-19c19ee3-f58a-4fda-9638-c99146881438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.132098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.132392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.132731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.212413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:27.215133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.274518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1850/3748] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:27.283292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.283923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.284406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.332158 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1899/3749] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:27.336742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.340274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:27.341587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.346703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07ec68-d764-4f1f-8996-ed5bad754e25 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.354442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.355090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.355375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.355712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.356885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:27.357005 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1851/3750] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:27.360100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.361003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.361695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.374476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994b2a-b4a1-4424-a926-a5f12d900e39 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.384199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1900/3751] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:27.385539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.391981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.392766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.393061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.393342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.394132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:27.394444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.397039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.411768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ed79-c57c-4815-8205-b7485004f459 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.413833 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1852/3752] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:20:27.421396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.433841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.435084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.435463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.435840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.436662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.440509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.450593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c38f8f-6a63-4661-9fc3-d8be3144fd4f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.464505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.465196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.465489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.465797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.466511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.478845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.511697 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1901/3753] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:27.512633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.533175 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1853/3754] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:27.536935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.560499 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:27.619893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d379c6-a217-4f5a-9bd3-44a0e47cb641 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.656064 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:27.683755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa697c-f158-4443-8b39-5aa71e354c8e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.694981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.695734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.696053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.696335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.697127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.699333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.717659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.718772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.719266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.719728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.721250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.724035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.761524 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1854/3755] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:27.763040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.769275 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1902/3756] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:27.771765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.798333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968c602-8018-4e5b-a0a1-2c89b90bf11c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.800697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afdd7-e874-470b-91fb-8666f72e1a89 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.809710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.810547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.810777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.811051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.811850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.812070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.812763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.813049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.813327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.813588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.814114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.827885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1855/3757] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:27.831505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.841339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.855165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a9ae7-a718-451d-b7b1-7ba96eae8f55 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.865615 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1903/3758] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:27.866068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.866068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.866068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.866068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.866421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.866814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.868439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.882082 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1856/3759] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:27.886228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.896722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6c9f1-2bcb-4792-9cc0-031812a39056 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.899314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c35ce7-d78d-48bc-a9b5-f610bd1c8eb6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.906878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.908002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.908421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.908842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] PATH_INFO: `/v3/projects/4bf80756586b48a7a320b87480fdbcc8/users/11411d69fb4747e783fae09aa58d1a5e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.911195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.911944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.912230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.912504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.913486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.916121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.937180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf80756586b48a7a320b87480fdbcc8, user_id=11411d69fb4747e783fae09aa58d1a5e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.948863 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1904/3760] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:27.949071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568632b8-00a5-43e4-9f33-9567e2aef0f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.950156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.972407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9490d-b73f-4163-bb4d-df3cc9bf837c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.975598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1857/3761] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:27 2022] PUT /identity/v3/projects/4bf80756586b48a7a320b87480fdbcc8/users/11411d69fb4747e783fae09aa58d1a5e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:27.985594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5d47-81c0-4fd2-9d41-be4481355ee2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.986116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5d47-81c0-4fd2-9d41-be4481355ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.986424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5d47-81c0-4fd2-9d41-be4481355ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.030555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-faad5d47-81c0-4fd2-9d41-be4481355ee2 None None] MFA Rules not processed for user `11411d69fb4747e783fae09aa58d1a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.031821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-faad5d47-81c0-4fd2-9d41-be4481355ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.163217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.168098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.170181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.171163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] PATH_INFO: `/v3/projects/37d719380c51434683b3dcd83722913f/users/5553b37350644a20b64ce76ebf60b44b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.209735 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1858/3762] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:28.220816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1515-003b-43ec-8a03-b7395a7b44af None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.221314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1515-003b-43ec-8a03-b7395a7b44af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.221836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1515-003b-43ec-8a03-b7395a7b44af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.233716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d719380c51434683b3dcd83722913f, user_id=5553b37350644a20b64ce76ebf60b44b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.244619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.248406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0aad1515-003b-43ec-8a03-b7395a7b44af None None] MFA Rules not processed for user `11411d69fb4747e783fae09aa58d1a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.251358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0aad1515-003b-43ec-8a03-b7395a7b44af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.266456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1859/3763] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:28.290629 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1905/3764] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:27 2022] PUT /identity/v3/projects/37d719380c51434683b3dcd83722913f/users/5553b37350644a20b64ce76ebf60b44b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:28.295897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.296199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.296486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.330699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.334025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.335984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.337907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.392769 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:28.516638 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1860/3765] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:28.525286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209ab9-e95d-4432-9fc9-8be782cb0202 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.534325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.535004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.536242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.536242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.553906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.555479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.595676 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:28.736844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.742108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.762414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918796-8367-45e9-a4be-abb9bb1361c7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.779872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.780555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.780836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.781110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.790380 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1906/3766] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:28.859011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.860496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62f820-d99d-421d-a353-cc48c4d2461f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.895690 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1861/3767] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:31.076568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:31.078237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:31.111008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134182-ba34-4d58-926e-681eb9d4794f service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:31.123920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:31.125089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:31.125515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:31.126252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] PATH_INFO: `/v3/users/9ea6cb4c68a544dd8fb6bd2fa6b76fc1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:31.129415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea6cb4c68a544dd8fb6bd2fa6b76fc1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:31.133550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:31.199122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea6cb4c68a544dd8fb6bd2fa6b76fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:31.200259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea6cb4c68a544dd8fb6bd2fa6b76fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:31.212824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea6cb4c68a544dd8fb6bd2fa6b76fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:31.223367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea6cb4c68a544dd8fb6bd2fa6b76fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:31.239817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea6cb4c68a544dd8fb6bd2fa6b76fc1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:31.256328 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1907/3768] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:31 2022] DELETE /identity/v3/users/9ea6cb4c68a544dd8fb6bd2fa6b76fc1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:31.256934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:31.257418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:31.257515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:31.281906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:31.283294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:31.378084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1862/3769] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:31.412552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:31.421380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:31.471069 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:31.523905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b1af-fbbb-422e-b99c-bd1d05ec1db1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:31.527912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:31.528638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:31.528920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:31.529195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:31.540579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:31.542149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:31.554407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1908/3770] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:32.379523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:32.381562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:32.423854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641049-bfd0-466a-892e-341e945b4317 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:32.445429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:32.446378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:32.446666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:32.446996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] PATH_INFO: `/v3/projects/d32fc467771e4579bd0e23874cc3ddc5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:32.451703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32fc467771e4579bd0e23874cc3ddc5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:32.453761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:32.604650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32fc467771e4579bd0e23874cc3ddc5', 'request_id': 'req-c63e6990-558f-42bf-9e96-debe7128410b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.636664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32fc467771e4579bd0e23874cc3ddc5', 'request_id': 'req-c63e6990-558f-42bf-9e96-debe7128410b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.654807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32fc467771e4579bd0e23874cc3ddc5', 'request_id': 'req-c63e6990-558f-42bf-9e96-debe7128410b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.683819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] The token cache is being invalidate because project d32fc467771e4579bd0e23874cc3ddc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:32.684446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.685388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.690130 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1863/3771] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:32 2022] DELETE /identity/v3/projects/d32fc467771e4579bd0e23874cc3ddc5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:32.694683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:32.709739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30019-f00d-462b-9db2-4500a1238a24 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:32.798392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:32.799698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:32.800413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:32.801408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] PATH_INFO: `/v3/users/7ad600b1d955456da749ba5619394853` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:32.815162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad600b1d955456da749ba5619394853)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:32.821505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:32.915730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad600b1d955456da749ba5619394853'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.916763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad600b1d955456da749ba5619394853'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.935599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad600b1d955456da749ba5619394853'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.946597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad600b1d955456da749ba5619394853'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.962027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-89f8de52-165b-4029-964f-f6da7f1eee31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad600b1d955456da749ba5619394853'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:32.970979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1909/3772] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:32 2022] DELETE /identity/v3/users/7ad600b1d955456da749ba5619394853 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:33.650501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:33.653444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:33.680353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e6990-558f-42bf-9e96-debe7128410b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:33.773073 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:33.793294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:33.794301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:33.794773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:33.795240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] PATH_INFO: `/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:33.797544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b58fcb2c14a4d4e8e3de40c08a9c734)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:33.799764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:33.868260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b58fcb2c14a4d4e8e3de40c08a9c734', 'request_id': 'req-b763c9de-5faf-4539-beac-130d1b42cfcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:33.877639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b58fcb2c14a4d4e8e3de40c08a9c734', 'request_id': 'req-b763c9de-5faf-4539-beac-130d1b42cfcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:33.885019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b58fcb2c14a4d4e8e3de40c08a9c734', 'request_id': 'req-b763c9de-5faf-4539-beac-130d1b42cfcc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:33.901316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] The token cache is being invalidate because project 6b58fcb2c14a4d4e8e3de40c08a9c734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:33.901946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:33.903061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b763c9de-5faf-4539-beac-130d1b42cfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:33.905503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1864/3773] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:33 2022] DELETE /identity/v3/projects/6b58fcb2c14a4d4e8e3de40c08a9c734 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:33.911235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:33.911753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:33.911867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:33.937623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:33.939353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:34.003801 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:34.028116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1910/3774] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:34.036529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.036950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.037289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.060188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:34.062529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:34.074395 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1865/3775] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:34.075660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.087909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db689c5-9b71-4bf5-b638-f7e86ab5544e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.093829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.094589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.095023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.095417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.096267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:34.096690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.099008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.122960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.135723 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1911/3776] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:34.136046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c357d7-a746-43fa-a73e-facaad0a2dea None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.141649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.142477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.142872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.143286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.144791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.147210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.190192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.202790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1866/3777] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:34.205696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c337910-2c62-48a4-abfe-06145e8f7052 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.296546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.297645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.298736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.299137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.299961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.303126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.334672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.345638 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1912/3778] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/users => generated 302 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:34.349047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127620b-0bf5-47e6-a394-dfdfc3cbc18c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.355661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.356858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.356858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.357334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.358620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.360501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.377810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.387907 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1867/3779] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:34.391079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c8a0-410f-45c6-96bb-4025bb977853 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.403141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.403977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.404373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.404765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.405625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.407403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d601-2a9e-4306-9fb2-a3d195d823d2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.427874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.428496 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1913/3780] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:34.441087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846c9b4-b3c1-4d5a-b769-9c5737c0032c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.446859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.447966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.448367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.448897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] PATH_INFO: `/v3/projects/2a231cefe57745f5af67fddf4d187cda/users/fbd790fc1da9431c8858e435c7299442/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.467386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a231cefe57745f5af67fddf4d187cda, user_id=fbd790fc1da9431c8858e435c7299442, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.470611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.511216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.512026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.513028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.521768 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1868/3781] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:34 2022] PUT /identity/v3/projects/2a231cefe57745f5af67fddf4d187cda/users/fbd790fc1da9431c8858e435c7299442/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:34.547875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] MFA Rules not processed for user `fbd790fc1da9431c8858e435c7299442`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:34.549638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:34.651833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.660040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1914/3782] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:34.796036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4512-cb67-4e19-be8c-1d3ef9b567a0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.801857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.802926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.803831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.804401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.805355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.808259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.831428 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:34.860707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.870025 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1869/3783] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/projects => generated 405 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:34.877061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a751d86-dbcb-41f0-9ebb-0451881898c1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.961715 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:34.991303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.992243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.992708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.993236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.994357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.996808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.054116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1915/3784] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:34 2022] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:35.058728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.076259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb92d8-5895-44a2-8ee9-56fe4783bfcb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:35.091343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:35.092173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.092566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.092950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.093843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:35.095567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.153713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1870/3785] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:35.156221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.172736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463236-6c8b-436f-8652-4635900be4c3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:35.185892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:35.186949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.187388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.187818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] PATH_INFO: `/v3/projects/156502a130d848919ff06302d811bb2f/users/5905c151d06244c5a914a920ae9c86e5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.232552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] RBAC: Authorizing `identity:create_grant(project_id=156502a130d848919ff06302d811bb2f, user_id=5905c151d06244c5a914a920ae9c86e5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:35.235366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.271166 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1916/3786] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:35 2022] PUT /identity/v3/projects/156502a130d848919ff06302d811bb2f/users/5905c151d06244c5a914a920ae9c86e5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:35.272318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.291936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbc42-b515-438e-a10a-20354aec1229 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:35.449990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:35.450598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.450881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.451160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.451907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:35.453519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebc3c0-78c3-4658-800b-5f267ab9f198 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.486220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.492948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1871/3787] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:35.500472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6928ce8-0ef3-4e57-8e89-3047f38c199c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:35.505997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:35.506909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.507219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.507457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] PATH_INFO: `/v3/projects/156502a130d848919ff06302d811bb2f/users/5905c151d06244c5a914a920ae9c86e5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.518760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156502a130d848919ff06302d811bb2f, user_id=5905c151d06244c5a914a920ae9c86e5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:35.522304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.551555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.551555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.551555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.551915 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1917/3788] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:35 2022] PUT /identity/v3/projects/156502a130d848919ff06302d811bb2f/users/5905c151d06244c5a914a920ae9c86e5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:35.663696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] MFA Rules not processed for user `5905c151d06244c5a914a920ae9c86e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:35.665838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:35.850605 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1872/3789] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:35.924676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.927047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:36.109511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dcbf-395c-49e5-b5d9-119a2fca35a9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:36.124838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:36.126359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:36.126896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:36.127383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:36.302727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:36.304798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e165e-9cc6-4c44-bc21-5e0f0a4206ab service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:36.332293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1918/3790] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:38.003268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:38.005808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:38.219536 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:38.234776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8a020-4f59-4945-bd28-54b762bdfa76 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:38.241782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:38.242937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:38.243434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:38.244243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:38.260179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:38.262606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:38.320089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1873/3791] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:39.481027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.482629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.482629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.536393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] MFA Rules not processed for user `5553b37350644a20b64ce76ebf60b44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:39.539109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.611245 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.668382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1919/3792] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:39.673236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.674860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.821600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967832d7-a948-426d-8e48-3b807b055cb9 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.834676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.835383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.835668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.835941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.836821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.838814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.894997 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1874/3793] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:39.898931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.922718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed54f-cf2f-4030-9d2c-58213603be62 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.123010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.123725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.124039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.124278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.124985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.127002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.203104 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1920/3794] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/users => generated 301 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:40.209109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.229273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ea77-91e6-45b4-a44e-f8addd12303e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.241277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.245209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.246267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.246764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.248826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.256409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.277106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1875/3795] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:40.280935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.299438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f2ef-b5e8-4188-baf2-ef3be6a85ece admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.316501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.317991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.317991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.318230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] PATH_INFO: `/v3/projects/e487e705f29346409a8478acc0795293/users/79c009db00ac498faa7671fd4477aacb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.350021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e487e705f29346409a8478acc0795293, user_id=79c009db00ac498faa7671fd4477aacb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.352718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.386275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.386956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1921/3796] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:40 2022] PUT /identity/v3/projects/e487e705f29346409a8478acc0795293/users/79c009db00ac498faa7671fd4477aacb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:40.400599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c114059-f51a-40ff-b189-9724795ce865 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.526991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.528061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.528562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.529533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.530560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.532432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.550669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.560915 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1876/3797] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:40.583405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56b1a-404c-48a1-a5d2-53d94c3bbb8b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.591352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.594848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.595247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.595634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] PATH_INFO: `/v3/projects/e487e705f29346409a8478acc0795293/users/79c009db00ac498faa7671fd4477aacb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.599678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e487e705f29346409a8478acc0795293, user_id=79c009db00ac498faa7671fd4477aacb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.609505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.638985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1922/3798] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:40 2022] PUT /identity/v3/projects/e487e705f29346409a8478acc0795293/users/79c009db00ac498faa7671fd4477aacb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:42.268039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.269926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.302930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94470d6d-84f2-40ae-a8be-1c0f97f48d94 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.489325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.491335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.558227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.559892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.567166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.567693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] PATH_INFO: `/v3/users/3172ec09985048558fe0f3adf9c067fd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.572694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3172ec09985048558fe0f3adf9c067fd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.595070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.612489 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:42.795051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3172ec09985048558fe0f3adf9c067fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.819877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3172ec09985048558fe0f3adf9c067fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.822616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238d21-9c38-4fee-892e-b1bfe06ef288 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.840363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3172ec09985048558fe0f3adf9c067fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.854463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.858003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.862113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.862886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.868258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.906247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3172ec09985048558fe0f3adf9c067fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.907827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3172ec09985048558fe0f3adf9c067fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.933834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1877/3799] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:42 2022] DELETE /identity/v3/users/3172ec09985048558fe0f3adf9c067fd => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:42.975860 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:43.077509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.079387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732eeb5-4e7e-4eb8-a119-a43a27ac6ac7 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.110210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1923/3800] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:43.503462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.505128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.644077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be5fb-4577-441e-8d11-ab7fe27e652c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.652137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.653051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.653336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.653619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] PATH_INFO: `/v3/projects/e5025d6267ba40509d642d51a559f217` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.655005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5025d6267ba40509d642d51a559f217)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.667061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.808955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5025d6267ba40509d642d51a559f217', 'request_id': 'req-7d004325-339c-403f-9ec6-eb840c97ef45'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.825695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5025d6267ba40509d642d51a559f217', 'request_id': 'req-7d004325-339c-403f-9ec6-eb840c97ef45'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.835354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5025d6267ba40509d642d51a559f217', 'request_id': 'req-7d004325-339c-403f-9ec6-eb840c97ef45'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.870191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] The token cache is being invalidate because project e5025d6267ba40509d642d51a559f217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:43.870494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.871181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7d004325-339c-403f-9ec6-eb840c97ef45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.881813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1878/3801] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:43 2022] DELETE /identity/v3/projects/e5025d6267ba40509d642d51a559f217 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:43.883590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.884090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.884175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.926356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:43.930678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:44.056465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1924/3802] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:44.060144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.060469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.060755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.111739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:44.117073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:44.143603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1879/3803] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:44.148321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.169995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d799e-1af3-495f-876a-af81b706bd8e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.183203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.183897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.184184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.184466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.185392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:44.185599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.187343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.215819 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1925/3804] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:44.223480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.234194 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:44.244060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9e484-926c-4b62-a81b-a8bcd989a4af None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.277648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.278690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.279274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.279713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.280599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.288949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.370499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1880/3805] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:44 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:44.374389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.388882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7660e55-c728-4d11-a18a-cc2463d4267f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.549263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.550151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.551055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.551492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.552403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.554556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.611150 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1926/3806] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:44 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:44.615125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.634892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975817e-a1ec-4032-b373-4e1dea096524 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.650387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.651440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.652068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.652603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.653529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.655252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.682849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1881/3807] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:44.687280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.702912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f855c-f291-4751-a6af-54378419b975 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.719557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.720426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.720717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.720997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.721821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.724167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c70d8-d1ba-4a5d-9ada-9f8335d275a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.746399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1927/3808] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:44.750333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.764549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0d2b-cf23-45c4-b612-d6131ed9f37c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.782356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.783288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.783575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.783855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] PATH_INFO: `/v3/projects/a0fe7868ac524f4498b1dadc33efae7b/users/59d8758357384418aeca2b24f1e8bd12/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.836601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fe7868ac524f4498b1dadc33efae7b, user_id=59d8758357384418aeca2b24f1e8bd12, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.839697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.870874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1882/3809] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:44 2022] PUT /identity/v3/projects/a0fe7868ac524f4498b1dadc33efae7b/users/59d8758357384418aeca2b24f1e8bd12/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:44.887024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f3df-614e-4ba6-b6da-e8f1e6d3f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.887862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f3df-614e-4ba6-b6da-e8f1e6d3f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.888306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7f3df-614e-4ba6-b6da-e8f1e6d3f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.938898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2ad7f3df-614e-4ba6-b6da-e8f1e6d3f6a5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:44.940427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ad7f3df-614e-4ba6-b6da-e8f1e6d3f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:44.987500 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:45.030820 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1928/3810] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:45.071170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.072961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.220960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173a6dc-38d8-4609-8752-01178267c7d4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.227108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.227786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.228073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.228504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.246841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.248347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd123bac-0174-433e-83fd-660697fadcb1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.260170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1883/3811] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:46.248211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.250105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.250390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.252182 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1929/3812] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:20:46.264891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.265365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.265500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.286685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:46.287941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.449084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1884/3813] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:46.510524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.512330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.554979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfc8fe-5042-4aa9-a288-ff6de5ce5bad None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.588716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.589393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.592786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.593334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.639914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.645132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.680806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1930/3814] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:47.086468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.107317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0b236-793d-48b2-9c0e-4a119e1a7068 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.130937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.131670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.131952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.132233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.138564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.166824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.169554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.188804 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1885/3815] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:48.372817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.404542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fe0a3-8228-43ea-81c5-a8bf86ee1fc8 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.417240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.419536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.421326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.423200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.430241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.601459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.604903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.651480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b777fd-9932-4c92-9149-d2c002c7b022 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.671710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.684945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.686110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.687052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] PATH_INFO: `/v3/users/c6d333d036f74225bf1afd3d36d8e339` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.691802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d333d036f74225bf1afd3d36d8e339)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.698484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.715755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.717439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.741539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1931/3816] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:48.760176 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.818127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d333d036f74225bf1afd3d36d8e339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.836251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d333d036f74225bf1afd3d36d8e339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.848178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.851396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d333d036f74225bf1afd3d36d8e339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.873550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d333d036f74225bf1afd3d36d8e339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.874369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d333d036f74225bf1afd3d36d8e339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.874551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee5f0-7ea0-4c7b-8af3-454a82981bfc service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.881367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.882483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.883234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.884035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.887231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.890672 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1886/3817] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:48 2022] DELETE /identity/v3/users/c6d333d036f74225bf1afd3d36d8e339 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:48.903035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.907143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed96d5-bc42-42a1-b703-40cdff6a8328 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.926101 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1932/3818] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:49.234568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.236448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.368867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c1e94-d37b-475c-9494-35d6133f05c3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.374057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.375116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.375472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.375839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] PATH_INFO: `/v3/users/11411d69fb4747e783fae09aa58d1a5e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.377280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11411d69fb4747e783fae09aa58d1a5e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.380753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.451073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11411d69fb4747e783fae09aa58d1a5e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.476684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11411d69fb4747e783fae09aa58d1a5e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.493194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11411d69fb4747e783fae09aa58d1a5e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.513474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11411d69fb4747e783fae09aa58d1a5e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.514873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11411d69fb4747e783fae09aa58d1a5e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.525484 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1887/3819] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:49 2022] DELETE /identity/v3/users/11411d69fb4747e783fae09aa58d1a5e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:49.530875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.531638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.532098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.574757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:49.578283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.698826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.702059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.714864 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1933/3820] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:49.736413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cd2a1-9fdb-4605-89c9-de76927ab585 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.756416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.757126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.758938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.760313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.760839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] PATH_INFO: `/v3/projects/97fbef19413a4054aa808c676248fd27` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.763691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fbef19413a4054aa808c676248fd27)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.766582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.782281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.842898 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:49.883751 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:49.885346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7a6b4-0a99-4f3b-9869-a5caea4ba79f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.892637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.893315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.893598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.894826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.922754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.924246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95208d2-30ad-4c6f-8c30-93a0bce9378f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.946655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1934/3821] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:49.950582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fbef19413a4054aa808c676248fd27', 'request_id': 'req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.965269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fbef19413a4054aa808c676248fd27', 'request_id': 'req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.990490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fbef19413a4054aa808c676248fd27', 'request_id': 'req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.027577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] The token cache is being invalidate because project 97fbef19413a4054aa808c676248fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:50.027973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.030572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d66c52ee-8e9d-4d6d-9a39-6db0dfec325c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.034515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1888/3822] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:49 2022] DELETE /identity/v3/projects/97fbef19413a4054aa808c676248fd27 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:50.040883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.041506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.042035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.063405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:50.065284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:50.186456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1935/3823] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:50.194836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.195170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.195387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.236725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:50.238261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:50.255255 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1889/3824] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:50.256586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.271944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc870-7932-4269-85ec-328e6bce2829 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.286470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.288589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.288877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.289154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.289943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:50.290251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.292522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.307120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1936/3825] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:50.311798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.327778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d3cb-38f4-4415-a3ee-a7b1843b2a5a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.334957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.335636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.335916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.336190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.337784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.339585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.374465 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1890/3826] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:50.379192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.394938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8b67-9bc3-4b5b-8bc0-4fd0dda073a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.542618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.543605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.544029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.544309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.545046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.555162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.616178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1937/3827] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:50 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:50.617955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.639406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d50b3-30a0-48c8-956a-b1a3a48f6c26 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.661945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.662637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.662922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.663558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.664071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.667527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.691009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1891/3828] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:50.694878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.712885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.714762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901bb06-88fa-4728-8cec-dd7dc69ce27e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.717701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:50.733964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.738043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.742854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.747658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.748601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.753760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.774770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6b7d7-4dc3-4571-9823-8d0ee041f044 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.787662 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1938/3829] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:50.789120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:50.791156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.792363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.793238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.793764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] PATH_INFO: `/v3/users/bba4323f452d409eaf42a1d7d60df35c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.798631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba4323f452d409eaf42a1d7d60df35c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.803864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.817139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df366a-6171-4345-9863-6f34d9903b66 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:50.834483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:50.836117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.836621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.837336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] PATH_INFO: `/v3/projects/e19e03d9bbe8415198317f7c2c001ac3/users/e19b156b5c8f4f30af95d21c57091ec5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.879597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19e03d9bbe8415198317f7c2c001ac3, user_id=e19b156b5c8f4f30af95d21c57091ec5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:50.885181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8db0d4-822c-48a8-b6d5-8023193f3762 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:50.926072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba4323f452d409eaf42a1d7d60df35c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.929012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1939/3830] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:50 2022] PUT /identity/v3/projects/e19e03d9bbe8415198317f7c2c001ac3/users/e19b156b5c8f4f30af95d21c57091ec5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:50.934527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:50.935270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:50.936025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:50.944676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba4323f452d409eaf42a1d7d60df35c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.963779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba4323f452d409eaf42a1d7d60df35c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:50.973161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:50.975374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:50.992479 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:51.009155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba4323f452d409eaf42a1d7d60df35c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:51.015071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba4323f452d409eaf42a1d7d60df35c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:51.040691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1892/3831] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:50 2022] DELETE /identity/v3/users/bba4323f452d409eaf42a1d7d60df35c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:51.092509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1940/3832] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:51.111742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:51.115334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.230175 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:51.295255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2123f-eab5-4369-a136-576c4da39f33 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:51.315351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:51.319090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.319617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.320298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.423035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:51.424924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed5360-9d0d-403a-9e4c-791a76c7897b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:51.441335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1893/3833] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:52.252193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.254782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:52.278594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027c91-feca-4a6d-a7a0-53ac7f5192ff None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:52.284270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:52.286300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.286692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.287194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] PATH_INFO: `/v3/projects/a2a0554a2bdf40009b895620212a11f1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.289523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a0554a2bdf40009b895620212a11f1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:52.292188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:52.404320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a0554a2bdf40009b895620212a11f1', 'request_id': 'req-a86a1713-8b62-4248-8dc6-c410820e3a8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.416248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a0554a2bdf40009b895620212a11f1', 'request_id': 'req-a86a1713-8b62-4248-8dc6-c410820e3a8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.458064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a0554a2bdf40009b895620212a11f1', 'request_id': 'req-a86a1713-8b62-4248-8dc6-c410820e3a8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.492958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] The token cache is being invalidate because project a2a0554a2bdf40009b895620212a11f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:52.493866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.494744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a86a1713-8b62-4248-8dc6-c410820e3a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.498365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1941/3834] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:52 2022] DELETE /identity/v3/projects/a2a0554a2bdf40009b895620212a11f1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:52.507974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.508464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.508558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.546893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:52.548340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:52.698533 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1894/3835] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:52.706467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.707542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.707715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.735220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:52.736755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:52.744337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.747506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:52.751471 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1942/3836] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:52.758700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.771419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337d4ec-7193-466f-b34c-4f09b3c1da59 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:52.775653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ed6c-451e-45eb-871f-09022522a2d6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:52.781446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:52.782181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.782464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.782739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.783593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:52.783907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:52.784722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:52.787068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:52.788234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.788769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.790162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] PATH_INFO: `/v3/projects/4bf80756586b48a7a320b87480fdbcc8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.793922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf80756586b48a7a320b87480fdbcc8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:52.801496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:52.821734 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1943/3837] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:52.826939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.852920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10eee6-5268-4178-a4bc-f3d3dd60a79a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:52.865331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:52.868983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.869491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.869941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.872912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:52.879318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:52.922308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf80756586b48a7a320b87480fdbcc8', 'request_id': 'req-ab31ef78-92e1-4c10-af67-0379dc4cce2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.937793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf80756586b48a7a320b87480fdbcc8', 'request_id': 'req-ab31ef78-92e1-4c10-af67-0379dc4cce2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.956957 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1944/3838] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:52.957519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf80756586b48a7a320b87480fdbcc8', 'request_id': 'req-ab31ef78-92e1-4c10-af67-0379dc4cce2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.961322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.979867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] The token cache is being invalidate because project 4bf80756586b48a7a320b87480fdbcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:52.980236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.981855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab31ef78-92e1-4c10-af67-0379dc4cce2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:52.983710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1895/3839] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:52 2022] DELETE /identity/v3/projects/4bf80756586b48a7a320b87480fdbcc8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:52.990749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366141-8ba6-4293-a132-62e0a50e37ed None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.991172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366141-8ba6-4293-a132-62e0a50e37ed None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.991454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae366141-8ba6-4293-a132-62e0a50e37ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.038030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ae366141-8ba6-4293-a132-62e0a50e37ed None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:53.039490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ae366141-8ba6-4293-a132-62e0a50e37ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:53.061546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befcc3b-c168-4fa8-939b-e6ea4587649a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.062526 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:53.076909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.077911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.079009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.079530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.092837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.095042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.103440 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:53.135216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1945/3840] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:53.139335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.142617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:53.163116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25c817-043f-4385-9112-c27b23045761 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.171175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.172533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.172927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.173346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.174819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.177304 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1896/3841] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:53.186421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.186705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.186979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.187407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.204604 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1946/3842] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:53.205845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.227658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:53.229056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:53.230747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e57bbd-9352-4f31-bb0c-f962e414d258 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.243133 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1897/3843] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:53.247400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.254889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.255621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.256046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.256431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.257411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.263653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.270381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde62b6-ed8d-484d-a38a-38c41d2b636a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.280370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.280987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.281268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.281546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.282384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:53.282696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.284348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.309304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1947/3844] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:53.310890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.313820 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1898/3845] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:53.318522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.339575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485418c8-bedc-4dbc-812c-98f68b2e158e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.346914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64695a-3534-476c-8e31-8ef0e805ecc9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.349775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.351814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.352658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.352947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.355137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.355826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.355971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.356680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.356967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] PATH_INFO: `/v3/projects/dfd38af4d6e2417b9b73b03ee795328f/users/5a34b91b8c3d4fe3a42e0ceffa767726/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.358357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.378201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd38af4d6e2417b9b73b03ee795328f, user_id=5a34b91b8c3d4fe3a42e0ceffa767726, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.382198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e9bff-4e9c-461a-97e5-1049d860e104 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.417215 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1948/3846] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:53 2022] PUT /identity/v3/projects/dfd38af4d6e2417b9b73b03ee795328f/users/5a34b91b8c3d4fe3a42e0ceffa767726/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:53.423371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.424230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.425032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.452092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:53.453739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:53.461048 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1899/3847] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:53 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:53.463232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.634532 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1949/3848] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:53.655699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3fcc7-09fc-4852-b296-6d51b883513d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.665086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.666234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.667007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.667458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.668599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.672253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.691204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.692772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:53.705468 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1900/3849] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:53 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:53.710410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.728971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f36a-8609-4fb8-a5bd-0be5f84367b3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.747163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.749324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.750026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.750504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.751827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.754557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.770146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1901/3850] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:53.773816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.787352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bca73-32a1-47e9-b7ae-a13a3b97adc8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.793526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.794607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.795085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.795562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.796629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.799300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.819324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1902/3851] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:53.823637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:53.839459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83838c2-fee0-48d0-800e-b021b36e8540 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.844427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a392f-79d3-4cdb-8a2d-3fcad2472ae4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:53.845698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.846772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.847109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.848036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] PATH_INFO: `/v3/projects/6b725b9f1812465f8a350e1a68e067a0/users/1dda9fc0670f4e11ad4d8089bf1687c3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.858372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:53.860493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.860778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.864020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.892148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.892467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b725b9f1812465f8a350e1a68e067a0, user_id=1dda9fc0670f4e11ad4d8089bf1687c3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:53.893599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc4b61-fbde-4b0e-9cb5-4fffb1e0661e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.896920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:53.922204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1950/3852] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:53.922731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1903/3853] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:53 2022] PUT /identity/v3/projects/6b725b9f1812465f8a350e1a68e067a0/users/1dda9fc0670f4e11ad4d8089bf1687c3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:53.928386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28e47-d034-48d1-918d-13a67d0205e3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:53.928725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28e47-d034-48d1-918d-13a67d0205e3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:53.929010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28e47-d034-48d1-918d-13a67d0205e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:53.952461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-95e28e47-d034-48d1-918d-13a67d0205e3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:53.953714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95e28e47-d034-48d1-918d-13a67d0205e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:54.033117 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:54.073376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1951/3854] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:54.089442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:54.139268 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:54.202887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efed87b-f672-4631-9e18-66caf5b2469b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:54.210165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:54.211214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:54.211858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:54.212363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:54.231775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:54.234887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:54.274357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1904/3855] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:02.277138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:02.277649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:02.277846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:02.380288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] MFA Rules not processed for user `79c009db00ac498faa7671fd4477aacb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:02.385093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.588792 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1952/3856] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:02.602942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:02.605425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.782431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d3bf-c412-4e7a-ae15-1eb7af1ff165 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:02.790458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:02.793061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:02.794553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:02.795738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:02.804083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.936895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:02.940248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:02.974495 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1905/3857] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:04.751258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:04.760881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:05.140126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b5b1-b599-4bc0-8aa4-dcca5fb40dc0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:05.178301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:05.181843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.187418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.189285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.199866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:05.258380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:05.261728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083d280-a3e7-4605-bf3f-d1abf2d239f6 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:05.297730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1953/3858] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:07.691975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.693798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:07.728300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85034-f7ad-4bc9-9282-b42641ce35e1 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.739886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.741957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.742325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.742673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] PATH_INFO: `/v3/users/fbd790fc1da9431c8858e435c7299442` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.744032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd790fc1da9431c8858e435c7299442)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.747491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.899409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd790fc1da9431c8858e435c7299442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:07.915218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd790fc1da9431c8858e435c7299442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:07.942431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd790fc1da9431c8858e435c7299442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:07.958590 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:08.001006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd790fc1da9431c8858e435c7299442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.002377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7de97960-e8fe-4edd-8f9c-16bc9be1f0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd790fc1da9431c8858e435c7299442'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.015671 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1906/3859] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:07 2022] DELETE /identity/v3/users/fbd790fc1da9431c8858e435c7299442 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:21:08.020174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.020717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.020812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.068342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:08.071759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.222396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.223000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.223786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.233775 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1954/3860] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:08.285126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:08.287343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.293934 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:08.299566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] MFA Rules not processed for user `59d8758357384418aeca2b24f1e8bd12`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:08.305014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.465920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ed0f-615e-4de3-9069-964ff17588b6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:08.480134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:08.480836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.481812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.482094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.514259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:08.515933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50e838-c4d9-4f4d-9223-90a156fad02b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:08.533150 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1907/3861] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:08.535099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:08.539266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.544243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1955/3862] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:21:08.554571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.554916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.555203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.587977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61d937-4cb9-401a-aa46-1d53313d8abc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:08.617059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:08.619093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.621776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.622029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] PATH_INFO: `/v3/users/7033c900a87241779c10097a9c494e7b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.626212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7033c900a87241779c10097a9c494e7b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:08.633097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:08.635351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] MFA Rules not processed for user `59d8758357384418aeca2b24f1e8bd12`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:08.639327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.666683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1956/3863] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:08.679612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:08.681569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:08.742865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7033c900a87241779c10097a9c494e7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.763575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7033c900a87241779c10097a9c494e7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.792984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7033c900a87241779c10097a9c494e7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.826539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7033c900a87241779c10097a9c494e7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.828280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34e74b0d-5b47-46cc-ab87-8faff20a31e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7033c900a87241779c10097a9c494e7b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:08.848266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1908/3864] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:08 2022] DELETE /identity/v3/users/7033c900a87241779c10097a9c494e7b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:08.851386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:08.852198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:08.852323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:08.920734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288157-27f3-4c3b-a3c3-552a4beb4b1a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:08.922160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:08.935517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:09.107769 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:09.196762 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1909/3865] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:09.203695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:09.208360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:09.208963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:09.209374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:09.212621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:09.220644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:09.222896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:09.320754 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:09.402201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dd4e6-d020-49f6-baf0-78ce8b70a4e3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:09.410948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:09.412326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:09.414693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:09.415148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:09.415891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:09.416496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:09.444662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:09.445620 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1957/3866] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:21:09.447481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:09.476800 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1910/3867] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:09.590120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:09.593580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:09.625049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf3a72-84cb-4010-8c4e-57603b35c901 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:09.655806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:09.660252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:09.667821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:09.670276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] PATH_INFO: `/v3/projects/2a231cefe57745f5af67fddf4d187cda` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:09.676765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a231cefe57745f5af67fddf4d187cda)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:09.683353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:09.849723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a231cefe57745f5af67fddf4d187cda', 'request_id': 'req-2188f659-4583-4ddf-9b16-abadbf98e915'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:09.861773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a231cefe57745f5af67fddf4d187cda', 'request_id': 'req-2188f659-4583-4ddf-9b16-abadbf98e915'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:09.881028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a231cefe57745f5af67fddf4d187cda', 'request_id': 'req-2188f659-4583-4ddf-9b16-abadbf98e915'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:09.908205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] The token cache is being invalidate because project 2a231cefe57745f5af67fddf4d187cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:09.910171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:09.914804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:09.919056 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1958/3868] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:09 2022] DELETE /identity/v3/projects/2a231cefe57745f5af67fddf4d187cda => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:09.923091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:09.958911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33dfe-6b1d-44f8-85d2-feb8c295a6a3 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:10.120255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:10.121408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:10.123320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:10.123746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] PATH_INFO: `/v3/users/5905c151d06244c5a914a920ae9c86e5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:10.126687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5905c151d06244c5a914a920ae9c86e5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:10.145267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:10.267279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5905c151d06244c5a914a920ae9c86e5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.284454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5905c151d06244c5a914a920ae9c86e5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.308035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5905c151d06244c5a914a920ae9c86e5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.353369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5905c151d06244c5a914a920ae9c86e5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.355059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5905c151d06244c5a914a920ae9c86e5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.377843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1911/3869] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:09 2022] DELETE /identity/v3/users/5905c151d06244c5a914a920ae9c86e5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:10.478719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:10.481984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:10.519453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f659-4583-4ddf-9b16-abadbf98e915 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:10.648429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:10.649990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:10.650557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:10.651136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] PATH_INFO: `/v3/projects/08cb5ce8c4354541b492eb8cc8f89c3b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:10.668905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cb5ce8c4354541b492eb8cc8f89c3b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:10.689893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:10.759811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:10.761807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:10.796448 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:10.803474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cb5ce8c4354541b492eb8cc8f89c3b', 'request_id': 'req-1a3da96e-e9e1-411b-aa3f-eada8a02c516'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.817142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cb5ce8c4354541b492eb8cc8f89c3b', 'request_id': 'req-1a3da96e-e9e1-411b-aa3f-eada8a02c516'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.821905 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:10.836173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cb5ce8c4354541b492eb8cc8f89c3b', 'request_id': 'req-1a3da96e-e9e1-411b-aa3f-eada8a02c516'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.862442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] The token cache is being invalidate because project 08cb5ce8c4354541b492eb8cc8f89c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:10.864229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.866228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.873381 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1959/3870] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:10 2022] DELETE /identity/v3/projects/08cb5ce8c4354541b492eb8cc8f89c3b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:10.874484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:10.880116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:10.987829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb3599-f577-47b2-9609-4d33ec7d5d97 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.143865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da96e-e9e1-411b-aa3f-eada8a02c516 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.162498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.163655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.163780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.164005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] PATH_INFO: `/v3/users/9129b6000e674a49a47040b00a4d763d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.166846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9129b6000e674a49a47040b00a4d763d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.176920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:11.193699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.195401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.195401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.195401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.203573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.234093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.235667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea712f6-8285-433c-832c-cc5c8325c39e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:11.260995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1912/3871] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:11.278374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9129b6000e674a49a47040b00a4d763d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.282144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9129b6000e674a49a47040b00a4d763d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.296906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9129b6000e674a49a47040b00a4d763d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.320580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9129b6000e674a49a47040b00a4d763d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.340350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e02b1e00-e543-41ab-a1c3-7b1a9da0f280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9129b6000e674a49a47040b00a4d763d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.351675 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1960/3872] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:10 2022] DELETE /identity/v3/users/9129b6000e674a49a47040b00a4d763d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:11.483134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.483915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.484335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.551610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] MFA Rules not processed for user `e19b156b5c8f4f30af95d21c57091ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:11.554827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.720650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1913/3873] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:11.723210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284944-6b1b-4a07-ad94-7cb13c26364c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.723684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284944-6b1b-4a07-ad94-7cb13c26364c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.723767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284944-6b1b-4a07-ad94-7cb13c26364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.769848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7a284944-6b1b-4a07-ad94-7cb13c26364c None None] MFA Rules not processed for user `e19b156b5c8f4f30af95d21c57091ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:11.771293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7a284944-6b1b-4a07-ad94-7cb13c26364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.791022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1961/3874] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:11.822811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:11.826808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.995944 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:12.005180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa391987-984f-4d87-b3dc-3c8bdf89356b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.082592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.084612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.085095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.085535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] PATH_INFO: `/v3/projects/156502a130d848919ff06302d811bb2f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.088330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=156502a130d848919ff06302d811bb2f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.094485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.236552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156502a130d848919ff06302d811bb2f', 'request_id': 'req-e69c86d8-4d7f-45ff-90b5-d534d226b459'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.250687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156502a130d848919ff06302d811bb2f', 'request_id': 'req-e69c86d8-4d7f-45ff-90b5-d534d226b459'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.261414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156502a130d848919ff06302d811bb2f', 'request_id': 'req-e69c86d8-4d7f-45ff-90b5-d534d226b459'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.291862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] The token cache is being invalidate because project 156502a130d848919ff06302d811bb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:12.292172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.292968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e69c86d8-4d7f-45ff-90b5-d534d226b459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.295196 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1914/3875] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:11 2022] DELETE /identity/v3/projects/156502a130d848919ff06302d811bb2f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:12.301193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.301971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.302468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.345136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:12.346413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.490439 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:12.513741 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1962/3876] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:12.528031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.528509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.529309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.610075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:12.611582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.655229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1915/3877] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:12.659415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.677964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2620d-742b-45de-8e8e-a8a715940687 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.693308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.694764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.695346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.697349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.699594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:12.700234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.707380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.750390 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1963/3878] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:12.755199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.771625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d75170-affb-43a9-9af8-1b9a42b97b1e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.793616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.794339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.794638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.794904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.795665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.806521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.878602 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1916/3879] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:12.883067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.896975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397432-96aa-4717-8f45-58ad94bd5cfd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.916032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.919086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.076883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.078380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.080196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.080926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.085712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.091869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.150591 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1964/3880] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/users => generated 299 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:13.151762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.177658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029c88-5113-445f-ac2b-820ee85b0df8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.189119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.189858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.190160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.190476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.193191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.195550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f1bb7-4d44-491d-b7d9-8b09825c283a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.197220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.210808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.211715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.211998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.212272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] PATH_INFO: `/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.216129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3824c3ea5105432dadfa9ea27f21b2f8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.221586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.233889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1965/3881] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:13.235444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.259636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28703a9-bc33-4e01-b2b1-fc9e8ebeb894 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.270909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.271556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.271847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.272123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.273029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.275003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.291946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1966/3882] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:13.293188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.307860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac97e8-205e-451e-9862-2451fa2c5ae3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.314722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.316773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.317225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.317637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] PATH_INFO: `/v3/projects/4283dadd9e2b454f883ba715f9989632/users/c6b7a7af337643fea35e824e5ea657fc/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.338337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4283dadd9e2b454f883ba715f9989632, user_id=c6b7a7af337643fea35e824e5ea657fc, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.341930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49c62b-1a4f-4e01-866a-5b1bdc44fb2a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.343984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3824c3ea5105432dadfa9ea27f21b2f8', 'request_id': 'req-51ead669-21df-42e8-b84c-7869f4e593dd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.359164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3824c3ea5105432dadfa9ea27f21b2f8', 'request_id': 'req-51ead669-21df-42e8-b84c-7869f4e593dd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.368465 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:13.369892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3824c3ea5105432dadfa9ea27f21b2f8', 'request_id': 'req-51ead669-21df-42e8-b84c-7869f4e593dd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.372807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1967/3883] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:13 2022] PUT /identity/v3/projects/4283dadd9e2b454f883ba715f9989632/users/c6b7a7af337643fea35e824e5ea657fc/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:13.385896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.386318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.386611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.398737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] The token cache is being invalidate because project 3824c3ea5105432dadfa9ea27f21b2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:13.399070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.399741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51ead669-21df-42e8-b84c-7869f4e593dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.401326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1917/3884] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:12 2022] DELETE /identity/v3/projects/3824c3ea5105432dadfa9ea27f21b2f8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:13.406542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5119702-52c4-4043-a490-a0adbd309774 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.406830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5119702-52c4-4043-a490-a0adbd309774 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.407355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5119702-52c4-4043-a490-a0adbd309774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.425179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] MFA Rules not processed for user `c6b7a7af337643fea35e824e5ea657fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.426851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.467488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f5119702-52c4-4043-a490-a0adbd309774 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.468748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f5119702-52c4-4043-a490-a0adbd309774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.567502 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1968/3885] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:13.568476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.570401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.643816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1918/3886] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:13.650444 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:13.736821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc161-7579-4988-abac-941355f7b136 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.736821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc161-7579-4988-abac-941355f7b136 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.736821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc161-7579-4988-abac-941355f7b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.772020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458584-6b93-4d0a-b85b-c9bd4d18d755 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.790105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-61edc161-7579-4988-abac-941355f7b136 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.797552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-61edc161-7579-4988-abac-941355f7b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.814435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.814759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.815117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.815863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.829425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.840081 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1919/3887] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:13.843134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc161-7579-4988-abac-941355f7b136 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.848822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.885600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc161-7579-4988-abac-941355f7b136 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.904496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.906760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.907357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.907626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.909802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:13.911450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.918008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.932950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1969/3888] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/projects => generated 397 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:13.937923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.970256 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1920/3889] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:13.972588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.000482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7706ba-b014-45d6-b4b6-4898c31f73f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.209069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.209069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.209069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.209069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.211216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.220112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.277389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1a38-4772-4a85-8b8d-ab47a28e80f5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.305731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.306429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.306716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.307395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.311287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.313951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.378984 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1921/3890] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/projects => generated 379 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:14.382870 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1970/3891] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/users => generated 305 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:14.386961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.387313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.409525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af1c2-b3fb-4fd9-b72b-5aebd821fb09 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.579544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.580267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.582923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.584071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.585622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.587315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.598005 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:14.607684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75f8a-6707-483a-82e2-dfe243a937bb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.617787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.619778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.620375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.621035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.623710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.627563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.639021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1971/3892] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:14.642558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.684582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac5f3-5247-4067-801b-e6ccf384b9a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.702574 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1922/3893] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/users => generated 290 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:14.708136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.715267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.719330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.719617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.719899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] PATH_INFO: `/v3/projects/41a3b7ce915a482e938da5dc42a5048c/users/48b6a5c0ac9d44a89f205c0c6e7326a8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.721953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a42c8-a671-4f9f-99da-1c8bb86cab14 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.739820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.741223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.741839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.742379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.746337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.754799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.790872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a3b7ce915a482e938da5dc42a5048c, user_id=48b6a5c0ac9d44a89f205c0c6e7326a8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.798606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.809794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1923/3894] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:14.814066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.847864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4f43-db65-4622-9256-3f7c3c0eac20 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.856157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1972/3895] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:14 2022] PUT /identity/v3/projects/41a3b7ce915a482e938da5dc42a5048c/users/48b6a5c0ac9d44a89f205c0c6e7326a8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:14.861952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.908200 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.039004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.039958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.040205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.040628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.041501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.043561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.061946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1924/3896] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:15.062921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.067745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.103751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221f564-f6bc-4380-a89a-abc82669e769 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.119661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.120351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.120638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.120922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.121702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.138302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.171545 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1973/3897] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:15.175958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.201442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a576d4-fc05-439c-b2e2-28e0cec0242d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.218693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.227070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.227070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.227070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] PATH_INFO: `/v3/projects/529575c8bb4f4fe69ed343648a318c18/users/0e63621b727e45d5b047755564721b89/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.255606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc83ccc-564e-4186-943b-799f688e2222 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.265455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.270144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.270392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.270649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.273070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529575c8bb4f4fe69ed343648a318c18, user_id=0e63621b727e45d5b047755564721b89, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.279319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.281321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.312957 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1974/3898] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:15 2022] PUT /identity/v3/projects/529575c8bb4f4fe69ed343648a318c18/users/0e63621b727e45d5b047755564721b89/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:15.326098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.461577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.465569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a54a3-da2a-4d33-93f0-ceb94ca66c3e service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.494353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e56938-678f-4321-8321-9d6e4131bde6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.499392 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1925/3899] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:15.500772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.501064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.501342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.520149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.521075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.521359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.521643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] PATH_INFO: `/v3/projects/41a3b7ce915a482e938da5dc42a5048c/users/48b6a5c0ac9d44a89f205c0c6e7326a8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.527081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a3b7ce915a482e938da5dc42a5048c, user_id=48b6a5c0ac9d44a89f205c0c6e7326a8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.535980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cb746-db32-4fd5-8904-c7b64bb6ec36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.555297 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.572769 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1975/3900] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:15 2022] PUT /identity/v3/projects/41a3b7ce915a482e938da5dc42a5048c/users/48b6a5c0ac9d44a89f205c0c6e7326a8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:15.583549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.583820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.584287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.608964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] MFA Rules not processed for user `0e63621b727e45d5b047755564721b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:15.624138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.682790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] MFA Rules not processed for user `48b6a5c0ac9d44a89f205c0c6e7326a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:15.684046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.916601 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1926/3901] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:15.918098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.956383 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.975720 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1976/3902] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:16.038662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:16.042365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:16.259338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd27f6-f178-4d3d-9160-9abb7c0eae1e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.272226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.272880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.273164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.273444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.276127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.280019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.384496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1927/3903] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:15 2022] POST /identity/v3/projects => generated 379 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:16.389082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:16.392367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186a2-509b-4c57-b9fb-6956346c0aec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.570672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.571812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.572218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.572597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.674349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d426e-669c-45cf-90f9-8fa66435aea8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.688168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.690734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.691208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.692212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.694874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.702272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.769812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1928/3904] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:16 2022] POST /identity/v3/users => generated 296 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:16.773348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:16.812918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624b366-c481-4668-9b4b-40f42a41f31e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.816058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.819625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.834570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.838469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.838761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.839043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.853628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.856965 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1977/3905] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:21:16.868903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.898088 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:16.945378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1929/3906] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:16.948072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:16.968072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2c3b3-e772-45d5-8d00-38c415737c14 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.988069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.989408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.992488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.994779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] PATH_INFO: `/v3/projects/053f5331bae0479bae162a34e7087dac/users/75bd317604984572bfbf6d321296a82e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:17.053108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f5331bae0479bae162a34e7087dac, user_id=75bd317604984572bfbf6d321296a82e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:17.067211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:17.104869 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1978/3907] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:16 2022] PUT /identity/v3/projects/053f5331bae0479bae162a34e7087dac/users/75bd317604984572bfbf6d321296a82e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:17.106947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:17.140424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc79b7-d8f5-49a8-9f6c-ccc3173f40d5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:17.373829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:17.374643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:17.374939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:17.375314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:17.375984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:17.377901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9dfe-ab9e-434d-a371-2180475f86e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:17.418044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1930/3908] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:17.421877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:17.445279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d87ce-dc35-4612-ad07-ca510a86a77b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:17.460894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:17.462196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:17.462721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:17.463212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] PATH_INFO: `/v3/projects/053f5331bae0479bae162a34e7087dac/users/75bd317604984572bfbf6d321296a82e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:17.470574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f5331bae0479bae162a34e7087dac, user_id=75bd317604984572bfbf6d321296a82e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:17.478736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:17.509634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1979/3909] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:17 2022] PUT /identity/v3/projects/053f5331bae0479bae162a34e7087dac/users/75bd317604984572bfbf6d321296a82e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:17.521022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:17.521737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:17.522046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:17.586754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] MFA Rules not processed for user `75bd317604984572bfbf6d321296a82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:17.588324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:17.813510 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1931/3910] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:17.946973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:17.949520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:18.084707 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:18.393062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd260-ca73-4dfc-a27a-3ed049cdf26d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:18.415922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:18.418353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:18.419786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:18.421782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:18.448885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:18.455200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:18.481354 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1980/3911] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:18.569024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:18.575959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:18.782285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738166f8-71ac-49a3-9fb4-17857db76d71 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:18.798700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:18.801051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:18.801598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:18.802048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:18.808378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:18.840871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:18.842637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:18.851224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:18.855826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:18.889951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d07d7-8391-4de2-9123-04602319b4ff service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:18.919456 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1932/3912] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:18.920106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:18.921320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:18.922254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:18.922829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:18.980820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:18.986138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34561927-b05e-48e5-a3ae-59832bca8eda service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:19.024278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1981/3913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:19.982515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:20.012243 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:20.185841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9f5c-611c-441a-8053-d2e0ad079f98 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:20.198630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:20.199596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:20.199875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:20.200150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] PATH_INFO: `/v3/users/0e63621b727e45d5b047755564721b89` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:20.205387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e63621b727e45d5b047755564721b89)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:20.212626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:20.366764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e63621b727e45d5b047755564721b89'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:20.403312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e63621b727e45d5b047755564721b89'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:20.441154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e63621b727e45d5b047755564721b89'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:20.476137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e63621b727e45d5b047755564721b89'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:20.477584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e63621b727e45d5b047755564721b89'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:20.514331 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1933/3914] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:19 2022] DELETE /identity/v3/users/0e63621b727e45d5b047755564721b89 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:20.515124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:20.515566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:20.515995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:20.550787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:20.552293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:20.916690 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1982/3915] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:20.924030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:20.925982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:21.150771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f0bd-82a3-4b71-95cc-76eb0013ecb7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:21.162848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:21.163553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:21.163841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:21.164177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:21.181274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:21.183294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:21.213012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1934/3916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:22.027317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:22.030590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:22.308559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00a49-3c38-4676-9621-d733b3d83526 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:22.325815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:22.327319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:22.327931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:22.328716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:22.334242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:22.505339 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:22.570967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:22.576660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:22.621732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1983/3917] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:23.047840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.050757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.073930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17efda-b5ef-4651-800d-2e2bc2a7b186 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.086468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.089550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.090372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.090841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] PATH_INFO: `/v3/projects/529575c8bb4f4fe69ed343648a318c18` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.095194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529575c8bb4f4fe69ed343648a318c18)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.099846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.194585 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:23.261210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529575c8bb4f4fe69ed343648a318c18', 'request_id': 'req-cce9962b-56da-4b35-9619-1d88ff1f0662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.301887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529575c8bb4f4fe69ed343648a318c18', 'request_id': 'req-cce9962b-56da-4b35-9619-1d88ff1f0662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.332433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529575c8bb4f4fe69ed343648a318c18', 'request_id': 'req-cce9962b-56da-4b35-9619-1d88ff1f0662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.361369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] The token cache is being invalidate because project 529575c8bb4f4fe69ed343648a318c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:23.367110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.368071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cce9962b-56da-4b35-9619-1d88ff1f0662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.378848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1935/3918] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:23 2022] DELETE /identity/v3/projects/529575c8bb4f4fe69ed343648a318c18 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:23.384334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.401038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4180-b4d1-428f-aa80-792fa50c9ab8 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.568051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.569293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.569760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.569970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] PATH_INFO: `/v3/users/75bd317604984572bfbf6d321296a82e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.572316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bd317604984572bfbf6d321296a82e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.574875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.710910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bd317604984572bfbf6d321296a82e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.712233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bd317604984572bfbf6d321296a82e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.728236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bd317604984572bfbf6d321296a82e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.739384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bd317604984572bfbf6d321296a82e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.760724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-818b9fdf-4841-497a-949f-77063c926e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bd317604984572bfbf6d321296a82e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.774362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1984/3919] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:23 2022] DELETE /identity/v3/users/75bd317604984572bfbf6d321296a82e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:24.086244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:24.086729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:24.087844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:24.139353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] MFA Rules not processed for user `5a34b91b8c3d4fe3a42e0ceffa767726`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:24.141511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:24.331646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1936/3920] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:24.342758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:24.343547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:24.343936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:24.397572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] MFA Rules not processed for user `5a34b91b8c3d4fe3a42e0ceffa767726`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:24.402315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:24.441103 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1985/3921] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:24.766058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:24.767518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:24.979015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430ddd-9076-44bb-b159-d8db94e6e055 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:24.993743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:24.994797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:24.995711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:24.996149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:25.015090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:25.018471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8c3b-0995-4bfd-b2f7-3b08e10328cc service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:25.049415 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1937/3922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:25.715263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:25.716882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:25.892579 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:25.932393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb010c6-f062-4cfc-93a2-228173878d9d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:25.949202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:25.950589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:25.951081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:25.951552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] PATH_INFO: `/v3/projects/053f5331bae0479bae162a34e7087dac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:25.955105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=053f5331bae0479bae162a34e7087dac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:25.960863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.069642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053f5331bae0479bae162a34e7087dac', 'request_id': 'req-95519a73-d4cf-45a0-a3c0-d149818571bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:26.078587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053f5331bae0479bae162a34e7087dac', 'request_id': 'req-95519a73-d4cf-45a0-a3c0-d149818571bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:26.095363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053f5331bae0479bae162a34e7087dac', 'request_id': 'req-95519a73-d4cf-45a0-a3c0-d149818571bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:26.121488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] The token cache is being invalidate because project 053f5331bae0479bae162a34e7087dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:26.122061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:26.122971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-95519a73-d4cf-45a0-a3c0-d149818571bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:26.125069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1986/3923] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:25 2022] DELETE /identity/v3/projects/053f5331bae0479bae162a34e7087dac => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:26.130110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.131213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.131658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.179096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:26.180622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:26.218021 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:26.291888 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1938/3924] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:26.301567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.302106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.302553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.345701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:26.347488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:26.368631 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1987/3925] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:26.373293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.384394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e278d4-c8b9-4458-bdf8-85a3ffdcc5d9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.389590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.390334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.390612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.390882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.391788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:26.392089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:26.395555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.413372 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1939/3926] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:26.414606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.426961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4ed6e-5203-4b45-9636-c9801f106745 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.435304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.436524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.436990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.437421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.438356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:26.441244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.491465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1988/3927] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:26 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:26.492290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.513335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadc751-c296-46e8-970a-e126d9dec472 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.672406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.673105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.673820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.674113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.678998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:26.685240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.731922 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1940/3928] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:26 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:26.735932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.763089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a587-09eb-47f1-aa0c-ad65b3318380 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.783351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.784142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.784459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.790571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.792589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:26.798626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.823931 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1989/3929] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:26.828591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.861016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d12e8-fe70-4457-be4a-fd697bdced5a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.873568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.875990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.876280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.877736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:26.880761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:26.887084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d27982-8de7-40e4-8a59-e7bd35e384d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:26.921584 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1941/3930] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:26.924347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:26.948358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272edc0-4cbf-4200-a310-f8c711fb2d20 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:26.959567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:26.960513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:26.964212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:26.964807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] PATH_INFO: `/v3/projects/c60507837fec4e06bd0551093bceb959/users/d82fd738d5bb4d5e838f67b0b76b3b56/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:27.008309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60507837fec4e06bd0551093bceb959, user_id=d82fd738d5bb4d5e838f67b0b76b3b56, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:27.017430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:27.055159 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1990/3931] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:26 2022] PUT /identity/v3/projects/c60507837fec4e06bd0551093bceb959/users/d82fd738d5bb4d5e838f67b0b76b3b56/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:27.061107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e60c-5bdc-4861-8311-36c8d0392990 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:27.061467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e60c-5bdc-4861-8311-36c8d0392990 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:27.062248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e60c-5bdc-4861-8311-36c8d0392990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:27.118161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b899e60c-5bdc-4861-8311-36c8d0392990 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:27.119663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b899e60c-5bdc-4861-8311-36c8d0392990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:27.252993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1942/3932] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:27.298604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:27.300720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:27.463089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4aa8-bd51-476c-87d2-1aeafe219858 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:27.469012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:27.469698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:27.469988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:27.470266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:27.493961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:27.495452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e376b64-ef75-47ea-aa7e-a3cdc077cb82 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:27.520954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1991/3933] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:29.174931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:29.176906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:29.177426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:29.283580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] MFA Rules not processed for user `1dda9fc0670f4e11ad4d8089bf1687c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:29.285556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:29.406753 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:29.557473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1943/3934] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:29.571111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aa69-31f3-4a26-bed5-c1a9d2b971f9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:29.571690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aa69-31f3-4a26-bed5-c1a9d2b971f9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:29.571800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5aa69-31f3-4a26-bed5-c1a9d2b971f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:29.613905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16a5aa69-31f3-4a26-bed5-c1a9d2b971f9 None None] MFA Rules not processed for user `1dda9fc0670f4e11ad4d8089bf1687c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:29.623214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16a5aa69-31f3-4a26-bed5-c1a9d2b971f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:29.663291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1992/3935] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:30.441583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:30.443715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:30.629279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293587-474e-4cbc-933a-534158f8d25a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:30.640835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:30.645155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:30.645838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:30.646314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:30.666163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:30.668369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:30.702645 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1944/3936] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:39.590218 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:40.680538 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=49 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:52.360615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:52.361791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:52.361916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:52.430018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] MFA Rules not processed for user `d82fd738d5bb4d5e838f67b0b76b3b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:52.431318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:52.699483 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1993/3937] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:52.704230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:52.734127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bdeae-84ad-4a74-b65d-6299c77ab480 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:52.760654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:52.761338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:52.766001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:52.770009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:52.770975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:52.773404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:52.855431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1945/3938] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:52 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:52.859665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:52.895739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3153ab-dd28-4516-a034-6e27ea305c08 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:53.082423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:53.082691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:53.082852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:53.083135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:53.083859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:53.085886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:53.190214 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1994/3939] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:52 2022] POST /identity/v3/users => generated 297 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:53.193529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:53.210093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78390f-b6fd-43a5-85b8-7a166bf8c78f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:53.224319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:53.225739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:53.226302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:53.226777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:53.227640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:53.229489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:53.262722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1946/3940] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:53.264046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:53.291533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca590-9818-44ee-97b4-ff89baa4ec89 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:53.309884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:53.311928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:53.312404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:53.312849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] PATH_INFO: `/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4/users/13ae58c891f04b258dbd2709ce7a32b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:53.339714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61c6d99deff4ac5a3d519d720cfb9f4, user_id=13ae58c891f04b258dbd2709ce7a32b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:53.349954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:53.379505 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1995/3941] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:53 2022] PUT /identity/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4/users/13ae58c891f04b258dbd2709ce7a32b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:53.380733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:53.393640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb522c8-ea4a-44fc-b910-f03e18bd4426 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:53.587639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:53.588662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:53.590051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:53.591165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:53.593459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:53.607095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:53.650710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1947/3942] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:53.654972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:53.709962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552027b-2f97-4ffb-bda8-397b783c8721 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:53.717750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:53.719184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:53.719654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:53.719938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] PATH_INFO: `/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4/users/13ae58c891f04b258dbd2709ce7a32b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:53.722571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61c6d99deff4ac5a3d519d720cfb9f4, user_id=13ae58c891f04b258dbd2709ce7a32b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:53.725762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d00e2-4e7d-4417-8544-cbbb9c34ae41 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:53.750026 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1996/3943] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:53 2022] PUT /identity/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4/users/13ae58c891f04b258dbd2709ce7a32b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:56.159550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:56.161565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:56.198751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84010ea-6405-411e-a763-d7c86027bbed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:56.414459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:56.415772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:56.416247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:56.416714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] PATH_INFO: `/v3/users/c6b7a7af337643fea35e824e5ea657fc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:56.418207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b7a7af337643fea35e824e5ea657fc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:56.420947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:56.531325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b7a7af337643fea35e824e5ea657fc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:56.548150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b7a7af337643fea35e824e5ea657fc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:56.566474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b7a7af337643fea35e824e5ea657fc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:56.569755 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:56.618872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b7a7af337643fea35e824e5ea657fc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:56.619867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b7a7af337643fea35e824e5ea657fc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:56.640741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1948/3944] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:56 2022] DELETE /identity/v3/users/c6b7a7af337643fea35e824e5ea657fc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:56.645514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:56.646073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:56.646270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:56.696911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:56.698221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:56.796295 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:56.862683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1997/3945] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:56.908842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:56.910816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:57.061190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fa1c9-f51f-40a0-8ce5-0357435da7e2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:57.070024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:57.070695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:57.070976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:57.071245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:57.105853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:57.107911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:57.150107 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1949/3946] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:58.796575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:58.799203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:58.841344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fdedb-c520-48f9-9504-85a4d1418b42 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:58.856461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:58.858254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:58.858822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:58.859476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] PATH_INFO: `/v3/projects/4283dadd9e2b454f883ba715f9989632` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:58.861920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4283dadd9e2b454f883ba715f9989632)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:58.865997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:58.968066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4283dadd9e2b454f883ba715f9989632', 'request_id': 'req-812f0efb-3228-45b4-84d5-a36a4333dca8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:58.983081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4283dadd9e2b454f883ba715f9989632', 'request_id': 'req-812f0efb-3228-45b4-84d5-a36a4333dca8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:58.998113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4283dadd9e2b454f883ba715f9989632', 'request_id': 'req-812f0efb-3228-45b4-84d5-a36a4333dca8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.039348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] The token cache is being invalidate because project 4283dadd9e2b454f883ba715f9989632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:59.039651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.042297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-812f0efb-3228-45b4-84d5-a36a4333dca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.054159 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1998/3947] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:58 2022] DELETE /identity/v3/projects/4283dadd9e2b454f883ba715f9989632 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:59.057908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:59.075005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c1a94-8d3e-4424-8bdc-34c76c669aeb service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:59.102903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.103195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.103471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.176581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] MFA Rules not processed for user `5a34b91b8c3d4fe3a42e0ceffa767726`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:59.184526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:59.303838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:59.309232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.309697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.310928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] PATH_INFO: `/v3/users/48b6a5c0ac9d44a89f205c0c6e7326a8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.318152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b6a5c0ac9d44a89f205c0c6e7326a8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:59.320274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:59.374410 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 1999/3948] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:21:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:59.476071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b6a5c0ac9d44a89f205c0c6e7326a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.507505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b6a5c0ac9d44a89f205c0c6e7326a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.526478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b6a5c0ac9d44a89f205c0c6e7326a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.555046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b6a5c0ac9d44a89f205c0c6e7326a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.555942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1715874-5f08-46fb-867f-e97f3957a212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b6a5c0ac9d44a89f205c0c6e7326a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.568486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1950/3949] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:59 2022] DELETE /identity/v3/users/48b6a5c0ac9d44a89f205c0c6e7326a8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:00.472984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:00.474421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:00.498915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d9f3-4ebd-4959-a9a6-740fc1748914 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:00.643246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:00.644146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:00.644428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:00.644704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] PATH_INFO: `/v3/projects/41a3b7ce915a482e938da5dc42a5048c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:00.646587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a3b7ce915a482e938da5dc42a5048c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:00.655445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:00.678463 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:00.753550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a3b7ce915a482e938da5dc42a5048c', 'request_id': 'req-e8b050c6-14bd-4065-9b02-90cde3d298a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:00.766547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a3b7ce915a482e938da5dc42a5048c', 'request_id': 'req-e8b050c6-14bd-4065-9b02-90cde3d298a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:00.787564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a3b7ce915a482e938da5dc42a5048c', 'request_id': 'req-e8b050c6-14bd-4065-9b02-90cde3d298a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:00.819045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] The token cache is being invalidate because project 41a3b7ce915a482e938da5dc42a5048c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:22:00.819762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:00.824367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8b050c6-14bd-4065-9b02-90cde3d298a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:00.826874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2000/3950] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:22:00 2022] DELETE /identity/v3/projects/41a3b7ce915a482e938da5dc42a5048c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:00.832288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:00.832830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:00.832924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:00.842926 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:00.897454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:00.898982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:01.106382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1951/3951] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:01.107173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:01.107699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:01.108249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:01.213513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:01.216719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:01.241065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2001/3952] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:22:01.245209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:01.262113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8ef1-f926-4c0c-b2cd-f28bcdc54f5f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:01.277552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:01.278997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:01.279295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:01.280161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:01.283788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:01.284158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:01.291721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:01.324236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1952/3953] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:01.330470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:01.342958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bc8fd-bbff-4850-91a6-10de6b3c0440 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:01.368298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:01.369215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:01.370809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:01.378983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:01.379916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:01.408262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:01.513014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:01.519893 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2002/3954] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:01 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:01.537054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07157-e725-4e85-869d-a751525c12a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:01.747344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:01.750564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:01.752068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:01.752452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:01.755562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:01.763880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:01.846842 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1953/3955] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:22:01 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:01.849549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:01.870958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c408-38f4-460d-9a8d-3b34eaea7293 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:01.890990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:01.892147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:01.898367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:01.899012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:01.900361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:01.903645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:01.941744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2003/3956] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:22:01.946487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:01.983499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8354-6834-4b0a-8814-98996cafe16a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:02.016328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:02.020340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:02.021258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:02.022014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:02.023439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:02.029180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ad1d-cb21-4b2a-a34b-bff8529dbd44 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:02.075697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:02.088526 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1954/3957] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:22:02.099540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028eb52-eb7e-4ad7-b335-db8b295716f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:02.126649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:02.128490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:02.130552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:02.131134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] PATH_INFO: `/v3/projects/efec1f2f97c7447d9b27fa488ec9ab5f/users/cfccd721a0374307b1afc2fbe94630cb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:02.193239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efec1f2f97c7447d9b27fa488ec9ab5f, user_id=cfccd721a0374307b1afc2fbe94630cb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:02.200278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:02.237434 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2004/3958] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:02 2022] PUT /identity/v3/projects/efec1f2f97c7447d9b27fa488ec9ab5f/users/cfccd721a0374307b1afc2fbe94630cb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:02.248863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:02.249422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:02.249887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:02.332476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] MFA Rules not processed for user `cfccd721a0374307b1afc2fbe94630cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:02.334052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:02.547966 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:02.568943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:02.569626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1955/3959] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:02.741829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfdb56-5f09-43e8-8b84-64810ae88738 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:02.754200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:02.756579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:02.759619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:02.761566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:02.764286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:02.780047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:02.888049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2005/3960] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:02 2022] POST /identity/v3/projects => generated 369 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:22:02.893516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:02.951910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb946c-9f8c-47fc-bfb9-cd537576faff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:03.144952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:03.148185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.149079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.149927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:03.153698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:03.156342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:03.247351 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1956/3961] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:22:02 2022] POST /identity/v3/users => generated 291 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:03.248559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:03.273194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9238-54d9-4c31-bdc3-b94420ad8e52 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:03.294523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:03.310223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.314675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.315861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:03.316731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:03.321026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:03.354563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2006/3962] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:22:03.356345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:03.368423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332e33-d134-4a6b-b4de-c116aafa944d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:03.383229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:03.384425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.384936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.385383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] PATH_INFO: `/v3/projects/884a52bb1a694f639726d4e08bf2a32c/users/a5bc8ce7c1f24e69adf6cf820b938b33/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:03.418194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884a52bb1a694f639726d4e08bf2a32c, user_id=a5bc8ce7c1f24e69adf6cf820b938b33, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:03.421113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:03.460110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1957/3963] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:03 2022] PUT /identity/v3/projects/884a52bb1a694f639726d4e08bf2a32c/users/a5bc8ce7c1f24e69adf6cf820b938b33/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:03.461179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:03.482769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddd90e-67c2-4786-9ee4-f005b133eca2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:03.518553 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:03.743861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:03.745443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.745952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.746423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:03.747594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:03.752326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196d21a-e74c-440b-92c9-cd3b93d6d126 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:03.819038 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2007/3964] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:22:03.823074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:03.845748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fed0-e6e0-4725-a934-47724b69f804 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:03.880115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:03.881042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.881326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.881604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] PATH_INFO: `/v3/projects/884a52bb1a694f639726d4e08bf2a32c/users/a5bc8ce7c1f24e69adf6cf820b938b33/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:03.887645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884a52bb1a694f639726d4e08bf2a32c, user_id=a5bc8ce7c1f24e69adf6cf820b938b33, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:03.899854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:03.960445 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1958/3965] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:03 2022] PUT /identity/v3/projects/884a52bb1a694f639726d4e08bf2a32c/users/a5bc8ce7c1f24e69adf6cf820b938b33/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:03.963374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601f4f-3ba5-4837-9698-009688e3454e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:03.963920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601f4f-3ba5-4837-9698-009688e3454e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:03.964462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601f4f-3ba5-4837-9698-009688e3454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:04.069932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-00601f4f-3ba5-4837-9698-009688e3454e None None] MFA Rules not processed for user `a5bc8ce7c1f24e69adf6cf820b938b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:04.073167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-00601f4f-3ba5-4837-9698-009688e3454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:04.340393 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2008/3966] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:04.697915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:04.700049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:04.789217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01a52-e30f-432d-a563-70285b8f6052 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:04.793334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:04.794037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:04.794325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:04.794607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:04.805417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:04.806952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7914-a9a2-491d-8fa8-15c166e1e9b3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:04.820210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1959/3967] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:06.405100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996d0c-edc5-4d95-892c-1daf27502db6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:06.405634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996d0c-edc5-4d95-892c-1daf27502db6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:06.406057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996d0c-edc5-4d95-892c-1daf27502db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:06.430087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c9996d0c-edc5-4d95-892c-1daf27502db6 None None] MFA Rules not processed for user `5553b37350644a20b64ce76ebf60b44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:06.431542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c9996d0c-edc5-4d95-892c-1daf27502db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:06.520461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2009/3968] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:06.530527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b7b-25c6-49f8-96dd-a3f67333bf6f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:06.531532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b7b-25c6-49f8-96dd-a3f67333bf6f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:06.532018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e0b7b-25c6-49f8-96dd-a3f67333bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:06.591083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dd3e0b7b-25c6-49f8-96dd-a3f67333bf6f None None] MFA Rules not processed for user `5553b37350644a20b64ce76ebf60b44b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:06.596020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd3e0b7b-25c6-49f8-96dd-a3f67333bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:06.613478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1960/3969] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:12.526600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cc613-3959-436e-8764-4568662cedaf None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:12.527115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cc613-3959-436e-8764-4568662cedaf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:12.527399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cc613-3959-436e-8764-4568662cedaf None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:12.529493 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2010/3970] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:22:12.541741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:12.542794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:12.543324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:12.654020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:12.657270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:12.770310 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:12.864849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1961/3971] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:12.890222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cc613-3959-436e-8764-4568662cedaf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:12.894827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-100cc613-3959-436e-8764-4568662cedaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:12.912712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cc613-3959-436e-8764-4568662cedaf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:12.916966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:12.918557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:12.919059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:12.920330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:12.949062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:12.954437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:12.979224 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2011/3972] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:17.065741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:17.068313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:17.147999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe565-9810-4827-a6ce-bccc3ff8d8ce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:17.153412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:17.154658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:17.155165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:17.155656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] PATH_INFO: `/v3/users/e19b156b5c8f4f30af95d21c57091ec5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:17.157253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19b156b5c8f4f30af95d21c57091ec5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:17.159952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:17.248625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19b156b5c8f4f30af95d21c57091ec5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:17.263043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19b156b5c8f4f30af95d21c57091ec5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:17.309133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19b156b5c8f4f30af95d21c57091ec5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:17.377969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19b156b5c8f4f30af95d21c57091ec5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:17.378751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e8dbff9-ba29-4739-b14c-b07af943b282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19b156b5c8f4f30af95d21c57091ec5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:17.394007 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1962/3973] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:22:17 2022] DELETE /identity/v3/users/e19b156b5c8f4f30af95d21c57091ec5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:18.706178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:18.734053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f224c-5c6e-40a3-9a12-72c6456a7271 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:18.799541 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:18.876104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:18.876837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:18.877123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:18.877402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] PATH_INFO: `/v3/projects/e19e03d9bbe8415198317f7c2c001ac3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:18.878715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19e03d9bbe8415198317f7c2c001ac3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:18.880643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:18.937312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19e03d9bbe8415198317f7c2c001ac3', 'request_id': 'req-59fc5095-0776-473b-bbd0-a8611547c9e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:18.945331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19e03d9bbe8415198317f7c2c001ac3', 'request_id': 'req-59fc5095-0776-473b-bbd0-a8611547c9e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:18.957827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19e03d9bbe8415198317f7c2c001ac3', 'request_id': 'req-59fc5095-0776-473b-bbd0-a8611547c9e0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:18.988908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] The token cache is being invalidate because project e19e03d9bbe8415198317f7c2c001ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:22:18.990003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:18.995166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59fc5095-0776-473b-bbd0-a8611547c9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:18.996752 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2012/3974] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:22:18 2022] DELETE /identity/v3/projects/e19e03d9bbe8415198317f7c2c001ac3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:22:19.003875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.004356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.004467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.036936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:19.038217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:19.127198 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:19.182775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1963/3975] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:19.191710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337831-7927-487b-83da-525d8ea78cac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.192003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337831-7927-487b-83da-525d8ea78cac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.192307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337831-7927-487b-83da-525d8ea78cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.216019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-03337831-7927-487b-83da-525d8ea78cac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:19.217337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-03337831-7927-487b-83da-525d8ea78cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:19.235861 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2013/3976] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:19.236840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.250280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9c67-7dec-4f51-ba2d-417bca75ce53 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.259647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.260589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.260985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.261388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.262282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:19.263315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.265510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.301467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337831-7927-487b-83da-525d8ea78cac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.301731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1964/3977] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:19.316104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337831-7927-487b-83da-525d8ea78cac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.325331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.326374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.327061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.327537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.328521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.334492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.404237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.418270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2014/3978] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:19.428469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931cce6-6001-46ca-9a8d-5dae32fe97fa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.524051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.525322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.526070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.526567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.527503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.530097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.578796 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1965/3979] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:19.583235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.595582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf509-fd5d-4573-8e05-6e46ae8d38c1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.602824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.603507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.603787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.604119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.605179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.607486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.622445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2015/3980] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:22:19.627305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.639882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1596570-7589-4e83-a27d-ffd4cb575e7c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.645438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.647395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.647849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.649096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.650325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.652836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352b5a-4514-496b-bc17-6f0e1301ba9d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.672495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:19.678894 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1966/3981] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:22:19.684919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1da9a-61d4-4769-8d7f-0e4a3bf31e86 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:19.691768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:19.693232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.693855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.694854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] PATH_INFO: `/v3/projects/b20fd219605f4e0c8e04a9289764a40d/users/785eebaf851240da958ed7c13d121121/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.716418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20fd219605f4e0c8e04a9289764a40d, user_id=785eebaf851240da958ed7c13d121121, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:19.721649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f07e8-cf39-4037-b858-dccd412921f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:19.776322 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2016/3982] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:19 2022] PUT /identity/v3/projects/b20fd219605f4e0c8e04a9289764a40d/users/785eebaf851240da958ed7c13d121121/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:19.783332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.784819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.785355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.815094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:19.815636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:19.817431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:19.839377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:19.841714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:19.936541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] MFA Rules not processed for user `13ae58c891f04b258dbd2709ce7a32b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:19.938152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:19.989786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1967/3983] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:20.053662 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:20.071176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:20.073184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:20.133330 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2017/3984] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:20.242451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912178f2-96c0-42b3-a9c4-b1f073fa6db4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:20.248281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:20.248960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:20.249246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:20.249523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:20.269237 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:20.277512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:20.279040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:20.318396 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1968/3985] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:20.522810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:20.524272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:20.717885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95a00-6520-4a27-9505-5365bd04a37b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:20.732154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:20.734053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:20.735906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:20.736191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:20.739988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:20.889493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:20.891076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:20.913938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2018/3986] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:30.286741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:30.288323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:30.421593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:30.424657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:30.449284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64578-d4c1-4857-ab12-1da4f869b527 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:30.480608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:30.481272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:30.481561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:30.486314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0df13-2b7c-4860-a8ce-28ec1c4400e4 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:30.487926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:30.491193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:30.505715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bc8ce7c1f24e69adf6cf820b938b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884a52bb1a694f639726d4e08bf2a32c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:30.506426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:30.506714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:30.507004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:30.518105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:30.518545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:30.520558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:30.546709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:30.548318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:30.568967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1969/3987] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:30.572119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:30.581426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2019/3988] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:22:30.601815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bc8fd-fb38-4d99-a9c2-8218d23ca961 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:30.617533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bc8ce7c1f24e69adf6cf820b938b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884a52bb1a694f639726d4e08bf2a32c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:30.618540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:30.618996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:30.619466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:30.620358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:30.622531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564c34-2b95-40cf-8e4b-939efca362c5 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:30.687296 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1970/3989] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:30 2022] POST /identity/v3/projects => generated 347 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:30.691997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:30.713994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976aff-bee9-4db9-8f27-82fcde9f3b9e service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:30.857416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bc8ce7c1f24e69adf6cf820b938b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884a52bb1a694f639726d4e08bf2a32c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:30.858137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:30.858428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:30.858710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:30.859474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:30.859848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:30.861652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:30.864195 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:30.883363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2020/3990] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:31.047738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:31.048360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:31.048816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:31.098864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] MFA Rules not processed for user `d82fd738d5bb4d5e838f67b0b76b3b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:31.100348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:31.241696 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1971/3991] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:31.872857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:31.894096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04094792-c288-4b97-9328-5f4a88c5279e tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:31.921224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bc8ce7c1f24e69adf6cf820b938b33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884a52bb1a694f639726d4e08bf2a32c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:31.922331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:31.922888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:31.923286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] PATH_INFO: `/v3/projects/35d04f0266bf484986909d4d57f62afb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:31.926373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35d04f0266bf484986909d4d57f62afb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:31.929106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:32.077932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d04f0266bf484986909d4d57f62afb', 'request_id': 'req-b15546ee-1049-48c1-a109-c5b1ed4b3605'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:32.098117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d04f0266bf484986909d4d57f62afb', 'request_id': 'req-b15546ee-1049-48c1-a109-c5b1ed4b3605'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:32.115016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d04f0266bf484986909d4d57f62afb', 'request_id': 'req-b15546ee-1049-48c1-a109-c5b1ed4b3605'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:32.145756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] The token cache is being invalidate because project 35d04f0266bf484986909d4d57f62afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:22:32.146549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:32.147512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:32.150228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2021/3992] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:22:31 2022] DELETE /identity/v3/projects/35d04f0266bf484986909d4d57f62afb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:32.203116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:32.369106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dd949-ffd4-49db-8780-d1d2fd25703e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:32.442401 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:32.501198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:32.501709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:32.502004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:32.502280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:32.507001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:32.609728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:32.612697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:32.625169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1972/3993] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:33.260967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:33.263052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:33.343196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15546ee-1049-48c1-a109-c5b1ed4b3605 tempest-RoutersAdminTest-1502356053 tempest-RoutersAdminTest-1502356053-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:33.349279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:33.349977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:33.350260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:33.350535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] PATH_INFO: `/v3/users/59d8758357384418aeca2b24f1e8bd12` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:33.352066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d8758357384418aeca2b24f1e8bd12)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:33.354585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:33.420854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d8758357384418aeca2b24f1e8bd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:33.421624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d8758357384418aeca2b24f1e8bd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:33.432234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d8758357384418aeca2b24f1e8bd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:33.443721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d8758357384418aeca2b24f1e8bd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:33.460440 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:33.462712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5ca2c570-201a-471f-afa9-299508baa534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d8758357384418aeca2b24f1e8bd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:33.476068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2022/3994] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:22:33 2022] DELETE /identity/v3/users/59d8758357384418aeca2b24f1e8bd12 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:22:34.001540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.019991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae17c0-8f82-4737-aec9-f67f81bf139b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.136050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.137246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.137815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.138515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] PATH_INFO: `/v3/projects/a0fe7868ac524f4498b1dadc33efae7b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.140679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fe7868ac524f4498b1dadc33efae7b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.144407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.256558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fe7868ac524f4498b1dadc33efae7b', 'request_id': 'req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:34.265406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fe7868ac524f4498b1dadc33efae7b', 'request_id': 'req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:34.274234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fe7868ac524f4498b1dadc33efae7b', 'request_id': 'req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:34.310833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] The token cache is being invalidate because project a0fe7868ac524f4498b1dadc33efae7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:22:34.311310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:34.312299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb66dae8-98c9-4e45-83b2-b92ea8fc21b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:34.316125 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1973/3995] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:22:33 2022] DELETE /identity/v3/projects/a0fe7868ac524f4498b1dadc33efae7b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:34.320995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.321537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.321537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.354666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:34.356184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:34.483935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2023/3996] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:34.485518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.485940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.486332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.511041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:34.512532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:34.526477 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1974/3997] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:22:34.527945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.555811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a00d8b-7d25-4199-badb-e46e561eb21e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.556429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.557184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.557517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.557892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.558704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:34.559077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.561123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.585221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2024/3998] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:34.591102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.607308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534371a-dc86-492a-ba07-33a1fca36f54 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.617509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.618568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.622135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.622667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.623575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.626492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.630455 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:34.661598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1975/3999] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:34 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:34.666374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.678884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6934-430c-478b-8d01-91c0de87b0cd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.757600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.758492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.758779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.759050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.759756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.761876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.787362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2025/4000] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:22:34 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:34.791877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.809241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcd82e-eaaa-42f0-a462-02676923d877 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.819039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.820084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.820470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.820850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.821951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.824680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.841454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1976/4001] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:22:34.842875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.858210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27297aa-3f61-4187-837a-5c1d2097f2fa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.865209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.866463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.866851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.867228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.868224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.870340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e0a80-f6fe-4add-b77c-fdad6c0ddde5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.885121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2026/4002] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:22:34.889597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:34.906998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563167c7-43f1-479c-ad6e-0afcc84d6e41 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:34.915847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:34.917013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.917455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.917922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] PATH_INFO: `/v3/projects/a463acfa253e4eadb23ff67c2e1058dc/users/71b31a7e59f94d6ea7749c7ae004fea2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:34.941912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463acfa253e4eadb23ff67c2e1058dc, user_id=71b31a7e59f94d6ea7749c7ae004fea2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:34.945416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:34.963989 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1977/4003] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:34 2022] PUT /identity/v3/projects/a463acfa253e4eadb23ff67c2e1058dc/users/71b31a7e59f94d6ea7749c7ae004fea2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:34.971582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef9b2-5f67-4b5c-b91e-935faa78bb0e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:34.972263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef9b2-5f67-4b5c-b91e-935faa78bb0e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:34.973137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef9b2-5f67-4b5c-b91e-935faa78bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:35.018995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad8ef9b2-5f67-4b5c-b91e-935faa78bb0e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:35.020369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad8ef9b2-5f67-4b5c-b91e-935faa78bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:35.154903 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2027/4004] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:35.207236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:35.210648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:35.315910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfda13-2d02-4703-a382-3a8731833ff8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:35.320407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:35.321195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:35.321579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:35.321987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:35.333503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:35.335288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea629d-e1c7-4f83-8b9d-9d1dc416c0c3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:35.354305 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1978/4005] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:35.558461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e81c-80ba-4868-991d-8f96f0b0d08d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:35.558908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e81c-80ba-4868-991d-8f96f0b0d08d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:35.559018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e81c-80ba-4868-991d-8f96f0b0d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:35.568369 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:35.588403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d927e81c-80ba-4868-991d-8f96f0b0d08d None None] MFA Rules not processed for user `1dda9fc0670f4e11ad4d8089bf1687c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:35.590330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d927e81c-80ba-4868-991d-8f96f0b0d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:35.711693 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2028/4006] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:44.683131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:44.683646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:44.683800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:44.776584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:44.779740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:44.901432 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1979/4007] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:44.910867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:44.911352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:44.911897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:44.950466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:44.952215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:44.972989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2029/4008] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:44.986281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:44.987829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:45.199023 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:45.353307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7778-f944-4bb3-a5c9-5a25b9936e30 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:45.415403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:45.416278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:45.416571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:45.418314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:45.451722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:45.454987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:45.473213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1980/4009] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:54.937998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=27 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:55.466813 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=15 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:58.451252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:58.454539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:58.478116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1d5c-6280-4452-9a98-458ea0d7ef51 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:58.483655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:58.485973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:58.486258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:58.486541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] PATH_INFO: `/v3/users/5a34b91b8c3d4fe3a42e0ceffa767726` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:58.487830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a34b91b8c3d4fe3a42e0ceffa767726)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:58.489857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:58.541482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a34b91b8c3d4fe3a42e0ceffa767726'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.542680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a34b91b8c3d4fe3a42e0ceffa767726'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.550970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a34b91b8c3d4fe3a42e0ceffa767726'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.560554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a34b91b8c3d4fe3a42e0ceffa767726'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.573831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37a472f7-4c16-4282-a9cd-03690d56708a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a34b91b8c3d4fe3a42e0ceffa767726'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.581394 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2030/4010] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:22:58 2022] DELETE /identity/v3/users/5a34b91b8c3d4fe3a42e0ceffa767726 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:58.769822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:58.783010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261a5e3-27ec-4460-ab89-383fce788dc2 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:58.856030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:58.856884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:58.857158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:58.857432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] PATH_INFO: `/v3/projects/dfd38af4d6e2417b9b73b03ee795328f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:58.858653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd38af4d6e2417b9b73b03ee795328f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:58.860802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:58.910892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd38af4d6e2417b9b73b03ee795328f', 'request_id': 'req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.918649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd38af4d6e2417b9b73b03ee795328f', 'request_id': 'req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.933429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd38af4d6e2417b9b73b03ee795328f', 'request_id': 'req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.959191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] The token cache is being invalidate because project dfd38af4d6e2417b9b73b03ee795328f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:22:58.959535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.960628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb9d00af-14dc-463d-9fb6-27aa2964e8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:22:58.966529 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1981/4011] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:22:58 2022] DELETE /identity/v3/projects/dfd38af4d6e2417b9b73b03ee795328f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:58.967677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:58.968040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:58.969228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.002652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:59.003891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:59.067551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2031/4012] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:22:59.075931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.076218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.076499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.095664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:59.096807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:59.104926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1982/4013] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:59.110270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.131805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab3e5d-634a-4daa-b89c-b7a5326a6885 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.137978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.138680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.138960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.139246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.140774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:22:59.141095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.143306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.159163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2032/4014] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:22:59.163903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.174498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b6754-1080-40aa-8c6f-4c794157f49a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.179560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.180452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.180804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.181147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.181960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.183958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.214532 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1983/4015] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:22:59 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:59.216006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.227421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3647d-4230-45f7-bdac-1bed7e2f191b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.288733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.289424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.289732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.290012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.290724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.292869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.299615 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:59.320338 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2033/4016] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:22:59 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:22:59.324380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.336303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a284e-f25b-4aec-9914-a6fcd94449d5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.341780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.342448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.342727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.343000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.343764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.345539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.357004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1984/4017] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:22:59.361309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.371516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c994bd-5f85-4d81-b40a-b620bdcc9a9b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.377329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.378340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.378687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.379026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.379821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.381479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1d1aa-5b28-4f39-a58e-a8c16add956f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.396445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2034/4018] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:22:59.397966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.408295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecac8f-340a-4c26-ba83-0e6a31c3970c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.413194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.414127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.414407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.414681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] PATH_INFO: `/v3/projects/04e896d3688c4c72bcf461445bada1f8/users/266a0979256344c497b6979cfdacc6ad/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.430346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e896d3688c4c72bcf461445bada1f8, user_id=266a0979256344c497b6979cfdacc6ad, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.433035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.447932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1985/4019] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:22:59 2022] PUT /identity/v3/projects/04e896d3688c4c72bcf461445bada1f8/users/266a0979256344c497b6979cfdacc6ad/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:59.454358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c738a3-40d9-452f-ba26-cba23b8abcaf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.454840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c738a3-40d9-452f-ba26-cba23b8abcaf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.455074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c738a3-40d9-452f-ba26-cba23b8abcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.475138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-25c738a3-40d9-452f-ba26-cba23b8abcaf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:59.476387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-25c738a3-40d9-452f-ba26-cba23b8abcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:59.544809 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2035/4020] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:22:59.555008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:59.556846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:59.597854 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:59.650834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575613a-3acb-483e-a2b2-4a03ee9e058a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:59.655115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:59.656995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:59.657461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:59.657884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:59.669517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:59.671196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:59.683883 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1986/4021] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:01.130873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae6d5-aa48-44c2-9f8e-faddc7a06a6b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:01.132139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae6d5-aa48-44c2-9f8e-faddc7a06a6b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:01.132436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae6d5-aa48-44c2-9f8e-faddc7a06a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:01.177842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-917ae6d5-aa48-44c2-9f8e-faddc7a06a6b None None] MFA Rules not processed for user `71b31a7e59f94d6ea7749c7ae004fea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:01.179449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-917ae6d5-aa48-44c2-9f8e-faddc7a06a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:01.370856 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2036/4022] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:01.941118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:01.942751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:02.065530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f4e90-0f96-40f0-9d68-b2214da68fed service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:02.081233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:02.082083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:02.082223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:02.082490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:02.101862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:02.103479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:02.115355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1987/4023] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:05.721456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b32b17-2a12-4cdc-8173-488ce353b89f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:05.722063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b32b17-2a12-4cdc-8173-488ce353b89f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:05.722063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b32b17-2a12-4cdc-8173-488ce353b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:05.755241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-68b32b17-2a12-4cdc-8173-488ce353b89f None None] MFA Rules not processed for user `71b31a7e59f94d6ea7749c7ae004fea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:05.756501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-68b32b17-2a12-4cdc-8173-488ce353b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:05.779594 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2037/4024] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:08.645645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:08.654754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:08.705392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d5ca-f930-4b20-adde-63e9cca7ee64 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:08.716179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:08.717073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:08.717356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:08.717840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] PATH_INFO: `/v3/users/735a3f7d7e454f14a7a4ed229affd75b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:08.730954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735a3f7d7e454f14a7a4ed229affd75b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:08.732871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:08.916063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735a3f7d7e454f14a7a4ed229affd75b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:08.927360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735a3f7d7e454f14a7a4ed229affd75b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:08.958204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735a3f7d7e454f14a7a4ed229affd75b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:09.007020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735a3f7d7e454f14a7a4ed229affd75b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:09.008242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735a3f7d7e454f14a7a4ed229affd75b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:09.027298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1988/4025] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:08 2022] DELETE /identity/v3/users/735a3f7d7e454f14a7a4ed229affd75b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:10.015392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51369-8078-4876-b994-fdb825749d4b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:10.015951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51369-8078-4876-b994-fdb825749d4b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:10.016080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51369-8078-4876-b994-fdb825749d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:10.041959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-afa51369-8078-4876-b994-fdb825749d4b None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:10.043703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-afa51369-8078-4876-b994-fdb825749d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:10.166079 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2038/4026] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:10.474324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:10.475831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:10.576610 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:10.694319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122266-0ab4-457e-b4a9-b3d74495f32e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:10.694946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122266-0ab4-457e-b4a9-b3d74495f32e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:10.695441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122266-0ab4-457e-b4a9-b3d74495f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:10.698906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e7ee-5af4-43f4-a08e-ff37c2a23588 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:10.714744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:10.716683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:10.717179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:10.717629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] PATH_INFO: `/v3/projects/e6caac543f0e47e5908eb146739cddca` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:10.721236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6caac543f0e47e5908eb146739cddca)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:10.726106 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:10.730929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:10.770604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42122266-0ab4-457e-b4a9-b3d74495f32e None None] MFA Rules not processed for user `266a0979256344c497b6979cfdacc6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:10.772801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42122266-0ab4-457e-b4a9-b3d74495f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:10.866160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6caac543f0e47e5908eb146739cddca', 'request_id': 'req-c3ebf0a1-3f47-4758-a955-5858be1937e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:10.876984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6caac543f0e47e5908eb146739cddca', 'request_id': 'req-c3ebf0a1-3f47-4758-a955-5858be1937e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:10.906727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6caac543f0e47e5908eb146739cddca', 'request_id': 'req-c3ebf0a1-3f47-4758-a955-5858be1937e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:10.938436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] The token cache is being invalidate because project e6caac543f0e47e5908eb146739cddca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:10.938739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:10.940385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:10.946809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1989/4027] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:10 2022] DELETE /identity/v3/projects/e6caac543f0e47e5908eb146739cddca => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:10.947795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:10.954291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:11.028614 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2039/4028] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:11.041936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:11.042263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:11.042523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:11.082284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] MFA Rules not processed for user `266a0979256344c497b6979cfdacc6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:11.085750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:11.146863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf0a1-3f47-4758-a955-5858be1937e3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:11.153800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:11.154877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:11.155157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:11.156384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] PATH_INFO: `/v3/users/db929a5c238a4cea9161fae69f637d2c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:11.158446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db929a5c238a4cea9161fae69f637d2c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:11.162288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:11.175066 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2040/4029] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:11.240693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db929a5c238a4cea9161fae69f637d2c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:11.254718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db929a5c238a4cea9161fae69f637d2c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:11.279596 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:11.282347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db929a5c238a4cea9161fae69f637d2c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:11.304940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db929a5c238a4cea9161fae69f637d2c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:11.305869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db929a5c238a4cea9161fae69f637d2c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:11.323182 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1990/4030] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:10 2022] DELETE /identity/v3/users/db929a5c238a4cea9161fae69f637d2c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:11.617997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:11.620732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:11.731575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28adc-6bb1-4d67-b17f-7a3ccfba76fa None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:11.800086 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:11.831216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:11.832594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:11.833970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:11.834362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:11.837609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:11.911871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:11.914777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:11.954027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:11.955982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd5470-6130-40ae-ac9d-5e10f4e96d10 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:11.982120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2041/4031] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:12.085972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c0a4-f60f-4101-b2be-9aadfb9e58a5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:12.101251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:12.102304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.102835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.103213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] PATH_INFO: `/v3/projects/c41a13f022a24583accedda5a698d7ae` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.104726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41a13f022a24583accedda5a698d7ae)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:12.107595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:12.210800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41a13f022a24583accedda5a698d7ae', 'request_id': 'req-f93e9003-10a3-4063-bb4d-f310dd75b6a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:12.226424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41a13f022a24583accedda5a698d7ae', 'request_id': 'req-f93e9003-10a3-4063-bb4d-f310dd75b6a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:12.261505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41a13f022a24583accedda5a698d7ae', 'request_id': 'req-f93e9003-10a3-4063-bb4d-f310dd75b6a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:12.279166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] The token cache is being invalidate because project c41a13f022a24583accedda5a698d7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:12.279779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:12.282079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f93e9003-10a3-4063-bb4d-f310dd75b6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:12.284260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1991/4032] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:11 2022] DELETE /identity/v3/projects/c41a13f022a24583accedda5a698d7ae => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:23:12.289454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.291023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.291517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.334916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:12.336074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:12.520609 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2042/4033] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:12.522501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.522753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.523032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.554795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:12.556486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:12.574142 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1992/4034] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:12.575401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:12.590654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd2c94-2e43-42f9-b3af-45eb194f6c4d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:12.599832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:12.601197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.601197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.601417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.603086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:23:12.603427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:12.605702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:12.636149 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2043/4035] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:23:12.639254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:12.663474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1b7b-8c5d-46b7-a34e-db9327f4fad5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:12.683944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:12.684905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.686305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.687806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.688866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:12.691852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:12.736263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1993/4036] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:12.740413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:12.773045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770ce5-d4e4-4757-87b7-648a8a962345 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:12.997052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:12.998724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.999034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.999525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.000637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.019045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.040538 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:13.071697 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2044/4037] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:12 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:13.075591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.096938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cbd76-3192-4434-a31a-00313188722b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.104062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.104923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.105702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.106097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.109488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.111923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.131565 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1994/4038] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:13.132769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.163905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2f60-4f5b-486a-89a1-d5e545204c55 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.169316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.169543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.169864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.170141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.177127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.178671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95ac7a-9284-400e-a74e-c89d262dc1e2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.192177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2045/4039] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:13.197665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.210931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d023a9-a082-44ef-8f24-423a1359cdba admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.216231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.217510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.218695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.219106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] PATH_INFO: `/v3/projects/74794638ee6a4b18aef9ff780d461b73/users/01e7c66073564bb0b78b2309d281d1f1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.241257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74794638ee6a4b18aef9ff780d461b73, user_id=01e7c66073564bb0b78b2309d281d1f1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.244582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.263411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1995/4040] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:13 2022] PUT /identity/v3/projects/74794638ee6a4b18aef9ff780d461b73/users/01e7c66073564bb0b78b2309d281d1f1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:13.288897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.289099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.289389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.332624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] MFA Rules not processed for user `01e7c66073564bb0b78b2309d281d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:13.334124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:13.459320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2046/4041] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:13.464251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.471247 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:13.594580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c52195-9072-4e4d-a1b1-78383b4398e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.599937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.600712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.601068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.601411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.602243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.604289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.644616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.651865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1996/4042] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:13.659679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f3709-77ab-416b-aead-e7ac941357f1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.740093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.740946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.741261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.741688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.742520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.744622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.771654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.772846 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2047/4043] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:13 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:13.785397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb83ab-5412-46ed-ade3-d752a087ff08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.791885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.792651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.793106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.793344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.794190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.795901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.809023 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1997/4044] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:23:13.813480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.823777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116bda-1185-48a1-a1ce-dfaf809df496 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.830142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.831066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.831350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.831628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] PATH_INFO: `/v3/projects/4343432978b644a286aa3cf937ba8320/users/f05b985e50f44940b352b6148fc10763/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.879099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4343432978b644a286aa3cf937ba8320, user_id=f05b985e50f44940b352b6148fc10763, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.881310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.948168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2048/4045] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:13 2022] PUT /identity/v3/projects/4343432978b644a286aa3cf937ba8320/users/f05b985e50f44940b352b6148fc10763/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:13.949521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.966832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60c02d-bc30-4465-a467-6f71cb2fbb6b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:14.207764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:14.208613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:14.211877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:14.212293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:14.213527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:14.224751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f356f18-e992-48ec-ae28-2038a69783a3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:14.259995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1998/4046] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:14.273475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:14.298461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df8e65-9271-4fc0-be73-4ecf966a8dec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:14.324580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:14.325507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:14.325816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:14.326273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] PATH_INFO: `/v3/projects/4343432978b644a286aa3cf937ba8320/users/f05b985e50f44940b352b6148fc10763/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:14.336443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4343432978b644a286aa3cf937ba8320, user_id=f05b985e50f44940b352b6148fc10763, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:14.339212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9940-002b-4034-bc85-9ffd037f5063 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:14.376918 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2049/4047] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:14 2022] PUT /identity/v3/projects/4343432978b644a286aa3cf937ba8320/users/f05b985e50f44940b352b6148fc10763/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:14.388009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:14.388302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:14.388586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:14.472297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] MFA Rules not processed for user `f05b985e50f44940b352b6148fc10763`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:14.477297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:14.650406 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:14.676870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:14.677182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:14.677455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:14.678169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 1999/4048] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:14.723004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] MFA Rules not processed for user `01e7c66073564bb0b78b2309d281d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:14.724770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:14.766492 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:14.868212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2050/4049] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:15.685607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:15.688651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:15.865394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca240b4-fab8-4278-82d6-bd7dcde58748 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:15.884539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:15.885131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:15.885555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:15.885868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:15.917007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:15.920380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582153-c18d-4c85-aea2-fe61e77588f2 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:15.938918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2000/4050] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:16.605434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:16.609609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:16.724923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bf9b5-36e0-43cf-8052-9c1bf0dce9b3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:16.729890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:16.731059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:16.731542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:16.732150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:16.735101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:16.755231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:16.756968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:16.772262 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2051/4051] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:17.553608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:17.554472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:17.554771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:17.594422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:17.599174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:17.735556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2001/4052] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:22.770064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:22.782143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcdbf3-cca1-428e-9843-a72a753f284c service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:22.788039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:22.788882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:22.789191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:22.789528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:22.791772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:22.808153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:22.809517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:22.824093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2052/4053] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:27.719744 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=60 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:30.877048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:30.881621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:30.903219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ff0e7-7a7a-40d3-8e7a-fd9ea557cf22 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:30.914269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:30.915202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:30.915614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:30.916015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:30.924815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:30.948772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:30.950358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac003032-97c6-40e0-9629-9317df8480c3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:30.965343 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2002/4054] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:32.817037 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=46 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:35.962644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:35.976993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9eace-8762-4c81-b744-bfb727db4232 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:35.984234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:35.985177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:35.985623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:35.986078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:35.995500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:35.997381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4667d-f6f2-4b28-b70f-5a947709d0c1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:36.009403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2053/4055] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:36.931871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393eae-6152-455b-8023-e44461e41620 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:36.933248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393eae-6152-455b-8023-e44461e41620 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:36.933894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393eae-6152-455b-8023-e44461e41620 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:36.935880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2003/4056] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:23:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:23:36.941636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:36.942177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:36.942605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:36.984959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:36.987318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:37.156562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2054/4057] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:37.189959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393eae-6152-455b-8023-e44461e41620 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:37.191754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b5393eae-6152-455b-8023-e44461e41620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:37.220842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393eae-6152-455b-8023-e44461e41620 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:37.228048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:37.229413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:37.231115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:37.231571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:37.245834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:37.247967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a287ed-1928-4f2a-a41a-fece60e40564 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:37.278771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2004/4058] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:37.550028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:37.562506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430b27-9d94-4523-a746-247d1fcdf73f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:37.567149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:37.568034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:37.568503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:37.569266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:37.571280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:37.585446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:37.587225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafab89-08fc-49dd-bef2-b61a193dc9ac service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:37.600399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2055/4059] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:37.747535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:37.748135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:37.748448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:37.750067 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2005/4060] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:23:37.755598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:37.756183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:37.756558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:37.778824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:37.780635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:37.791142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2056/4061] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:37.823014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:37.824962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:37.845227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36cbfd-5186-4fd2-bda2-4ed123cfe20e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:37.851446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:37.852215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:37.852657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:37.853848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:37.865538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:37.865836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:37.876611 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2006/4062] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:38.084130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:38.099968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27326c7-6919-4d28-a0a5-3af40aa93a8a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:38.103652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:38.104667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:38.104957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:38.106097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:38.108191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:38.124789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:38.126409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:38.139954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2057/4063] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:44.886132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:44.889034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:44.923841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:44.945215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7787e-2e8b-4260-9232-57a203ab1efa service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:44.958632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:44.959594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:44.960034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:44.960462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:44.968624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:45.001067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:45.003007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:45.038075 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2058/4064] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:23:45.082185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b1954-d78e-4a1c-9592-3c8913a50645 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:45.088474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:45.089393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.090340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.090617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] PATH_INFO: `/v3/users/71b31a7e59f94d6ea7749c7ae004fea2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.092768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b31a7e59f94d6ea7749c7ae004fea2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:45.095715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:45.136080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:45.137891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:45.158303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de812bbc-8e0d-4876-b174-a465e455d60a service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:45.166865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b31a7e59f94d6ea7749c7ae004fea2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.177228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:45.178157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.178443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.178728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] PATH_INFO: `/v3/users/266a0979256344c497b6979cfdacc6ad` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.181646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b31a7e59f94d6ea7749c7ae004fea2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.185223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266a0979256344c497b6979cfdacc6ad)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:45.187567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:45.195064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b31a7e59f94d6ea7749c7ae004fea2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.227204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b31a7e59f94d6ea7749c7ae004fea2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.229476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b31a7e59f94d6ea7749c7ae004fea2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.237280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2007/4065] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:44 2022] DELETE /identity/v3/users/71b31a7e59f94d6ea7749c7ae004fea2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:45.300810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266a0979256344c497b6979cfdacc6ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.301855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266a0979256344c497b6979cfdacc6ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.313064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266a0979256344c497b6979cfdacc6ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.322062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266a0979256344c497b6979cfdacc6ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.382121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266a0979256344c497b6979cfdacc6ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.397477 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2059/4066] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:45 2022] DELETE /identity/v3/users/266a0979256344c497b6979cfdacc6ad => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:23:45.599946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:45.601987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:45.664195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:45.695073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b36c-e1cf-491a-921a-7e25366ac450 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:45.704954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:45.711326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:45.739329 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:45.782875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:45.784269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.784837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.785117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] PATH_INFO: `/v3/projects/a463acfa253e4eadb23ff67c2e1058dc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.786578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a463acfa253e4eadb23ff67c2e1058dc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:45.789423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:45.819384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e196f-b8c2-4716-8b18-63ef7089b330 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:45.835891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:45.835891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.835891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.835891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] PATH_INFO: `/v3/projects/04e896d3688c4c72bcf461445bada1f8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.836823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e896d3688c4c72bcf461445bada1f8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:45.837177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:45.862478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a463acfa253e4eadb23ff67c2e1058dc', 'request_id': 'req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.872144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a463acfa253e4eadb23ff67c2e1058dc', 'request_id': 'req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.880588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a463acfa253e4eadb23ff67c2e1058dc', 'request_id': 'req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.896614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e896d3688c4c72bcf461445bada1f8', 'request_id': 'req-37af6be0-d0cd-424e-bc5c-1307ac600dab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.897888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] The token cache is being invalidate because project a463acfa253e4eadb23ff67c2e1058dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:45.898403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.898915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-150fb253-4ce5-4cbd-ae5b-6d18d873ceda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.905774 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2008/4067] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:45 2022] DELETE /identity/v3/projects/a463acfa253e4eadb23ff67c2e1058dc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:45.906085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e896d3688c4c72bcf461445bada1f8', 'request_id': 'req-37af6be0-d0cd-424e-bc5c-1307ac600dab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.908385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511410e-410e-476d-8a6f-da68b1cd5424 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.908953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511410e-410e-476d-8a6f-da68b1cd5424 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.909859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511410e-410e-476d-8a6f-da68b1cd5424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.923474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e896d3688c4c72bcf461445bada1f8', 'request_id': 'req-37af6be0-d0cd-424e-bc5c-1307ac600dab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.930372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a511410e-410e-476d-8a6f-da68b1cd5424 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:45.931636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a511410e-410e-476d-8a6f-da68b1cd5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:45.939767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] The token cache is being invalidate because project 04e896d3688c4c72bcf461445bada1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:45.940258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.940916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37af6be0-d0cd-424e-bc5c-1307ac600dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:45.946924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2060/4068] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:45 2022] DELETE /identity/v3/projects/04e896d3688c4c72bcf461445bada1f8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:45.948709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557550-f678-4c39-800e-42d609e0ffae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:45.949006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557550-f678-4c39-800e-42d609e0ffae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:45.949292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557550-f678-4c39-800e-42d609e0ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:45.970346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ec557550-f678-4c39-800e-42d609e0ffae None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:45.972037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ec557550-f678-4c39-800e-42d609e0ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.013478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2009/4069] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.015797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.016091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.016373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.044851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:46.046228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.055052 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2010/4070] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.055501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2061/4071] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.061951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.064871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.065217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.065501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.074256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcfaf-098a-425d-816f-9c60842a66ce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.080047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.080841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.081327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.081738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.082587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:23:46.082997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.084876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.085802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:46.087029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.092907 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:46.097839 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2062/4072] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:46.101664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.102019 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2011/4073] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:23:46.109061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.112338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2669563-2c82-4cc6-b3fb-244b9af86887 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.123920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.124947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.125409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.125896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.126041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cb552-5253-4467-bad0-887502228d43 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.127131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:23:46.127844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.130524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.131263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.132043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.132334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.132863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.133490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.135497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.144913 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2063/4074] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:23:46.149132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.162443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d17921-0029-40df-9c55-b482c8bdc26f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.168257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.168907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.169195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.169475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.170351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.172313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.175955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2012/4075] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:46.176710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.202412 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:46.210960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2064/4076] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:46.214882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.266821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e182-d8fa-482e-a79c-a94307898b2e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.299992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d003ff-629b-41c2-8a99-d061b30c3661 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.306528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.307271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.307746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.308082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.308785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.311095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.333202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.334068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.334355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.334635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.335335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.337287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.337817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2065/4077] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:46.343326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.353785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce609e-6b22-42c2-9965-f04f9c4f2232 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.360647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.361387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.361712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.362032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.362828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.364749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.376341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2013/4078] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:46.378157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2066/4079] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:46.381305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.382571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.393802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e66096-49af-417d-b541-dc19c0850811 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.394005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c4a4-3341-4996-9dba-c039ff45956c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.398559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.398963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.399322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.399602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.399723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.399879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.399993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.400196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.400902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.401016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.402552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.402680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.417748 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2014/4080] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:23:46.417953 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2067/4081] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:46.419453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.419615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.430631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cb3de-0576-4f1e-ab63-5b025a0f29dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.430918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fec62d-5036-4ad5-a328-7ff4d7872514 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.435788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.435944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.436658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.437061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.437198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.437403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.437609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.437816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] PATH_INFO: `/v3/projects/2ff39f2632ca408e9795b48dbcefc815/users/5ab27e46e8534384abea2875fb9946df/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.438590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.440290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.453084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2068/4082] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:46.457017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.457161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff39f2632ca408e9795b48dbcefc815, user_id=5ab27e46e8534384abea2875fb9946df, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.459977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be4893-058c-4718-8b6f-079e2e85c6eb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.469080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9a6b4-758d-4470-9be4-943310d7f6de admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.475821 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2015/4083] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:46 2022] PUT /identity/v3/projects/2ff39f2632ca408e9795b48dbcefc815/users/5ab27e46e8534384abea2875fb9946df/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:46.482487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.482875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.483152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.503948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:46.505366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.543829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.546430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.546746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.547756 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:46.547898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] PATH_INFO: `/v3/projects/3782597cb4134300a0ad028dbc7176ce/users/0c41ee7f21744d48bf1ea29dd7cc311b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.580808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3782597cb4134300a0ad028dbc7176ce, user_id=0c41ee7f21744d48bf1ea29dd7cc311b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.584619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c33d7-e7e2-4ca3-ab8b-31a0f52d6ff9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.605841 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2016/4084] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.610628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.612543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.620090 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2069/4085] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:46 2022] PUT /identity/v3/projects/3782597cb4134300a0ad028dbc7176ce/users/0c41ee7f21744d48bf1ea29dd7cc311b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:46.632054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f826fb-e8f3-4e71-b533-525e58f5fa27 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.632341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f826fb-e8f3-4e71-b533-525e58f5fa27 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.632658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f826fb-e8f3-4e71-b533-525e58f5fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.671365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-81f826fb-e8f3-4e71-b533-525e58f5fa27 None None] MFA Rules not processed for user `0c41ee7f21744d48bf1ea29dd7cc311b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:46.673275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-81f826fb-e8f3-4e71-b533-525e58f5fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.711792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185784f2-b0e9-4a5d-95b1-7e74c6b036e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.712367 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:46.766249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2070/4086] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.768437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.769128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.769621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.791305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:46.792283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:46.795307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.795979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.796261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.796518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.877749 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2071/4087] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:46.879189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:46.924438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.926871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bd936-06ad-47db-9032-d84026e2d8e0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:46.939360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2017/4088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:46.977734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e001c3-e7a7-4ced-9605-c4983adc4687 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:46.986615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:46.987539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:46.987824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:46.988676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] PATH_INFO: `/v3/users/0c41ee7f21744d48bf1ea29dd7cc311b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:46.990460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c41ee7f21744d48bf1ea29dd7cc311b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:46.994253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:47.057344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c41ee7f21744d48bf1ea29dd7cc311b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:47.058054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c41ee7f21744d48bf1ea29dd7cc311b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:47.072338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c41ee7f21744d48bf1ea29dd7cc311b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:47.087923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c41ee7f21744d48bf1ea29dd7cc311b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:47.099188 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:47.114794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c41ee7f21744d48bf1ea29dd7cc311b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:47.130745 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2072/4089] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:46 2022] DELETE /identity/v3/users/0c41ee7f21744d48bf1ea29dd7cc311b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:47.139752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:47.140315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:47.141136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:47.175870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:47.182313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:47.263859 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:47.287077 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2018/4090] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:47.328812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:47.332362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:47.444326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e417a19-2fcf-4da1-a27c-0ea84c6701c2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:47.448129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:47.448797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:47.449083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:47.449366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:47.462954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:47.464663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91e4a-eba7-4b52-a093-77925c2f3d91 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:47.477044 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2073/4091] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:48.102413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:48.103905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:48.145691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb77a3-a379-4783-a44f-514f5f742c5d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:48.151897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:48.153077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.153749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.154985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] PATH_INFO: `/v3/projects/3782597cb4134300a0ad028dbc7176ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.156560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3782597cb4134300a0ad028dbc7176ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:48.159042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:48.254761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3782597cb4134300a0ad028dbc7176ce', 'request_id': 'req-55acfa30-4e18-4c35-af35-07e1653f1684'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:48.273249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3782597cb4134300a0ad028dbc7176ce', 'request_id': 'req-55acfa30-4e18-4c35-af35-07e1653f1684'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:48.291586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3782597cb4134300a0ad028dbc7176ce', 'request_id': 'req-55acfa30-4e18-4c35-af35-07e1653f1684'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:48.312499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] The token cache is being invalidate because project 3782597cb4134300a0ad028dbc7176ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:48.312867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:48.315464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-55acfa30-4e18-4c35-af35-07e1653f1684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:48.317547 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2019/4092] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:48 2022] DELETE /identity/v3/projects/3782597cb4134300a0ad028dbc7176ce => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:48.323813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.324387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.324387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.360354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:48.364961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:48.535391 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2074/4093] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:48.543520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.543821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.544106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.583311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:48.584967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:48.613497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2020/4094] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:23:48.618027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:48.631852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078783-5237-42f3-951a-8dd7c0f39290 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:48.650087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:48.650783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.651068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.651348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.652100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:23:48.652418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:48.654083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:48.684543 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2075/4095] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:23:48.687126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:48.703096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401e80c-8669-4230-8e58-5d5a9d03cd92 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:48.716598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:48.719176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.720798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.724454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.725819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:48.729792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:48.812286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2021/4096] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:48 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:48.816039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:48.832972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c4920-7bd0-46a9-adb5-f05d8e61df31 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:48.973840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:48.974903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:48.975195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:48.975474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:48.976292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:48.978776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:49.007893 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2076/4097] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:48 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:49.012509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:49.026741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503440-5e7b-42a2-b65f-abdaa5550964 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:49.034238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:49.035233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.035714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.036013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.037036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:49.039169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:49.058864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2022/4098] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:49.065480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:49.078833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c665b17-403a-4f6b-b8a4-2b665ce6334b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:49.084969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:49.085955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.086342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.086818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.087972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:49.090814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee77f6-3d6a-46a8-88c0-791e3ae62abe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:49.099968 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:49.109295 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2077/4099] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:49.114066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:49.145377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924e5a-cfa4-46a2-81a2-029918d601e5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:49.151004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:49.151920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.152205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.152483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] PATH_INFO: `/v3/projects/b8eb99dbda38447a8ff7721744633469/users/472ff2bf65fb473ba60274de014b08a9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.180703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eb99dbda38447a8ff7721744633469, user_id=472ff2bf65fb473ba60274de014b08a9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:49.186718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:49.209381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2023/4100] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:49 2022] PUT /identity/v3/projects/b8eb99dbda38447a8ff7721744633469/users/472ff2bf65fb473ba60274de014b08a9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:49.214930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.215113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.215349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.250077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:49.252082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:49.405866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2078/4101] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:49.431542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:49.434332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:49.592423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7b96c-0daa-4fd6-8e93-4c75025331f9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:49.606633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:49.608878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.609130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.609414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.633581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:49.635237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:49.661599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2024/4102] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:23:49.684658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:49.693191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:49.925081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d93811-30d4-475d-bd91-40fae864d639 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:49.939671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:49.941605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:49.942481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:49.943604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:49.949054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:49.990879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:49.993694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a11b-daaa-4f4e-96a1-dc2ba3c6d6bd service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:50.032620 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2079/4103] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:55.015444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:55.017152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:55.038540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb519e35-e9be-4db6-8c36-c1c14b5fcac3 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:55.047500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:55.048705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:55.050460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:55.053248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] PATH_INFO: `/v3/users/cfccd721a0374307b1afc2fbe94630cb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:55.056800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfccd721a0374307b1afc2fbe94630cb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:55.059178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:55.064614 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:55.173660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfccd721a0374307b1afc2fbe94630cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:55.187556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfccd721a0374307b1afc2fbe94630cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:55.202140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfccd721a0374307b1afc2fbe94630cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:55.235864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfccd721a0374307b1afc2fbe94630cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:55.237114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfccd721a0374307b1afc2fbe94630cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:55.250650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2025/4104] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:55 2022] DELETE /identity/v3/users/cfccd721a0374307b1afc2fbe94630cb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:55.256920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:55.258095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:55.258746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:55.348579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:55.354942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:55.553561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2080/4105] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:55.569651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:55.571693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:55.696010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1bb7-249b-414d-b515-a8e6d4d818f3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:55.708524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:55.710300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:55.710790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:55.711233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:55.729918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:55.733477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:55.759591 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2026/4106] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:56.793593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:56.800156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:56.828614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388f0b-98e9-4198-844d-8f57ccf783ac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:56.841382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:56.843011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:56.843383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:56.843723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] PATH_INFO: `/v3/projects/efec1f2f97c7447d9b27fa488ec9ab5f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:56.846752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=efec1f2f97c7447d9b27fa488ec9ab5f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:56.848843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:56.891841 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:56.941993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efec1f2f97c7447d9b27fa488ec9ab5f', 'request_id': 'req-cf576170-340d-4dfc-acd1-ec9dd2f22eef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:56.959263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efec1f2f97c7447d9b27fa488ec9ab5f', 'request_id': 'req-cf576170-340d-4dfc-acd1-ec9dd2f22eef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:56.976881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efec1f2f97c7447d9b27fa488ec9ab5f', 'request_id': 'req-cf576170-340d-4dfc-acd1-ec9dd2f22eef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.010139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] The token cache is being invalidate because project efec1f2f97c7447d9b27fa488ec9ab5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:57.010430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.011301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.013169 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2081/4107] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:56 2022] DELETE /identity/v3/projects/efec1f2f97c7447d9b27fa488ec9ab5f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:57.017634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:57.036671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd465c-df0b-4534-8a81-a4b8a33a3abf service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:57.220011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:57.221196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:57.221756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:57.221879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] PATH_INFO: `/v3/users/a5bc8ce7c1f24e69adf6cf820b938b33` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:57.223449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bc8ce7c1f24e69adf6cf820b938b33)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:57.226176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:57.261981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:57.314127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bc8ce7c1f24e69adf6cf820b938b33'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.327063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bc8ce7c1f24e69adf6cf820b938b33'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.343531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bc8ce7c1f24e69adf6cf820b938b33'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.365881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bc8ce7c1f24e69adf6cf820b938b33'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.367308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5dd4ed46-fbe8-462e-9b8e-61a71836a145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bc8ce7c1f24e69adf6cf820b938b33'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:57.380605 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2027/4108] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:57 2022] DELETE /identity/v3/users/a5bc8ce7c1f24e69adf6cf820b938b33 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:58.304231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:58.306478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:58.334098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576170-340d-4dfc-acd1-ec9dd2f22eef admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:58.493031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:58.493968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:58.494430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:58.494720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] PATH_INFO: `/v3/projects/884a52bb1a694f639726d4e08bf2a32c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:58.496016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884a52bb1a694f639726d4e08bf2a32c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:58.498772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:58.639732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884a52bb1a694f639726d4e08bf2a32c', 'request_id': 'req-e6154695-c9af-4db7-bf92-380243ccc106'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:58.655182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884a52bb1a694f639726d4e08bf2a32c', 'request_id': 'req-e6154695-c9af-4db7-bf92-380243ccc106'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:58.676628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884a52bb1a694f639726d4e08bf2a32c', 'request_id': 'req-e6154695-c9af-4db7-bf92-380243ccc106'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:58.707828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] The token cache is being invalidate because project 884a52bb1a694f639726d4e08bf2a32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:58.708725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:58.709059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6154695-c9af-4db7-bf92-380243ccc106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:58.712722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2082/4109] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:58 2022] DELETE /identity/v3/projects/884a52bb1a694f639726d4e08bf2a32c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:58.722863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:58.723677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:58.724131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:58.759553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:58.761815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:58.938383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2028/4110] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:58.946188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:58.946554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:58.946911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:58.980061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:58.981617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:59.009781 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2083/4111] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:59.015480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.036611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017dcb8-eb65-4728-8f61-8fd3ff7faeeb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.046772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.049197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.050322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.050450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.054090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:23:59.054090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.057242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.085869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2029/4112] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:23:59.088347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.100392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43006bf-bc50-42f8-b3b8-6ed6fa31728d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.112394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.114632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.116972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.117504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.118464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.122223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.170452 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2084/4113] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:23:59 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:23:59.176519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.200419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb271b-7f69-4493-b3c1-cf64adce0260 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.316071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.316770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.317054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.317809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.319006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.321148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.371810 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2030/4114] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:23:59 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:23:59.376383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.399720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9158-5bda-424e-844e-885a20f53510 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.422838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.423637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.423823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.424105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.424862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.429846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.442006 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:59.457888 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2085/4115] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:59.461426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.478714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e62d2-57b8-4298-bcf5-828ba3238bd1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.488417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.489185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.489539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.490047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.490854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.492888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676b9b-fc77-4f61-a62d-9a430933a103 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.514843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2031/4116] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:23:59.515291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.532322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871898bb-4294-4086-88df-e10491acc528 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:59.546405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:59.547578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.547993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.548283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] PATH_INFO: `/v3/projects/dbfb4f5c1e80417080aa2eda9186303c/users/41135b742e29427782ee8f628b7775d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.590943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfb4f5c1e80417080aa2eda9186303c, user_id=41135b742e29427782ee8f628b7775d5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:59.595313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:59.630889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2086/4117] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:23:59 2022] PUT /identity/v3/projects/dbfb4f5c1e80417080aa2eda9186303c/users/41135b742e29427782ee8f628b7775d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:59.637310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dde1b5-f713-4300-8d16-0882c70010dc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:59.637994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dde1b5-f713-4300-8d16-0882c70010dc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:59.638677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dde1b5-f713-4300-8d16-0882c70010dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:59.669337 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:59.699792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-26dde1b5-f713-4300-8d16-0882c70010dc None None] MFA Rules not processed for user `41135b742e29427782ee8f628b7775d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:23:59.702417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26dde1b5-f713-4300-8d16-0882c70010dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:59.856049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2032/4118] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:23:59.905490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:59.907329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.047119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f79f95-c4ac-486e-9430-7df6ad73f576 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:00.056582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:00.057459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.057872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.059914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.077314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:00.079160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa599f-8525-40c8-b9c5-28888d6ff5aa service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:00.086520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827854a-8c47-49e4-95be-183702169eac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.086952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827854a-8c47-49e4-95be-183702169eac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.087331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827854a-8c47-49e4-95be-183702169eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.099718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2087/4119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:00.174598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8827854a-8c47-49e4-95be-183702169eac None None] MFA Rules not processed for user `472ff2bf65fb473ba60274de014b08a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:00.176964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8827854a-8c47-49e4-95be-183702169eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.315289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75bf5d-c1ad-4a24-941e-d0c56c9220ee None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.315575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75bf5d-c1ad-4a24-941e-d0c56c9220ee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.315917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75bf5d-c1ad-4a24-941e-d0c56c9220ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.341425 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2033/4120] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:24:00.369764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827854a-8c47-49e4-95be-183702169eac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:00.396957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827854a-8c47-49e4-95be-183702169eac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:00.397166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cc75bf5d-c1ad-4a24-941e-d0c56c9220ee None None] MFA Rules not processed for user `5ab27e46e8534384abea2875fb9946df`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:00.397166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc75bf5d-c1ad-4a24-941e-d0c56c9220ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.397726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:00.397726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.397726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.397726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.398091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.421006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:00.422776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:00.437926 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2034/4121] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:00.438792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:00.440503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.613870 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2088/4122] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:00.617234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.619318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.619718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.714194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] MFA Rules not processed for user `5ab27e46e8534384abea2875fb9946df`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:00.720075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.739694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c779b-6f23-4a66-b3f7-730c60036936 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:00.760899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2089/4123] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:00.771134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:00.771821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.773528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.773864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.783575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:00.786431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:00.794127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:00.796555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:00.810927 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:00.843938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2035/4124] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:00.867297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a44f9-1d8e-45e0-8b87-a892646258ba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:00.891445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:00.891445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:00.891985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:00.892409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:00.921242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:00.924693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f1c0-3633-46b0-9240-956a47840f78 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:00.956314 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2090/4125] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:01.848496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:01.991197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532a66-e45f-4987-ab94-49741519fcb6 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:02.005985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:02.006951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:02.007508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:02.008033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] PATH_INFO: `/v3/users/41135b742e29427782ee8f628b7775d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:02.012073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41135b742e29427782ee8f628b7775d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:02.014252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:02.109293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41135b742e29427782ee8f628b7775d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:02.133823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41135b742e29427782ee8f628b7775d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:02.154071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41135b742e29427782ee8f628b7775d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:02.178337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41135b742e29427782ee8f628b7775d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:02.179131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41135b742e29427782ee8f628b7775d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:02.187877 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2036/4126] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:24:01 2022] DELETE /identity/v3/users/41135b742e29427782ee8f628b7775d5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:02.192423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:02.192966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:02.192966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:02.231640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:02.235694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:02.389618 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:02.437641 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2091/4127] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:24:02.496034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:02.499864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:02.687846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9f81c-0584-49ac-babb-bd1e66a94196 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:02.699179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:02.699879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:02.700220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:02.700435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:02.731761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:02.733343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7111c4-4afd-4927-bcd2-a3b28ca7e8dd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:02.756356 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2037/4128] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:03.894585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:03.896651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:04.071827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1632b4-cfdd-464d-88f0-a96c3f9203e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:04.087788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:04.088604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:04.088996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:04.089377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:04.096003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:04.118920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0790a-f97d-4f99-84af-8c3d884727fd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:04.119855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0790a-f97d-4f99-84af-8c3d884727fd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:04.121051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0790a-f97d-4f99-84af-8c3d884727fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:04.150793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:04.152441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:04.174682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b4e0790a-f97d-4f99-84af-8c3d884727fd None None] MFA Rules not processed for user `5ab27e46e8534384abea2875fb9946df`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:04.176216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b4e0790a-f97d-4f99-84af-8c3d884727fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:04.176730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2092/4129] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:04.193883 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:04.336194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2038/4130] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:04.923008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:04.924495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:04.965561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b14f-fbc0-4a8f-8005-6988278f6797 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:04.978529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:04.980719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:04.981198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:04.985543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] PATH_INFO: `/v3/projects/dbfb4f5c1e80417080aa2eda9186303c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:05.000606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfb4f5c1e80417080aa2eda9186303c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:05.004140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:05.243052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfb4f5c1e80417080aa2eda9186303c', 'request_id': 'req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:05.268418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfb4f5c1e80417080aa2eda9186303c', 'request_id': 'req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:05.290451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfb4f5c1e80417080aa2eda9186303c', 'request_id': 'req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:05.315125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] The token cache is being invalidate because project dbfb4f5c1e80417080aa2eda9186303c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:24:05.315514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:05.318080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-615f1270-5ac3-4a4c-b193-fe0c66d25e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:05.321180 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2093/4131] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:24:04 2022] DELETE /identity/v3/projects/dbfb4f5c1e80417080aa2eda9186303c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:05.327949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:05.328487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:05.329187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:05.380285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:05.383752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:05.687786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2039/4132] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:05.696437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:05.696873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:05.697349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:05.791562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:05.796654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:05.861085 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2094/4133] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:05.862261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:05.879497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf616-a4ad-4e4a-a1c4-6ad73d2a6bb3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:05.902982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:05.907176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:05.910120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:05.910465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:05.911304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:24:05.914746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:05.916768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:05.962793 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2040/4134] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:24:05.967361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:05.982091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46089d9a-41c3-4d91-b1e0-7a5a5ce7be68 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:05.992041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:05.994731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:05.995526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:05.996635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:05.998354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:06.001749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:06.045002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2095/4135] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:24:05 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:24:06.049907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:06.071023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb3332-ffe4-47c7-84b2-e827e493c34d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:06.258000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:06.262608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:06.263055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:06.264795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:06.266700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:06.272846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:06.338315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2041/4136] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:24:06 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:24:06.340841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:06.399877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35311b1-4605-462c-b278-f0625360cc1e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:06.426556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:06.427442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:06.427729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:06.428220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:06.428995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:06.430717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:06.472722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2096/4137] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:24:06.477726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:06.501503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523322a-30d1-420d-a8ec-0de28739aaa1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:06.516371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:06.517513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:06.537040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:06.537828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:06.538889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:06.562129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d281e-28e5-4ac1-ba5e-d89540384344 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:06.603500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2042/4138] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:24:06.608906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:06.628283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f050e-966e-4601-93e4-9aafd7da6cb1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:06.636217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:06.637061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:06.637347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:06.637629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] PATH_INFO: `/v3/projects/59a41392f602490a804528f0c7011717/users/7f6d89e4a5b844758b7585e71a0710c8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:06.664461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a41392f602490a804528f0c7011717, user_id=7f6d89e4a5b844758b7585e71a0710c8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:06.668319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:06.680979 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:06.712061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556c09-85fc-4baa-814b-237ed9893ecf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:06.712429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556c09-85fc-4baa-814b-237ed9893ecf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:06.712710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556c09-85fc-4baa-814b-237ed9893ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:06.714107 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2097/4139] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:24:06 2022] PUT /identity/v3/projects/59a41392f602490a804528f0c7011717/users/7f6d89e4a5b844758b7585e71a0710c8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:06.772651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a7556c09-85fc-4baa-814b-237ed9893ecf None None] MFA Rules not processed for user `7f6d89e4a5b844758b7585e71a0710c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:06.773337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7556c09-85fc-4baa-814b-237ed9893ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:06.813899 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:06.994457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2043/4140] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:07.006724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:07.009102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:07.101612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26581-6f31-4742-8697-910d0fca861e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:07.110720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:07.111846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:07.112522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:07.113161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:07.138985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:07.141647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:07.158168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2098/4141] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:10.099712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:10.100266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:10.100266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:10.145064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] MFA Rules not processed for user `472ff2bf65fb473ba60274de014b08a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:10.146655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:10.245383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2044/4142] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:10.483907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:10.485458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:10.716004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa3b9-cee0-4300-b492-ea182a3dc582 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:10.723877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:10.726118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:10.726695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:10.727228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] PATH_INFO: `/v3/users/1dda9fc0670f4e11ad4d8089bf1687c3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:10.729911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dda9fc0670f4e11ad4d8089bf1687c3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:10.735241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:10.811645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dda9fc0670f4e11ad4d8089bf1687c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:10.812588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dda9fc0670f4e11ad4d8089bf1687c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:10.822134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dda9fc0670f4e11ad4d8089bf1687c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:10.834673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dda9fc0670f4e11ad4d8089bf1687c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:10.851135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dda9fc0670f4e11ad4d8089bf1687c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:10.868134 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2099/4143] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:24:10 2022] DELETE /identity/v3/users/1dda9fc0670f4e11ad4d8089bf1687c3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:11.597461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:11.599091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:11.625701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4b06a-0be4-43f6-893b-41fa53dab2f8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:11.672315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:11.675141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:11.751104 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:11.790823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:11.791496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:11.791779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:11.792055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:11.793970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:11.829498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:11.831278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe4f22-1588-4a3e-b4fc-3093e59f8c1e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:11.846925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2045/4144] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:11.857904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265588-6ace-4008-acc1-3600a10b4e3e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:11.875322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:11.878135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:11.878657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:11.880268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] PATH_INFO: `/v3/projects/6b725b9f1812465f8a350e1a68e067a0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:11.882134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b725b9f1812465f8a350e1a68e067a0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:11.884725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:11.954082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b725b9f1812465f8a350e1a68e067a0', 'request_id': 'req-c10da98d-6e86-474d-b773-e8e806297f43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:11.965193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b725b9f1812465f8a350e1a68e067a0', 'request_id': 'req-c10da98d-6e86-474d-b773-e8e806297f43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:11.977002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b725b9f1812465f8a350e1a68e067a0', 'request_id': 'req-c10da98d-6e86-474d-b773-e8e806297f43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:11.993697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] The token cache is being invalidate because project 6b725b9f1812465f8a350e1a68e067a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:24:11.994370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:11.995421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c10da98d-6e86-474d-b773-e8e806297f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:24:11.999309 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2100/4145] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:24:11 2022] DELETE /identity/v3/projects/6b725b9f1812465f8a350e1a68e067a0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:12.004609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.005130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.005603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.030155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:12.032563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.133898 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2046/4146] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:12.146207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.146610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.148184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.181446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:12.183499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.196630 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2101/4147] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:12.200904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.211429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a82a-3183-4197-84a0-d1f8df63dc50 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.216456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.217400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.217769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.218213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.219235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:24:12.219235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.220996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.223840 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:12.243964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.245044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2047/4148] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:24:12.264837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b2c8-4ddf-4393-9f9b-5afa22f690d7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.277210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.280614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.281296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.281825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.282989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.285714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882df74-d084-4613-aab6-246739e9de7d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.350495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.373830 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2102/4149] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:24:12.390208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edb834-2bb4-4abb-bd75-1555289f117a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.533509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.538398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.538983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.584465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:12.586392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.601229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.605882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.611963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.612520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.613388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.615884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.658561 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2048/4150] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:24:12.675952 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2103/4151] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:12.677722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.693989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc647a0-7a80-46c2-8b33-3bd57d5a89fa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.702244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.703028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.703383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.703736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.704570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.706525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.720623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2049/4152] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:24:12.724454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.738899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31543-d6b1-428f-83d3-0b06f4f1833b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.744434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.745232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.745586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.745977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.746794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.749140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a7d47-1fbe-4f68-90b8-e862e36e8137 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.768964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2104/4153] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:24:12.771183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.794937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8382-946e-4248-a5df-4d9a8a2e9b17 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.823066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.823979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.824334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.824658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] PATH_INFO: `/v3/projects/4978ac73559545f080ff9ae3ebff0bbf/users/203831e3a6874ec1b359f3d873cf5b42/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.849302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4978ac73559545f080ff9ae3ebff0bbf, user_id=203831e3a6874ec1b359f3d873cf5b42, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.852169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.873776 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2050/4154] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:24:12 2022] PUT /identity/v3/projects/4978ac73559545f080ff9ae3ebff0bbf/users/203831e3a6874ec1b359f3d873cf5b42/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:24:12.878679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.879180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.879605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.902919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:12.906427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.924339 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:12.991479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2105/4155] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:13.086621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:13.088636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:13.198915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b5f7-d658-4962-a3ac-07ac378c05d2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:13.204449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:13.205811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:13.206100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:13.206384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:13.218619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:13.220256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec625c4d-4ae1-43d3-bd55-06d061519d4f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:13.233641 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2051/4156] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:15.239181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:15.241845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:15.372794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de57612-3106-4df7-9d42-9acae35dbfe8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:15.381046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:15.382347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:15.382878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:15.383494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:15.385791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:15.402228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:15.405521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:15.437562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2106/4157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:16.071034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824ae9-0e1e-4d3f-b3d5-d46eebd09ffc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:16.071592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824ae9-0e1e-4d3f-b3d5-d46eebd09ffc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:16.071592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824ae9-0e1e-4d3f-b3d5-d46eebd09ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:16.098269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-17824ae9-0e1e-4d3f-b3d5-d46eebd09ffc None None] MFA Rules not processed for user `01e7c66073564bb0b78b2309d281d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:16.103110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-17824ae9-0e1e-4d3f-b3d5-d46eebd09ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:16.212822 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:16.226498 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2052/4158] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:22.366326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:22.399695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cfc9c-50cc-4d24-9f7a-c4c6f8af0274 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:22.421968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:22.423195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:22.423662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:22.424849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:22.428466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:22.472195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:22.475163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cf029-a9d9-4811-9cfd-3ddf528ac747 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:22.493008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2107/4159] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:26.135485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.135961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.136049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.138387 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2053/4160] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:24:26.145461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190ee14-4e95-469f-b0b8-6da9f0b0c992 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.146002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190ee14-4e95-469f-b0b8-6da9f0b0c992 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.146221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190ee14-4e95-469f-b0b8-6da9f0b0c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.191630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e190ee14-4e95-469f-b0b8-6da9f0b0c992 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:26.193139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e190ee14-4e95-469f-b0b8-6da9f0b0c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:26.200778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2108/4161] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:24:26.223731 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:26.230651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:26.233030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:26.250106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac25a50-ddb3-4d66-a665-3fe1f3844c66 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:26.254180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:26.255032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.255518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.255895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.264751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:26.266521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ccd5-c3b1-4655-8c1c-c19b3af22ad2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:26.277182 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2054/4162] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:30.926360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:30.927226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:30.927691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:30.971348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] MFA Rules not processed for user `203831e3a6874ec1b359f3d873cf5b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:30.973468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:31.078603 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:31.093924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2109/4163] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:31.099867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd55-b7fd-46a5-b2e3-2038a999520a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:31.100836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd55-b7fd-46a5-b2e3-2038a999520a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:31.101157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5dd55-b7fd-46a5-b2e3-2038a999520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:31.128063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a4e5dd55-b7fd-46a5-b2e3-2038a999520a None None] MFA Rules not processed for user `203831e3a6874ec1b359f3d873cf5b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:31.130564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4e5dd55-b7fd-46a5-b2e3-2038a999520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:31.150270 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2055/4164] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:24:31.158038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:31.182566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6508d-2a3d-4c9a-8d00-0e73858acafc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:31.190358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:31.191024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:31.191297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:31.191578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:31.203175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:31.205884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f73d48-0318-421d-8e9f-48d391869804 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:31.233859 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2110/4165] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:32.282234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:32.282745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:32.282840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:32.284517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2056/4166] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:24:32.295693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8dd1-56ed-4661-b3a4-f48d6dd8d9ba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:32.296610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8dd1-56ed-4661-b3a4-f48d6dd8d9ba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:32.297277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8dd1-56ed-4661-b3a4-f48d6dd8d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:32.343530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9aef8dd1-56ed-4661-b3a4-f48d6dd8d9ba None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:32.345987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9aef8dd1-56ed-4661-b3a4-f48d6dd8d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:32.596792 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2111/4167] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:32.630254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:32.632178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:32.699161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b5202-065b-47e9-b868-15adaae9463e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:32.721501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:32.724403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:32.724693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:32.724968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:32.747303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:32.748942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:32.777229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2057/4168] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:36.910583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfa867-bb0d-44e5-832b-6aa1a7892f1c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:36.911133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfa867-bb0d-44e5-832b-6aa1a7892f1c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:36.911133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfa867-bb0d-44e5-832b-6aa1a7892f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:36.929073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1ebfa867-bb0d-44e5-832b-6aa1a7892f1c None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:36.930337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1ebfa867-bb0d-44e5-832b-6aa1a7892f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:37.000097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2112/4169] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:42.768054 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=15 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:46.990342 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=61 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:52.252418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:52.267663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abfd8e-2ede-43b9-80dc-e5bc05086a1b service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:52.273246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:52.273922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:52.274208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:52.274481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:52.276284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:52.350035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:52.351645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:52.362399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2058/4170] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:01.076223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:01.077650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:01.078442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:01.146820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] MFA Rules not processed for user `d82fd738d5bb4d5e838f67b0b76b3b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:01.148183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:01.361047 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2113/4171] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:01.593108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:01.627825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:01.632310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee572-6e8b-4e15-93b5-76bc1b547358 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:01.660989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:01.665072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:01.670950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:01.672164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:01.675476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:01.682925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c40d1-d2d0-43f7-958b-b3a5ac635c80 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:01.707673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:01.709623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:01.709798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:01.710082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:01.710370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] PATH_INFO: `/v3/users/203831e3a6874ec1b359f3d873cf5b42` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:01.713101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:01.716266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=203831e3a6874ec1b359f3d873cf5b42)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:01.718469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:01.735053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2059/4172] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:01.848640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203831e3a6874ec1b359f3d873cf5b42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:01.849885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203831e3a6874ec1b359f3d873cf5b42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:01.865546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203831e3a6874ec1b359f3d873cf5b42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:01.894705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203831e3a6874ec1b359f3d873cf5b42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:01.911187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8cf68b9c-9e1a-438e-9f4c-3836f1915944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203831e3a6874ec1b359f3d873cf5b42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:01.922411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2114/4173] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:01 2022] DELETE /identity/v3/users/203831e3a6874ec1b359f3d873cf5b42 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:02.459165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:02.477694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3af7c8-f664-49af-983f-443df0694d7b service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:02.626522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:02.627421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:02.627705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:02.627981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] PATH_INFO: `/v3/projects/4978ac73559545f080ff9ae3ebff0bbf` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:02.629620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4978ac73559545f080ff9ae3ebff0bbf)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:02.631925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:02.708668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4978ac73559545f080ff9ae3ebff0bbf', 'request_id': 'req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:02.716480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4978ac73559545f080ff9ae3ebff0bbf', 'request_id': 'req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:02.725394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4978ac73559545f080ff9ae3ebff0bbf', 'request_id': 'req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:02.742536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] The token cache is being invalidate because project 4978ac73559545f080ff9ae3ebff0bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:02.743617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:02.745052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-abdfb4b6-5dda-4ce8-bece-bf2f55ff8709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:02.751493 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2060/4174] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:02 2022] DELETE /identity/v3/projects/4978ac73559545f080ff9ae3ebff0bbf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:02.753486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223cce-1685-4826-8e54-190afa915231 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:02.754046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223cce-1685-4826-8e54-190afa915231 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:02.754759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06223cce-1685-4826-8e54-190afa915231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:02.779687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-06223cce-1685-4826-8e54-190afa915231 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:02.781287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06223cce-1685-4826-8e54-190afa915231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:02.881376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2115/4175] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:02.890590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:02.890874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:02.892117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:02.916497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:02.922363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:02.950285 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2061/4176] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:02.955366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06223cce-1685-4826-8e54-190afa915231 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:02.967882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06223cce-1685-4826-8e54-190afa915231 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:02.973303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:02.974012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:02.974304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:02.974605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:02.975361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:02.975672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:02.977393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:02.993711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2116/4177] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:02.996796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.006176 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:03.012460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dac50-1a32-4d90-9f31-8638d9827059 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.019198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.020048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.020751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.021030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.021842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.023829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf339a7-88d9-4aec-a081-05189c9338c5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.062749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2062/4178] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:02 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:03.067022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.075874 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:03.080981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07548f9-ad0b-4fbe-970a-d201b1775af3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.210507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.211202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.211684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.212148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.213040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.216372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.253316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.253918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.254362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.265744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2117/4179] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:03 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:03.269960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.276280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:03.278290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:03.284866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcff9c-8293-4836-844f-95399f893125 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.292016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.293346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.294140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.294480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.295317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.296865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.313702 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2118/4180] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:25:03.317714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.331444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc6487-8d11-473d-92dc-fc48a2814bc7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.337218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.338045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.338447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.338840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.339746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.341638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f872073-1490-474d-a88f-cb6cc524d156 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.353432 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2063/4181] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:03.356054 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2119/4182] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:03.366985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.387684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9d5ae-4e66-4fea-bb2a-ff30993b92dd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.394569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.395475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.395756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.396093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] PATH_INFO: `/v3/projects/7a951b63d79d4f2a9e411bc4a420d399/users/f0ecd3586149487ea192389a28afa9f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.422859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a951b63d79d4f2a9e411bc4a420d399, user_id=f0ecd3586149487ea192389a28afa9f8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.425298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.442256 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2064/4183] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:03 2022] PUT /identity/v3/projects/7a951b63d79d4f2a9e411bc4a420d399/users/f0ecd3586149487ea192389a28afa9f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:03.452917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96985a1c-f011-4a6f-beea-3976250390b0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.453200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96985a1c-f011-4a6f-beea-3976250390b0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.453496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96985a1c-f011-4a6f-beea-3976250390b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.499340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-96985a1c-f011-4a6f-beea-3976250390b0 None None] MFA Rules not processed for user `f0ecd3586149487ea192389a28afa9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:03.500603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-96985a1c-f011-4a6f-beea-3976250390b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:03.573421 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2120/4184] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:03.585230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:03.587008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:03.676698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9648-c3c0-44ed-8c6e-5931f72fc16d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:03.680904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:03.681775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:03.682060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:03.682338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:03.692649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:03.694160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:03.706083 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2065/4185] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:13.569998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:13.700198 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:20.848741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186faf-9732-40d3-ac3e-f6f76f656d91 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:20.850374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186faf-9732-40d3-ac3e-f6f76f656d91 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:20.850861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186faf-9732-40d3-ac3e-f6f76f656d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:20.896798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:20.913969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e8186faf-9732-40d3-ac3e-f6f76f656d91 None None] MFA Rules not processed for user `01e7c66073564bb0b78b2309d281d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:20.915369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8186faf-9732-40d3-ac3e-f6f76f656d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:21.115711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2121/4186] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:21.137244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b326-9860-453c-b075-e2dc0fcac45d service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:21.157384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:21.157914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:21.158432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:21.158824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] PATH_INFO: `/v3/users/f0ecd3586149487ea192389a28afa9f8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:21.160081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ecd3586149487ea192389a28afa9f8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:21.162339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:21.327267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ecd3586149487ea192389a28afa9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:21.345556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ecd3586149487ea192389a28afa9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:21.386403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ecd3586149487ea192389a28afa9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:21.429849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ecd3586149487ea192389a28afa9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:21.430917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ecd3586149487ea192389a28afa9f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:21.449535 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2066/4187] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:20 2022] DELETE /identity/v3/users/f0ecd3586149487ea192389a28afa9f8 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:21.455045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:21.455045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:21.455361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:21.503448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:21.504211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:21.685912 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2122/4188] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:21.718021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:21.719611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:21.916497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6ac48-891e-4dfa-a52b-21a05ebcf392 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:21.928205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:21.928880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:21.930752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:21.931043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:21.947757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:21.949912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ef247-fcc4-40a8-b142-41c21dd44fad service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:21.978107 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2067/4189] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:23.302743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:23.305065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:23.334315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519fdf-a0da-4cc9-8c5c-1ccf2e47b713 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:23.346095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:23.347314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:23.348681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:23.349480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] PATH_INFO: `/v3/projects/7a951b63d79d4f2a9e411bc4a420d399` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:23.352208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a951b63d79d4f2a9e411bc4a420d399)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:23.367126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:23.510788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a951b63d79d4f2a9e411bc4a420d399', 'request_id': 'req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:23.531963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a951b63d79d4f2a9e411bc4a420d399', 'request_id': 'req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:23.545661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a951b63d79d4f2a9e411bc4a420d399', 'request_id': 'req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:23.568590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] The token cache is being invalidate because project 7a951b63d79d4f2a9e411bc4a420d399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:23.568590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:23.568590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca7ad68e-d9fe-49bc-9d52-47f0eea1317c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:23.569764 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2123/4190] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:23 2022] DELETE /identity/v3/projects/7a951b63d79d4f2a9e411bc4a420d399 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:23.572658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:23.573186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:23.573479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:23.594943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:23.596232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:23.620802 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:23.730338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:23.730521 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2068/4191] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:23.731430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:23.731882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:23.754946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:23.756233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:23.766484 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2124/4192] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:23.778559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:23.793707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdbcfd-16b6-4049-b4ab-26d717290a87 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:23.805119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:23.806340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:23.806878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:23.807619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:23.808795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:23.809209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:23.810984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:23.826457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2069/4193] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:23.830668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:23.843592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae680ad-2645-4b64-870c-84acb2f6c8cf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:23.855599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:23.858937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:23.859295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:23.859576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:23.860850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:23.866136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:23.894201 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:23.961022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:23.962025 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2125/4194] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:23 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:23.981941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5869f9d-b845-42f1-81ef-36f7069c596e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.125774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.126608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.127047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.127432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.128251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.130350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.175744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2070/4195] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:23 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:24.179579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:24.195508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6687712-22ca-4133-b271-5e806f51b464 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.203263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.204098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.204384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.205000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.205780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.207648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.242232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:24.242625 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2126/4196] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:24.264052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3542a-9bd8-43f1-994a-7141a2d498e7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.273255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.275067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.275453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.276075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.277356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.280074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcbf0d-de01-491d-abc4-c22530742803 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.299355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2071/4197] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:25:24.299656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:24.318137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e77e1-e79c-47b5-92b1-76bf898c70bc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.327184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.331100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.331685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.332186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] PATH_INFO: `/v3/projects/122512c355ba4b9cb818226d2b8bd6c0/users/140f50fe269847cd8977dea21b6dd385/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.356118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122512c355ba4b9cb818226d2b8bd6c0, user_id=140f50fe269847cd8977dea21b6dd385, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.359406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.398184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.398836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.399335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.402275 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2127/4198] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:24 2022] PUT /identity/v3/projects/122512c355ba4b9cb818226d2b8bd6c0/users/140f50fe269847cd8977dea21b6dd385/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:24.487349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] MFA Rules not processed for user `140f50fe269847cd8977dea21b6dd385`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:24.487349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:24.590225 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2072/4199] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:24.596104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:24.710123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7284826-d054-4bc7-af19-206386645c05 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.719930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.721093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.721614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.723361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.724393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.728288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.778201 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2128/4200] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:24 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:24.783080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:24.800054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519591-c926-4323-ab43-014a0ccb02fd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:24.842630 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:24.947962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:24.949460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:24.949878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:24.950190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:24.950915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:24.955299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:24.997933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2073/4201] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:24 2022] POST /identity/v3/users => generated 308 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:24.998750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.023380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81841-ce86-44c5-858b-93d66423db94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.039371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.040452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.041082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.042617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.043938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.046000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.068637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2129/4202] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:25.070861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.091642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a700b8-cafb-4ec7-95cc-0edc3afcdb19 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.097899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.100079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.100476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.101128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] PATH_INFO: `/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec/users/9ca1434c20954dc89b066c4086a6c7f1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.132262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a94c5b7b0a4cc7a9b009f8b3db43ec, user_id=9ca1434c20954dc89b066c4086a6c7f1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.136289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.156087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2074/4203] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:25 2022] PUT /identity/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec/users/9ca1434c20954dc89b066c4086a6c7f1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:25.159937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.191634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1c3c9-7a3c-4b12-8bbf-5f4baf16da87 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.306370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.309234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.310693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.310933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.311988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.314075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e15b47-7525-4bf6-ba5e-d882e8848e12 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.352584 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2130/4204] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:25.358285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.376274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79769745-0449-4bb0-9ae0-41d1925d4afd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.410951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.412065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.414900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.415451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] PATH_INFO: `/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec/users/9ca1434c20954dc89b066c4086a6c7f1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.425827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a94c5b7b0a4cc7a9b009f8b3db43ec, user_id=9ca1434c20954dc89b066c4086a6c7f1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.435552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.492769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2075/4205] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:25 2022] PUT /identity/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec/users/9ca1434c20954dc89b066c4086a6c7f1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:25.504684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.504987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.506147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.577755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] MFA Rules not processed for user `9ca1434c20954dc89b066c4086a6c7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:25.580219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:25.648465 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:25.774062 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2131/4206] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:25.775384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.792991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abc48b-8ee2-4a22-ad96-e04681c293f3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.810452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca1434c20954dc89b066c4086a6c7f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.811612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.812175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.812617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.816866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.819392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.857775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2076/4207] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:25 2022] POST /identity/v3/roles => generated 240 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:25.862537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:25.878326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60894-26cb-49f7-b95a-7cabaf487767 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:25.894607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca1434c20954dc89b066c4086a6c7f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:25.896637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:25.897011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:25.897413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] PATH_INFO: `/v3/projects/122512c355ba4b9cb818226d2b8bd6c0/users/140f50fe269847cd8977dea21b6dd385/roles/0cead225559a473e93e4b1551fd64b4c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:25.906842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorizing `identity:create_grant(project_id=122512c355ba4b9cb818226d2b8bd6c0, user_id=140f50fe269847cd8977dea21b6dd385, role_id=0cead225559a473e93e4b1551fd64b4c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:25.913884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca4efc-ad85-46fc-bfe1-b7936cdb8eae tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:25.958234 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2132/4208] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:25 2022] PUT /identity/v3/projects/122512c355ba4b9cb818226d2b8bd6c0/users/140f50fe269847cd8977dea21b6dd385/roles/0cead225559a473e93e4b1551fd64b4c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:25.958920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:26.142872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d2fc6-3ca4-4ff4-9e05-1ce3482e31bc tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:26.276423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140f50fe269847cd8977dea21b6dd385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122512c355ba4b9cb818226d2b8bd6c0', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1084335908', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:26.278340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:26.278822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:26.279268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] PATH_INFO: `/v3/users/140f50fe269847cd8977dea21b6dd385/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:26.280195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: Authorizing `identity:create_application_credential(user_id=140f50fe269847cd8977dea21b6dd385)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:26.282019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:26.290878 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:26.388144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:26.388709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:26.388709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:26.399560 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2077/4209] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:25:25 2022] POST /identity/v3/users/140f50fe269847cd8977dea21b6dd385/application_credentials => generated 659 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:26.425762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] MFA Rules not processed for user `140f50fe269847cd8977dea21b6dd385`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:26.427822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:26.610115 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2133/4210] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 24 01:25:26.615298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:26.636453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261dab4-94cd-467f-8cd3-18ea2f7e3daf tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:26.645109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140f50fe269847cd8977dea21b6dd385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122512c355ba4b9cb818226d2b8bd6c0', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1084335908', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:26.646140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:26.646432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:26.646880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] PATH_INFO: `/v3/users/140f50fe269847cd8977dea21b6dd385/application_credentials/5e4c46c119fa425d869c41cd67d34861` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:26.648145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: Authorizing `identity:delete_application_credential(user_id=140f50fe269847cd8977dea21b6dd385, application_credential_id=5e4c46c119fa425d869c41cd67d34861)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:26.649854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:26.686403 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2078/4211] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:25:26 2022] DELETE /identity/v3/users/140f50fe269847cd8977dea21b6dd385/application_credentials/5e4c46c119fa425d869c41cd67d34861 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:26.690894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:26.772968 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:26.810983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17f3bd-b5d8-4a0a-a414-e7641e8e86d9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:26.826921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca1434c20954dc89b066c4086a6c7f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:26.828073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:26.828634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:26.829140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] PATH_INFO: `/v3/roles/0cead225559a473e93e4b1551fd64b4c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:26.831504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0cead225559a473e93e4b1551fd64b4c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:26.834192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:26.928458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] Invalidating the token cache because role 0cead225559a473e93e4b1551fd64b4c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:26.928771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:26.930029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d04e267e-99d0-4459-afc2-ffdc7f193643 tempest-ApplicationCredentialsV3AdminTest-1471642295 tempest-ApplicationCredentialsV3AdminTest-1471642295-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:26.934312 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2134/4212] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:26 2022] DELETE /identity/v3/roles/0cead225559a473e93e4b1551fd64b4c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:26.939229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:26.941161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:27.162940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f22cb-4854-44c3-b47d-9753e25d2aa5 tempest-ApplicationCredentialsV3AdminTest-979321154 tempest-ApplicationCredentialsV3AdminTest-979321154-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:27.272951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:27.274119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:27.274595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:27.274884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] PATH_INFO: `/v3/users/140f50fe269847cd8977dea21b6dd385` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:27.277868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=140f50fe269847cd8977dea21b6dd385)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:27.280580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:27.368594 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:27.407925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140f50fe269847cd8977dea21b6dd385'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:27.438331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140f50fe269847cd8977dea21b6dd385'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:27.493164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140f50fe269847cd8977dea21b6dd385'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:27.541356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140f50fe269847cd8977dea21b6dd385'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:27.547470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140f50fe269847cd8977dea21b6dd385'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:27.573033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2079/4213] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:26 2022] DELETE /identity/v3/users/140f50fe269847cd8977dea21b6dd385 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:27.574710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:27.575189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:27.575292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:27.600298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:27.601565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:27.703833 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2135/4214] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:27.731869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:27.735283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:27.805571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a4d6-11cd-4375-bca0-01f5d3d6b32f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:27.810028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:27.810695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:27.810974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:27.811247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:27.823883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:27.825572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:27.836274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2080/4215] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:28.657000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:28.661542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:28.677246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753225a-40fa-421a-ae5e-0b6366f0e98f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:28.693790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:28.693790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:28.693790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:28.693790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] PATH_INFO: `/v3/projects/122512c355ba4b9cb818226d2b8bd6c0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:28.694225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] RBAC: Authorizing `identity:delete_project(project_id=122512c355ba4b9cb818226d2b8bd6c0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:28.694225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:28.802896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122512c355ba4b9cb818226d2b8bd6c0', 'request_id': 'req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:28.810232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122512c355ba4b9cb818226d2b8bd6c0', 'request_id': 'req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:28.819256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122512c355ba4b9cb818226d2b8bd6c0', 'request_id': 'req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:28.835573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] The token cache is being invalidate because project 122512c355ba4b9cb818226d2b8bd6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:28.835930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:28.836602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:28.838386 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2136/4216] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:28 2022] DELETE /identity/v3/projects/122512c355ba4b9cb818226d2b8bd6c0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:28.842872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:28.859074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cfe0-b3fc-456c-8c19-25b3673736c1 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:28.944018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:28.945188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:28.945448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:28.945853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] PATH_INFO: `/v3/users/9ca1434c20954dc89b066c4086a6c7f1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:28.951658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca1434c20954dc89b066c4086a6c7f1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:28.953920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:29.018686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca1434c20954dc89b066c4086a6c7f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:29.023641 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:29.031762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca1434c20954dc89b066c4086a6c7f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:29.042312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca1434c20954dc89b066c4086a6c7f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:29.064104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca1434c20954dc89b066c4086a6c7f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:29.064994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e54d9763-262a-4c3c-bf58-1690147482f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca1434c20954dc89b066c4086a6c7f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:29.076007 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2081/4217] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:28 2022] DELETE /identity/v3/users/9ca1434c20954dc89b066c4086a6c7f1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:29.816362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:29.818380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:29.834572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a767-ee07-48a2-8acf-ec7fb7d8216e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:29.881631 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:29.923831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:29.925114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:29.925556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:29.925891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] PATH_INFO: `/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:29.929448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a94c5b7b0a4cc7a9b009f8b3db43ec)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:29.932008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:29.998781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'request_id': 'req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.007188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'request_id': 'req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.016275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a94c5b7b0a4cc7a9b009f8b3db43ec', 'request_id': 'req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.032494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] The token cache is being invalidate because project e6a94c5b7b0a4cc7a9b009f8b3db43ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:30.032867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.033612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.035460 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2137/4218] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:29 2022] DELETE /identity/v3/projects/e6a94c5b7b0a4cc7a9b009f8b3db43ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:30.040103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0334-ae96-4bca-9a8a-f4dc4005a2c8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.040627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0334-ae96-4bca-9a8a-f4dc4005a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.040799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0334-ae96-4bca-9a8a-f4dc4005a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.062596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a48e0334-ae96-4bca-9a8a-f4dc4005a2c8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:30.063810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a48e0334-ae96-4bca-9a8a-f4dc4005a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.172672 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2082/4219] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:30.180932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.181094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1767-d16f-415a-809e-609d8689681e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.181570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1767-d16f-415a-809e-609d8689681e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.181996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d1767-d16f-415a-809e-609d8689681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.183874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.214735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3dc21-f3a3-473a-b4c0-4ca99b10c16d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.221473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-919d1767-d16f-415a-809e-609d8689681e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:30.222754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-919d1767-d16f-415a-809e-609d8689681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.223123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.224934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.225220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.225875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] PATH_INFO: `/v3/users/7f6d89e4a5b844758b7585e71a0710c8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.227936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6d89e4a5b844758b7585e71a0710c8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.230572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.232917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2083/4220] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:30.238125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1767-d16f-415a-809e-609d8689681e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.251652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d1767-d16f-415a-809e-609d8689681e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.256088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.256790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.257069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.257349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.258223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:30.258528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.260812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.277853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2084/4221] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:30.283295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.291313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6d89e4a5b844758b7585e71a0710c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.292259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6d89e4a5b844758b7585e71a0710c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.293432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6c0a-8a3b-4efb-8b47-643108163359 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.298818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.299593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.299875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.300150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.301719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6d89e4a5b844758b7585e71a0710c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.301851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.303772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.311510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6d89e4a5b844758b7585e71a0710c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.336016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b406d24-f308-4aea-a55f-e81f3c651812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6d89e4a5b844758b7585e71a0710c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:30.344441 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2138/4222] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:30 2022] DELETE /identity/v3/users/7f6d89e4a5b844758b7585e71a0710c8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:30.348591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.348845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.349248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.353783 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2085/4223] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:30.358406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.361579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.373301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:30.374571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.408011 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:30.442387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f327-1600-4098-a244-9c1ac5d6b4f7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.448132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.449171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.449528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.449965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.450925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.452892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.473249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2139/4224] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:30.486717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2086/4225] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:30.487777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.490732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.490915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.504481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f53903-f027-44f9-925a-513b2e00d73c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.510921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.512126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.512690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.512833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.513697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.515570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.560720 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2087/4226] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:30.564737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.600922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1d9bf-5f95-45e9-afe0-adca1ed4b61b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.612763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.615025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.615242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.615529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.616273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.620082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91d8f-2789-4932-8e1b-fb50be6ff0cf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.621170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.622778 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:30.626914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.627894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.629689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.630278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.635735 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2088/4227] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:30.641054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.645007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.646719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374ee90-3498-4694-bd5a-29fe59515766 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.661939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de968006-db58-438d-bb00-fdba3f73d51a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:30.672100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:30.673369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.673699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.674228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] PATH_INFO: `/v3/projects/a5a589c3a4a8498a8fe0eaef9462b144/users/4bea6ecd50bf42f7a27502cb7a934ff2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.681834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2140/4228] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:30.694723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a589c3a4a8498a8fe0eaef9462b144, user_id=4bea6ecd50bf42f7a27502cb7a934ff2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:30.697798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:30.729711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2089/4229] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:30 2022] PUT /identity/v3/projects/a5a589c3a4a8498a8fe0eaef9462b144/users/4bea6ecd50bf42f7a27502cb7a934ff2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:30.810231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:30.810521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:30.810807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:30.840791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] MFA Rules not processed for user `4bea6ecd50bf42f7a27502cb7a934ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:30.842101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:30.935528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2141/4230] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:30.944138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.968800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:30.970539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:31.042320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830966b-87c6-4a4d-8f1c-3703b15bf2da admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.049962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.050620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.050949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.051275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.052646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.054674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.096461 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2090/4231] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:30 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:31.101991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.129621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9fb2-405b-4b4b-ace5-6785e404225f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.145297 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.197132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d34a6-99cd-4459-811c-389e19ed186c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.204441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.205365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.205600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.205859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.206342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.206515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.206802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.207079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] PATH_INFO: `/v3/projects/59a41392f602490a804528f0c7011717` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.207441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.208372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a41392f602490a804528f0c7011717)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.210897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.211059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.239640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2091/4232] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:31.240768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.252316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49062ea1-76db-49af-87df-4afcfbb028ff admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.257440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.258284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.258706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.259179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.259966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.262375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.279771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2092/4233] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:31.281288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.289044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a41392f602490a804528f0c7011717', 'request_id': 'req-3e580d92-6531-4646-b098-413cafa50caf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:31.295445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a41392f602490a804528f0c7011717', 'request_id': 'req-3e580d92-6531-4646-b098-413cafa50caf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:31.298807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2147-b58d-470d-aa1c-a72133f9c331 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.308457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a41392f602490a804528f0c7011717', 'request_id': 'req-3e580d92-6531-4646-b098-413cafa50caf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:31.325481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] The token cache is being invalidate because project 59a41392f602490a804528f0c7011717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:31.325758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:31.326702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3e580d92-6531-4646-b098-413cafa50caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:31.329467 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2142/4234] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:30 2022] DELETE /identity/v3/projects/59a41392f602490a804528f0c7011717 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:31.335603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b8d-8443-481d-b058-d0ec5897db23 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.335904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b8d-8443-481d-b058-d0ec5897db23 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.336191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661b8d-8443-481d-b058-d0ec5897db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.347605 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.364451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-49661b8d-8443-481d-b058-d0ec5897db23 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:31.365918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-49661b8d-8443-481d-b058-d0ec5897db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:31.387328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.388249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.388533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.388959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] PATH_INFO: `/v3/projects/83b3110be4cf448fbeb2199dc225e7d2/users/103666572d914eda825c9143fa9ed1e9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.407601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b3110be4cf448fbeb2199dc225e7d2, user_id=103666572d914eda825c9143fa9ed1e9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.413547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.451218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2093/4235] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:31 2022] PUT /identity/v3/projects/83b3110be4cf448fbeb2199dc225e7d2/users/103666572d914eda825c9143fa9ed1e9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:31.455514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.458125 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2143/4236] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:31.470179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:31.470629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.472374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.472733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.492438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:31.493786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:31.552568 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.590888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ab72-458a-4f6e-93ca-195ee4f8f44d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.597022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.597748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.598099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.598385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.600463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2144/4237] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:31.603818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.605274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.607371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.621930 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2094/4238] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:31.625791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.627803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0eb6-b784-48da-91a8-b3f089725dcf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.641376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ffaa-f072-4585-9514-edc25b78daec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.642156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.642884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.643171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.643449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.644253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:31.644563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.648673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.648866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.649588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.649921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.650202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] PATH_INFO: `/v3/projects/83b3110be4cf448fbeb2199dc225e7d2/users/103666572d914eda825c9143fa9ed1e9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.654011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b3110be4cf448fbeb2199dc225e7d2, user_id=103666572d914eda825c9143fa9ed1e9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.658197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9338c-abc2-4197-a3ad-a255e2556f39 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.670527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2145/4239] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:31.674699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.676615 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2095/4240] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:31 2022] PUT /identity/v3/projects/83b3110be4cf448fbeb2199dc225e7d2/users/103666572d914eda825c9143fa9ed1e9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:31.687675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.687989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.688287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.696547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a39824-c8c4-47a4-b558-926529c27824 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.727700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] MFA Rules not processed for user `103666572d914eda825c9143fa9ed1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:31.730161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:31.795344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.796135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.796424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.797034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.798511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.800735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.821580 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2096/4241] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:31.827186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.839539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781d3c-8531-4a3d-b5f3-478fdf546f81 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.842245 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2146/4242] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:31.848137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.880213 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:31.919272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.920064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.920346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.920620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.921349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.922412 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:31.922412 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:31.922412 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:31.923305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.934444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca55bb5-3fe5-4c11-9357-8fec3d120bd0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.939649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.940445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.940797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.941142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.941969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.946775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2097/4243] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/services => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:31.946993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.947888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.976163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2147/4244] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:31.980939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:31.981544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e7ab-a80b-44b0-a71c-4cda647d6528 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:31.987060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:31.987735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:31.988024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:31.988299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:31.989059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:31.990383 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:31.990383 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:31.990383 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:31.991583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:31.995679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de7cfd-2aff-4ae4-9bd4-8abcc5f210a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: 'False' Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise error Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'False' Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.014687 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:25:32.016382 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'False' Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.019113 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2098/4245] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:25:31 2022] POST /identity/v3/endpoints => generated 283 bytes in 67 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:25:32.020386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.034797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9a2e6-7f8b-4444-bdba-3c18a999971e tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.038105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.039033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.040226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.040724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.041248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.042855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.043424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.043424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.044159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.045202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.046016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.047673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: 'True' Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise error Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'True' Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.053017 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:25:32.055131 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'True' Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.056355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2099/4246] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:25:32 2022] POST /identity/v3/endpoints => generated 281 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:25:32.061746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.067889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2148/4247] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:25:32.071793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.079079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf3ba6-f18d-4243-88b7-66491695d671 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.085355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f85a-7f2f-4d64-87cc-a578f98403db admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.090865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.092145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.092438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.092722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.093109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.093509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.094134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.094475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.094811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.095174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.095739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.098012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.116850 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2149/4248] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:25:32.120884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.139691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142c31-c4d9-432f-9483-58a8391e28f7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.147658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.148808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.149250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.150026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] PATH_INFO: `/v3/projects/c29c5066e32041b68c80a27b57e7b327/users/08f48bfc09ad4b0c83c9300f1ae59ab9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.172148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c5066e32041b68c80a27b57e7b327, user_id=08f48bfc09ad4b0c83c9300f1ae59ab9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.175058 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-826988783. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:25:32.175058 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:25:32.175058 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:32.175790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811fdca-9ba3-4da5-8299-01bf4a8ac671 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.180143 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:32.200952 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2150/4249] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:32 2022] PUT /identity/v3/projects/c29c5066e32041b68c80a27b57e7b327/users/08f48bfc09ad4b0c83c9300f1ae59ab9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:32.211762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.212437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.212437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.220781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2100/4250] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:25:32 2022] POST /identity/v3/endpoints => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:32.226490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.246537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] MFA Rules not processed for user `08f48bfc09ad4b0c83c9300f1ae59ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:32.248522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:32.263340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ba75-0143-489d-9408-4ce6e5e9c265 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.339893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.340909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.341275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.341627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/regions/tempest-region-826988783` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.342418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-826988783)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.343595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.345636 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2151/4251] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3544 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:32.345805 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2101/4252] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:25:32 2022] GET /identity/v3/regions/tempest-region-826988783 => generated 178 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:32.349916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.357146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.359806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:32.362183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767f7d7-60de-4fab-99e9-1f945d86374a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.367223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.368828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.369345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.370185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints/40a8a507d09f4d7490d628b9d327018a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.378344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=40a8a507d09f4d7490d628b9d327018a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.379418 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:32.379418 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:32.379418 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:32.380316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: On instance['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: On instance['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: 'False' Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise error Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'False' Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.397533 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:25:32.401938 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'False' Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:25:32.403224 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2152/4253] 10.222.0.27 () {60 vars in 1254 bytes} [Sun Jul 24 01:25:32 2022] PATCH /identity/v3/endpoints/40a8a507d09f4d7490d628b9d327018a => generated 283 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:25:32.406020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.419017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426d9c-7f0e-4943-81f1-8303e2d3cfe0 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.426085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.427101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.427509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.428087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints/40a8a507d09f4d7490d628b9d327018a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.429564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=40a8a507d09f4d7490d628b9d327018a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.430883 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:32.430883 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:32.430883 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:32.432772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.444303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '40a8a507d09f4d7490d628b9d327018a', 'request_id': 'req-9e835430-f802-41a4-9527-216c3ec717c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:32.452205 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:32.455348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeceecd-2bb6-4d8e-993b-f407571c7f7d tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.464669 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2153/4254] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:32 2022] DELETE /identity/v3/endpoints/40a8a507d09f4d7490d628b9d327018a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:32.468266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.469198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.470293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.470601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.470884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.485966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.488743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.496059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835430-f802-41a4-9527-216c3ec717c6 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.502170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.503028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.503310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.503637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/regions/tempest-region-826988783` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.504309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-826988783)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.505699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2102/4255] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3544 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:32.510196 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:32.510196 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:32.510196 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:32.511918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.532083 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-826988783. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:25:32.532083 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:25:32.532083 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:32.540687 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2154/4256] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:25:32 2022] DELETE /identity/v3/regions/tempest-region-826988783 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:32.547053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.560386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e8c7-9a93-4ed0-9df5-738808c40969 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.579310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.580424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.580705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.581003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.581827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.583478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.605633 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-319408191. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:25:32.605633 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:25:32.605633 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:32.643843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2103/4257] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:25:32 2022] POST /identity/v3/endpoints => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:32.644888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.673417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52140140-fa56-4578-87c3-35befa38e8e5 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.693481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.694793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.694793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.695028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/regions/tempest-region-319408191` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.695670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-319408191)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.697356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.699592 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2155/4258] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:25:32 2022] GET /identity/v3/regions/tempest-region-319408191 => generated 178 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:32.704333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.743424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53390fd8-9b42-4f01-b7d2-568518597b96 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.767564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.768456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.768745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.769028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints/5c7a3776c98544cda8f51c002e933968` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.779908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5c7a3776c98544cda8f51c002e933968)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.781108 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:32.781108 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:32.781108 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:32.782106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: On instance['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: 'True' Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise error Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'True' Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.797321 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:25:32.799367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application On instance['enabled']: Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application 'True' Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:25:32.800702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2104/4259] 10.222.0.27 () {60 vars in 1254 bytes} [Sun Jul 24 01:25:32 2022] PATCH /identity/v3/endpoints/5c7a3776c98544cda8f51c002e933968 => generated 281 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:25:32.803407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.816065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173adb6-b184-4219-a189-2ed748fd9ceb tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.828502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.829636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.830149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.831103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/endpoints/5c7a3776c98544cda8f51c002e933968` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.832648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5c7a3776c98544cda8f51c002e933968)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.846198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:32.868381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5c7a3776c98544cda8f51c002e933968', 'request_id': 'req-f46a6b94-bc41-43e3-af50-83de96c96f10'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:32.900225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2156/4260] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:25:32 2022] DELETE /identity/v3/endpoints/5c7a3776c98544cda8f51c002e933968 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:32.906267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:32.926683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154e2b5-5820-474e-a9a2-69ccbcb599af tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:32.972328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:32.973190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:32.973478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:32.973785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/regions/tempest-region-319408191` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:32.974467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-319408191)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:32.975503 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:32.975503 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:32.975503 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:32.976398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:33.015762 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2105/4261] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:25:32 2022] DELETE /identity/v3/regions/tempest-region-319408191 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:33.021441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:33.036980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a6b94-bc41-43e3-af50-83de96c96f10 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:33.057128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '103666572d914eda825c9143fa9ed1e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3110be4cf448fbeb2199dc225e7d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:33.058992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:33.059285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:33.059568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] PATH_INFO: `/v3/services/dd95e75c06f54b35a981cbc7e66f9de6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:33.060246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dd95e75c06f54b35a981cbc7e66f9de6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:33.062146 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:33.062146 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:33.062146 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:33.063116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eed2b-0df2-4f7c-97b2-84cb2911ad34 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:33.146534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2157/4262] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:33 2022] DELETE /identity/v3/services/dd95e75c06f54b35a981cbc7e66f9de6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:33.150545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:33.313211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaade9-42ad-42d6-a0a4-da921989d8d3 tempest-EndpointsNegativeTestJSON-771781108 tempest-EndpointsNegativeTestJSON-771781108-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:33.334952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:33.336028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:33.336377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:33.336747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] PATH_INFO: `/v3/users/4bea6ecd50bf42f7a27502cb7a934ff2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:33.338126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bea6ecd50bf42f7a27502cb7a934ff2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:33.340705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:33.423353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bea6ecd50bf42f7a27502cb7a934ff2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:33.427938 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:33.434372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bea6ecd50bf42f7a27502cb7a934ff2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:33.447025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bea6ecd50bf42f7a27502cb7a934ff2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:33.465841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bea6ecd50bf42f7a27502cb7a934ff2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:33.466524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bea6ecd50bf42f7a27502cb7a934ff2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:33.493397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2106/4263] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:33 2022] DELETE /identity/v3/users/4bea6ecd50bf42f7a27502cb7a934ff2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:33.498189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:33.498480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:33.498785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:33.548178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:33.552294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:33.583026 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:33.724726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2158/4264] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:33.757297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:33.759312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:33.911716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4afcfa-a630-4f1e-b1e8-f5c8c5502a34 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:33.923309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:33.923589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:33.924384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:33.924384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:33.949575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:33.951090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:33.976919 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2107/4265] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:34.786824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:34.790652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:34.821181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f14b6-3709-4eeb-af7a-2167765e9c74 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:34.833619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:34.834488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:34.834774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:34.835054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] PATH_INFO: `/v3/projects/a5a589c3a4a8498a8fe0eaef9462b144` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:34.837330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a589c3a4a8498a8fe0eaef9462b144)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:34.839885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:34.929093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a589c3a4a8498a8fe0eaef9462b144', 'request_id': 'req-30226f5f-4579-4e16-955c-ae91d77be4fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:34.936197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a589c3a4a8498a8fe0eaef9462b144', 'request_id': 'req-30226f5f-4579-4e16-955c-ae91d77be4fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:34.946572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a589c3a4a8498a8fe0eaef9462b144', 'request_id': 'req-30226f5f-4579-4e16-955c-ae91d77be4fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:34.964075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] The token cache is being invalidate because project a5a589c3a4a8498a8fe0eaef9462b144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:34.964685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:34.965822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30226f5f-4579-4e16-955c-ae91d77be4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:34.968136 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2159/4266] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:34 2022] DELETE /identity/v3/projects/a5a589c3a4a8498a8fe0eaef9462b144 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:34.971931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:34.983913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964147c7-3ac8-4ff2-ba57-baddbf494d2f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:35.158034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:35.159494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:35.159794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:35.160455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] PATH_INFO: `/v3/users/103666572d914eda825c9143fa9ed1e9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:35.163444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=103666572d914eda825c9143fa9ed1e9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:35.165466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:35.269021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103666572d914eda825c9143fa9ed1e9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:35.286012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103666572d914eda825c9143fa9ed1e9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:35.300552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103666572d914eda825c9143fa9ed1e9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:35.305986 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:35.329888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103666572d914eda825c9143fa9ed1e9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:35.331319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103666572d914eda825c9143fa9ed1e9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:35.351425 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2108/4267] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:34 2022] DELETE /identity/v3/users/103666572d914eda825c9143fa9ed1e9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:35.959867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5b84-c015-4db8-b05a-a7374a0c9ec3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:35.960440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5b84-c015-4db8-b05a-a7374a0c9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:35.960658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5b84-c015-4db8-b05a-a7374a0c9ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:35.980266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-373c5b84-c015-4db8-b05a-a7374a0c9ec3 None None] MFA Rules not processed for user `785eebaf851240da958ed7c13d121121`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:35.981995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-373c5b84-c015-4db8-b05a-a7374a0c9ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:36.079273 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2160/4268] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:36.397008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:36.402160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:36.555266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83a0f0-aa24-4f04-904d-bee250968dae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:36.562570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:36.563710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:36.564059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:36.564423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] PATH_INFO: `/v3/projects/83b3110be4cf448fbeb2199dc225e7d2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:36.566443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b3110be4cf448fbeb2199dc225e7d2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:36.568598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:36.640757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b3110be4cf448fbeb2199dc225e7d2', 'request_id': 'req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:36.653383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b3110be4cf448fbeb2199dc225e7d2', 'request_id': 'req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:36.663464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b3110be4cf448fbeb2199dc225e7d2', 'request_id': 'req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:36.681706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] The token cache is being invalidate because project 83b3110be4cf448fbeb2199dc225e7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:36.684026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:36.684768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0a04d38-eedf-41ce-8cdd-9c11eb93d487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:36.692039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505552-c08b-4206-9048-db2509793a74 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:36.692344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505552-c08b-4206-9048-db2509793a74 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:36.692634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505552-c08b-4206-9048-db2509793a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:36.695291 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2109/4269] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:36 2022] DELETE /identity/v3/projects/83b3110be4cf448fbeb2199dc225e7d2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:36.742215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1a505552-c08b-4206-9048-db2509793a74 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:36.743788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a505552-c08b-4206-9048-db2509793a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:36.813219 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:36.861763 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2161/4270] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:36.870755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:36.871117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:36.871343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:36.892422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:36.893758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:36.904749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2110/4271] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:36.908558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505552-c08b-4206-9048-db2509793a74 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:36.919016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505552-c08b-4206-9048-db2509793a74 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:36.924631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:36.925556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:36.926048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:36.926496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:36.927522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:36.927996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:36.930068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:36.945283 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2162/4272] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:25:36.950360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:36.961741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6bb8-6b04-467d-8814-e93a7e08d75a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:36.969024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:36.970782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:36.971967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:36.972464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:36.973374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:36.975762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.007931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2111/4273] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:36 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:37.014349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.029536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb20cff-b2ff-43b5-a401-fc2a00c7c850 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.143511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.144225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.144512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.144794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.145572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.147845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.190353 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2163/4274] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:37 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:37.195129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.211124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0ab68-0eaf-4dfb-b1cc-2b33e1c4aff4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.216897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.220716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.221010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.221294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.223418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.223760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.243667 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2112/4275] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:37.246046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.267369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d03c-3866-479b-90b0-d8742435970d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.275211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.277059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.277401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.277713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.278792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.280879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726e01-594f-4e65-96fd-5945e0a9e7b3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.296671 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2164/4276] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:37.299684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.312208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75c65-fc80-4927-9949-e0c48877c191 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.317408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.319031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.319031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.319031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] PATH_INFO: `/v3/projects/ba17a6209d5c460aa62f4863f0e6a3e6/users/707169f096ab423e943673131d89ecd5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.339520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba17a6209d5c460aa62f4863f0e6a3e6, user_id=707169f096ab423e943673131d89ecd5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.342860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.372136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2113/4277] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:37 2022] PUT /identity/v3/projects/ba17a6209d5c460aa62f4863f0e6a3e6/users/707169f096ab423e943673131d89ecd5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:37.382350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.382645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.382929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.421541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] MFA Rules not processed for user `707169f096ab423e943673131d89ecd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:37.422811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:37.547454 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2165/4278] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:37.552531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.568195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.662075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e15a-bd54-461b-86fc-df17412f9b80 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.671825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.672923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.673324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.673780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.675247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.678016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.726746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.727629 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2114/4279] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:37 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:37.740747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d77a35-4690-44d6-91d2-6cbd7c12c1bb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.785816 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:37.825503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.826277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.826556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.826838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.827546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.829467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.868661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.879343 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2166/4280] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:37 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:37.884116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519200e-f704-478a-87ec-b248ac65b932 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.889880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.891545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.891916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.892249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.893175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.894967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.913071 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2115/4281] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:37.918037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.928125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071cfa3-4d88-4179-9aa1-ae48f4fb9d63 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:37.933532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:37.934459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:37.934776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:37.935052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] PATH_INFO: `/v3/projects/82534141ca9d4277ad6226a7afdea064/users/11a4b68f417d488a9d3f987954f8b6b4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:37.951944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82534141ca9d4277ad6226a7afdea064, user_id=11a4b68f417d488a9d3f987954f8b6b4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:37.955503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:37.972413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2167/4282] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:37 2022] PUT /identity/v3/projects/82534141ca9d4277ad6226a7afdea064/users/11a4b68f417d488a9d3f987954f8b6b4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:37.976330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:37.986861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3e84-1308-406c-88d2-a01385ea09a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.054445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.055279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.055637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.056028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.057658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.059656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c279653-e849-473a-aadd-108a66ff2941 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.084270 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2116/4283] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:38.089067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.101124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7fcb1-080e-4887-b395-6d313b9ce364 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.108210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.109772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.110279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.110768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] PATH_INFO: `/v3/projects/82534141ca9d4277ad6226a7afdea064/users/11a4b68f417d488a9d3f987954f8b6b4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.113029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=82534141ca9d4277ad6226a7afdea064, user_id=11a4b68f417d488a9d3f987954f8b6b4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.116278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.131432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2168/4284] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:38 2022] PUT /identity/v3/projects/82534141ca9d4277ad6226a7afdea064/users/11a4b68f417d488a9d3f987954f8b6b4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:38.142177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.142475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.142817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.185600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] MFA Rules not processed for user `11a4b68f417d488a9d3f987954f8b6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:38.185600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:38.336880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2117/4285] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:38.341970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.357490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39005b3-505c-4964-96e1-8b84f26833ef admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.364193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.364786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.365259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.365934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.366899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.370310 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:38.370310 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:38.370310 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:38.371384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.394486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2169/4286] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/domains => generated 277 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:38.398831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.406665 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:38.411111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99cdbb-78ba-467c-b4c7-c28cee5bc548 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.478157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.479552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.479842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.480119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.481354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.484666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.539848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2118/4287] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/projects => generated 402 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:38.544692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.564218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf843-ec86-47c7-815f-df1afa54c901 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.680921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.681965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.682434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.682717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.683784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.684846 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:38.684846 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:38.684846 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:38.686531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.712047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.714976 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2170/4288] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/groups => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:38.725563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217df7-1e1c-4e2a-a0e8-7d0218e3b714 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.743131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.743746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.744103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.744973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.746026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.748942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.789239 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2119/4289] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/users => generated 445 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:38.796057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.808497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92526429-c787-42b1-a39c-8d217b12935a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.815403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.816172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.817063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.817602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.818924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.820932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.852746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2171/4290] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:38 2022] POST /identity/v3/roles => generated 240 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:38.857413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.870870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6536-8dd5-446b-8eb8-97b939aae4b7 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:38.879045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:38.880146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:38.880536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:38.880926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:38.889739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1995908143d4403d87534a39fbdc6b99, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=59e375c1d3a14a2cb0fdb81db32bf720)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:38.896071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:38.913293 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2120/4291] 10.222.0.27 () {60 vars in 1584 bytes} [Sun Jul 24 01:25:38 2022] PUT /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:38.918142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:38.930341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8890-fa15-4105-8773-40396abf566f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.008362 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:39.022524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.023749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.023749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.024015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.028557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1995908143d4403d87534a39fbdc6b99, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=59e375c1d3a14a2cb0fdb81db32bf720)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.029048 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:39.029048 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:39.029048 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:39.031281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.040914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2172/4292] 10.222.0.27 () {58 vars in 1566 bytes} [Sun Jul 24 01:25:38 2022] HEAD /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:39.046163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.059307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5fb6d-27d8-4361-8e97-aa93d67af09a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.065566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.066853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.067344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.067825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.070745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1995908143d4403d87534a39fbdc6b99, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=59e375c1d3a14a2cb0fdb81db32bf720)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.072126 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:39.072126 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:39.072126 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:39.075728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.086520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 59e375c1d3a14a2cb0fdb81db32bf720 was removed from group 87b03e9dad7541cd8351f112e756e2d9 on project 1995908143d4403d87534a39fbdc6b99. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:39.087202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.098291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.125843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2121/4293] 10.222.0.27 () {58 vars in 1568 bytes} [Sun Jul 24 01:25:39 2022] DELETE /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/groups/87b03e9dad7541cd8351f112e756e2d9/roles/59e375c1d3a14a2cb0fdb81db32bf720/inherited_to_projects => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:39.127698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.131748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:39.147978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c546b5-6376-4a1a-a784-4fd47ce3bc33 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.233818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.235076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.235858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.237236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/59e375c1d3a14a2cb0fdb81db32bf720` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.239107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=59e375c1d3a14a2cb0fdb81db32bf720)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.242009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.297603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 59e375c1d3a14a2cb0fdb81db32bf720 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:39.298886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.300743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-24905a8f-7ede-4a2e-87e9-49d8b74fb9aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.303568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2173/4294] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:39 2022] DELETE /identity/v3/roles/59e375c1d3a14a2cb0fdb81db32bf720 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:39.309568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.320480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a75ca-3018-4115-830f-da48a4e2c6af tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.473405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.474149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.474516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.474801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.476098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.479746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.496362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6cc7-6f52-4215-a673-ac306f705593 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.497063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6cc7-6f52-4215-a673-ac306f705593 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.498072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6cc7-6f52-4215-a673-ac306f705593 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.501277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2174/4295] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:25:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:25:39.509530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.511741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.512065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2122/4296] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:39 2022] POST /identity/v3/roles => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:39.512878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.516629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.522986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:39.538426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:39.544149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:39.551183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebc67-ed28-40d8-ad57-4facb51c048f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.566303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.567234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.567516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.567791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.604316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1995908143d4403d87534a39fbdc6b99, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=68d61f10471f471091446ced299111a6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.607399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.619778 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:39.629211 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2123/4297] 10.222.0.27 () {60 vars in 1581 bytes} [Sun Jul 24 01:25:39 2022] PUT /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:39.636273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.731279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ea909-da0f-4c88-b755-52ba1110fafd tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.738185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.739343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.739702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.740052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.744966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1995908143d4403d87534a39fbdc6b99, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=68d61f10471f471091446ced299111a6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.746063 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:39.746063 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:39.746063 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:39.748165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.758516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2124/4298] 10.222.0.27 () {58 vars in 1563 bytes} [Sun Jul 24 01:25:39 2022] HEAD /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:39.761127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.777962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df92ab-728f-49ae-a263-b1bc664dfd3f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.784481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.785249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.785536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.785856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.788394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1995908143d4403d87534a39fbdc6b99, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=68d61f10471f471091446ced299111a6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.801970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.811363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 68d61f10471f471091446ced299111a6 was removed from user f5f66345f8694544b4160ef73c8b583d on project 1995908143d4403d87534a39fbdc6b99. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:39.812168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.812927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.836541 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2125/4299] 10.222.0.27 () {58 vars in 1565 bytes} [Sun Jul 24 01:25:39 2022] DELETE /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/68d61f10471f471091446ced299111a6/inherited_to_projects => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:39.840921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.842427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:39.875999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2175/4300] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:39.906773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:39.908612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:39.930746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf4a6-a5e1-437a-bc58-4472e4bf3e13 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.930991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95019-d3d6-4e4b-b9a3-f702ffbcf0d2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:39.937627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:39.938710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:39.939096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:39.939470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/68d61f10471f471091446ced299111a6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:39.941949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=68d61f10471f471091446ced299111a6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:39.943839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:39.989199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 68d61f10471f471091446ced299111a6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:39.990106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.990704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:39.993728 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2126/4301] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:39 2022] DELETE /identity/v3/roles/68d61f10471f471091446ced299111a6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:39.998983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.001786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:40.016690 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:40.054019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.055805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.056606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.057313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.060198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:40.089008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.091279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.106033 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:40.120082 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2176/4302] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:25:40.138129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f0ca-7ec2-4465-9157-cd0a75362043 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.144722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.145647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.145971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.146506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.147370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.149301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.180489 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2127/4303] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:39 2022] POST /identity/v3/roles => generated 239 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:40.184332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.203640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc9405-8cf3-4a23-b765-51affcfe40cc service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.210790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.211683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.212114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.212430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.215980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=db124601877b421cb1a2976564c9fad2, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=d003fa913c9a49c08290077d8ca716e3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.219055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.236471 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2177/4304] 10.222.0.27 () {60 vars in 1581 bytes} [Sun Jul 24 01:25:40 2022] PUT /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:40.241115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.261692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542440ea-a708-452b-8140-d8981eb9723a tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.411284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.412264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.412660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.413086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.415174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=db124601877b421cb1a2976564c9fad2, group_id=87b03e9dad7541cd8351f112e756e2d9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.417588 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:40.417588 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:40.417588 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:40.422796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.489731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.491120 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2128/4305] 10.222.0.27 () {58 vars in 1463 bytes} [Sun Jul 24 01:25:40 2022] GET /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/inherited_to_projects => generated 447 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:40.506585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046375b-3dd3-46a0-8225-1e630c900521 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.528966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.530635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.530923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.531211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.537701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=db124601877b421cb1a2976564c9fad2, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=d003fa913c9a49c08290077d8ca716e3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.542697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.560232 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2178/4306] 10.222.0.27 () {58 vars in 1563 bytes} [Sun Jul 24 01:25:40 2022] HEAD /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:40.564394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.593962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3b6-640f-452c-a4ba-98e89a0a2617 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.602833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.604793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.605194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.605590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.609603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=db124601877b421cb1a2976564c9fad2, group_id=87b03e9dad7541cd8351f112e756e2d9, role_id=d003fa913c9a49c08290077d8ca716e3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.613275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:40.626781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role d003fa913c9a49c08290077d8ca716e3 was removed from group 87b03e9dad7541cd8351f112e756e2d9 on domain db124601877b421cb1a2976564c9fad2. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:40.627233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:40.628094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7fb9ee2e-5fae-42bd-b5a8-cd2acab277f4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:40.654535 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2129/4307] 10.222.0.27 () {58 vars in 1565 bytes} [Sun Jul 24 01:25:40 2022] DELETE /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/groups/87b03e9dad7541cd8351f112e756e2d9/roles/d003fa913c9a49c08290077d8ca716e3/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:40.658692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:40.661178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:40.691103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897dc1-c030-437f-afcf-7acfc0d150d1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:40.746464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.747031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.747031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.897262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:40.903654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:40.909929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:40.913289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:40.914691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:40.914785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/d003fa913c9a49c08290077d8ca716e3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:40.918059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d003fa913c9a49c08290077d8ca716e3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:40.924459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.021154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role d003fa913c9a49c08290077d8ca716e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:41.022887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:41.026289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:41.029961 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2179/4308] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:40 2022] DELETE /identity/v3/roles/d003fa913c9a49c08290077d8ca716e3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:41.044454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.047029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:41.077957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2130/4309] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:41.224718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.226633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:41.290048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824e63-5113-4740-a4fa-adcb2af56e4f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.292570 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:41.308551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.310043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.310773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.311791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.314340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.321753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.353029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2180/4310] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:41 2022] POST /identity/v3/roles => generated 240 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:41.362604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.408561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f6dd-b6f6-4883-9911-7c15e17fd1f3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.418427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.419751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.420255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.420708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.423763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=6409933f9bae41a38194c251abfd81fb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.435894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.457700 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:41.467588 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2181/4311] 10.222.0.27 () {60 vars in 1578 bytes} [Sun Jul 24 01:25:41 2022] PUT /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:41.472605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.496425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5475f0e-7786-43ef-a1e0-905121f64821 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.651881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5441d-f5de-4bb7-9cf0-49f896ad1bef tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.658577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.659577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.660088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.660434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.663450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.665007 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:41.665007 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:41.665007 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:41.667837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.684696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.685659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.686651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.687100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.700808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2182/4312] 10.222.0.27 () {58 vars in 1460 bytes} [Sun Jul 24 01:25:41 2022] GET /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/inherited_to_projects => generated 447 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:41.705520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.729854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243f81-bcc3-4f5a-b0d4-8cb617b7a718 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.743242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.745360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.745522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.747954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.751356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=6409933f9bae41a38194c251abfd81fb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.754849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.772732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2183/4313] 10.222.0.27 () {58 vars in 1560 bytes} [Sun Jul 24 01:25:41 2022] HEAD /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:41.780255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.807275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31af44-ab00-4a53-b0f1-22669e19b88b tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:41.826866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.830701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.834153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:41.835027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:41.835308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:41.835675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:41.838440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=6409933f9bae41a38194c251abfd81fb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:41.839789 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:41.839789 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:41.839789 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:41.842012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:41.845562 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2131/4314] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:25:41.849630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 6409933f9bae41a38194c251abfd81fb was removed from user f5f66345f8694544b4160ef73c8b583d on domain db124601877b421cb1a2976564c9fad2. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:41.849853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:41.850602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:41.901994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:41.903991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2184/4315] 10.222.0.27 () {58 vars in 1562 bytes} [Sun Jul 24 01:25:41 2022] DELETE /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/6409933f9bae41a38194c251abfd81fb/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:41.925104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856aed-adbb-48ee-ad69-fa0b67079a55 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:42.076945 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:42.123512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:42.130770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:42.131202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:42.131586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/6409933f9bae41a38194c251abfd81fb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:42.133428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6409933f9bae41a38194c251abfd81fb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:42.136166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:42.254073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 6409933f9bae41a38194c251abfd81fb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:42.254489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:42.262302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:42.271547 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2132/4316] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:41 2022] DELETE /identity/v3/roles/6409933f9bae41a38194c251abfd81fb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:42.277082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:42.278541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:42.305105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ebfd2-b3db-40a2-97a3-e33147d23da0 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:42.437505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:42.438451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:42.438835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:42.439215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:42.440072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:42.441812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:42.469544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2185/4317] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:42 2022] POST /identity/v3/roles => generated 239 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:42.473334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:42.474930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:42.501869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e186b-57d3-4160-b898-a0a4c44995e3 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:42.530096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:42.531103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:42.531397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:42.531676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:42.532398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:42.534398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:42.613711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2133/4318] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:42 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:42.616972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:42.634616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbb765-c695-4a2e-bafe-115f3f0aa798 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:42.735049 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:42.750916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:42.752387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:42.752683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:42.778404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/a0345b42527140db9795a09d9813284c/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:42.787257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=a0345b42527140db9795a09d9813284c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:42.790971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:42.825234 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2186/4319] 10.222.0.27 () {60 vars in 1578 bytes} [Sun Jul 24 01:25:42 2022] PUT /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/a0345b42527140db9795a09d9813284c/inherited_to_projects => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:42.830494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:42.842778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6600-220f-4b65-a3ea-5ebac13f1dfe tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:42.994958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:42.995962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:42.996332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:42.996711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:42.997817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=1995908143d4403d87534a39fbdc6b99, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:42.998373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.000768 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:43.000768 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:43.000768 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:43.004644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:43.144072 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2134/4320] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:42 2022] GET /identity/v3/role_assignments?scope.project.id=1995908143d4403d87534a39fbdc6b99&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 648 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:43.148507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.165758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e0ce-892e-4723-a393-c192d1961ead tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.179974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.180797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.181044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.182991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.185454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=5d9347e9c01d48a1954aa5a5fe4502b3, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:43.185839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.186996 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:43.186996 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:43.186996 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:43.194984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:43.334062 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2187/4321] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:43 2022] GET /identity/v3/role_assignments?scope.project.id=5d9347e9c01d48a1954aa5a5fe4502b3&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 648 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:43.338595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.354440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc5d9-166d-46df-a017-c16f4186fe26 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.367830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.369167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.369467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.369981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/a0345b42527140db9795a09d9813284c/inherited_to_projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.375820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=db124601877b421cb1a2976564c9fad2, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=a0345b42527140db9795a09d9813284c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.382666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:43.397262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role a0345b42527140db9795a09d9813284c was removed from user f5f66345f8694544b4160ef73c8b583d on domain db124601877b421cb1a2976564c9fad2. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:43.397592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:43.406098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:43.424310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2135/4322] 10.222.0.27 () {58 vars in 1562 bytes} [Sun Jul 24 01:25:43 2022] DELETE /identity/v3/OS-INHERIT/domains/db124601877b421cb1a2976564c9fad2/users/f5f66345f8694544b4160ef73c8b583d/roles/a0345b42527140db9795a09d9813284c/inherited_to_projects => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:43.428787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.430773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:43.455964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495b70-692b-4386-829e-69faf70ea1ae tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.595165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.596165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.596680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.597351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.598652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=1995908143d4403d87534a39fbdc6b99, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:43.599215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.602089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:43.716183 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2188/4323] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:43 2022] GET /identity/v3/role_assignments?scope.project.id=1995908143d4403d87534a39fbdc6b99&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 228 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:25:43.717470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.733475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b0694-4015-499f-9d19-9c63cc8da4c6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.749066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.750264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.750465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.750881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.751743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=5d9347e9c01d48a1954aa5a5fe4502b3, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:43.752058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.753971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:43.804595 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:43.875326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2136/4324] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:43 2022] GET /identity/v3/role_assignments?scope.project.id=5d9347e9c01d48a1954aa5a5fe4502b3&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 228 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:43.879982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.942521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829f7a-b584-43ea-96f3-137eaf29d511 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.973440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.975908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.977979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.978317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects/5d9347e9c01d48a1954aa5a5fe4502b3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.980304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d9347e9c01d48a1954aa5a5fe4502b3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:43.983643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.152452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9347e9c01d48a1954aa5a5fe4502b3', 'request_id': 'req-4dc49714-4eec-4025-b1e6-8cfcbc689463'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.173000 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:44.182540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9347e9c01d48a1954aa5a5fe4502b3', 'request_id': 'req-4dc49714-4eec-4025-b1e6-8cfcbc689463'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.207955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9347e9c01d48a1954aa5a5fe4502b3', 'request_id': 'req-4dc49714-4eec-4025-b1e6-8cfcbc689463'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.242646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] The token cache is being invalidate because project 5d9347e9c01d48a1954aa5a5fe4502b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:44.243491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.244693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.253585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2189/4325] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:43 2022] DELETE /identity/v3/projects/5d9347e9c01d48a1954aa5a5fe4502b3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:44.254881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:44.256903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:44.282689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bb0b8-eac3-432d-9408-45178b175bba tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:44.413118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:44.418145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:44.418444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:44.418729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/a0345b42527140db9795a09d9813284c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:44.420372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a0345b42527140db9795a09d9813284c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:44.423284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.485280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role a0345b42527140db9795a09d9813284c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:44.485585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.486246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:44.488710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2137/4326] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:44 2022] DELETE /identity/v3/roles/a0345b42527140db9795a09d9813284c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:44.494429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:44.506972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc49714-4eec-4025-b1e6-8cfcbc689463 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:44.593429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:44.595252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:44.595649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:44.596098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:44.597303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:44.599032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.630039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2190/4327] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:25:44 2022] POST /identity/v3/roles => generated 239 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:44.632732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:44.634600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:44.660471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1bc3f-a716-4142-8166-64786f60c91d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:44.669660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:44.670505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:44.670889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:44.676499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:44.677368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:44.679639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.781726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2138/4328] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:44 2022] POST /identity/v3/projects => generated 409 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:44.786028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:44.802466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e93da-cf6b-49c6-b84b-2ee086f109aa tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:44.891499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:44.892638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:44.893029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:44.893448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/43560caaa6db4c03a0d48ddabbe2a0a3/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:44.897227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1995908143d4403d87534a39fbdc6b99, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=43560caaa6db4c03a0d48ddabbe2a0a3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:44.900447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.924002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2191/4329] 10.222.0.27 () {60 vars in 1581 bytes} [Sun Jul 24 01:25:44 2022] PUT /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/43560caaa6db4c03a0d48ddabbe2a0a3/inherited_to_projects => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:44.924463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:44.939533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1088fdb-ad3b-4dbd-aa4d-05d90fd78b4d tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:45.050888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:45.051671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:45.051960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:45.052241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:45.054284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=a3f3027a1388454aaa1daef698489168, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:45.054598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:45.058478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:45.095660 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:45.253119 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2139/4330] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:44 2022] GET /identity/v3/role_assignments?scope.project.id=a3f3027a1388454aaa1daef698489168&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 649 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:45.254666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:45.274965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab063d4-6a44-4f64-80f8-665680c6573f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:45.287464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:45.288964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:45.289626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:45.291274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/43560caaa6db4c03a0d48ddabbe2a0a3/inherited_to_projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:45.295502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1995908143d4403d87534a39fbdc6b99, user_id=f5f66345f8694544b4160ef73c8b583d, role_id=43560caaa6db4c03a0d48ddabbe2a0a3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:45.301638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:45.312480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 43560caaa6db4c03a0d48ddabbe2a0a3 was removed from user f5f66345f8694544b4160ef73c8b583d on project 1995908143d4403d87534a39fbdc6b99. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:45.313159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.316379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.353101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:45.354589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2192/4331] 10.222.0.27 () {58 vars in 1565 bytes} [Sun Jul 24 01:25:45 2022] DELETE /identity/v3/OS-INHERIT/projects/1995908143d4403d87534a39fbdc6b99/users/f5f66345f8694544b4160ef73c8b583d/roles/43560caaa6db4c03a0d48ddabbe2a0a3/inherited_to_projects => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:45.356077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:45.374931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b48ab-f69b-4007-a0f4-27e01c697dd4 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:45.576711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:45.577961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:45.578146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:45.578753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:45.579709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Adding query filter params (scope.project.id=a3f3027a1388454aaa1daef698489168, user.id=f5f66345f8694544b4160ef73c8b583d) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:45.586891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:45.590416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:45.716361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:45.731970 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2140/4332] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:25:45 2022] GET /identity/v3/role_assignments?scope.project.id=a3f3027a1388454aaa1daef698489168&user.id=f5f66345f8694544b4160ef73c8b583d&effective => generated 228 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:45.732502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748385-cddb-48a2-aea5-47dac88f87da tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:45.738283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:45.739173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:45.739456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:45.739731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects/a3f3027a1388454aaa1daef698489168` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:45.741013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3f3027a1388454aaa1daef698489168)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:45.743145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:45.827545 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:45.829302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f3027a1388454aaa1daef698489168', 'request_id': 'req-71448c56-21db-4977-ba8a-7f97afcde77f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.836170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f3027a1388454aaa1daef698489168', 'request_id': 'req-71448c56-21db-4977-ba8a-7f97afcde77f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.847153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f3027a1388454aaa1daef698489168', 'request_id': 'req-71448c56-21db-4977-ba8a-7f97afcde77f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.873737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] The token cache is being invalidate because project a3f3027a1388454aaa1daef698489168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:45.874148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.875840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:45.877910 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2193/4333] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:45 2022] DELETE /identity/v3/projects/a3f3027a1388454aaa1daef698489168 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:45.881849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:45.883662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:45.904428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fed65-71f0-453d-a51c-2354c01ce0ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:46.089495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:46.090543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:46.091149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:46.091448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/roles/43560caaa6db4c03a0d48ddabbe2a0a3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:46.117503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_role(role_id=43560caaa6db4c03a0d48ddabbe2a0a3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:46.124543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:46.209952 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:46.315120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invalidating the token cache because role 43560caaa6db4c03a0d48ddabbe2a0a3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:46.315865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.316990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.327125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:46.327936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2141/4334] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:45 2022] DELETE /identity/v3/roles/43560caaa6db4c03a0d48ddabbe2a0a3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:46.343867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448c56-21db-4977-ba8a-7f97afcde77f tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:46.498193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:46.499096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:46.502296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:46.502591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/users/f5f66345f8694544b4160ef73c8b583d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:46.503984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f5f66345f8694544b4160ef73c8b583d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:46.510933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:46.640627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f66345f8694544b4160ef73c8b583d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.642352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f66345f8694544b4160ef73c8b583d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.653384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f66345f8694544b4160ef73c8b583d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.663654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f66345f8694544b4160ef73c8b583d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.685188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f66345f8694544b4160ef73c8b583d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:46.694330 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2194/4335] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:46 2022] DELETE /identity/v3/users/f5f66345f8694544b4160ef73c8b583d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:46.699301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:46.700781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:46.715429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3c08-9e02-4632-8c8e-2669b193ed32 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:46.793883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:46.794986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:46.795379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:46.795838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/groups/87b03e9dad7541cd8351f112e756e2d9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:46.809942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_group(group_id=87b03e9dad7541cd8351f112e756e2d9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:46.828660 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:46.828660 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:46.828660 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:46.830201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:46.958099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:46.959967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2142/4336] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:25:46 2022] DELETE /identity/v3/groups/87b03e9dad7541cd8351f112e756e2d9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:46.962023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:46.982802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad0f4d-f597-4f3a-b895-e644b893f8ac tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.058414 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:47.075363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.076410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.077766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.078191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/projects/1995908143d4403d87534a39fbdc6b99` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.080292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1995908143d4403d87534a39fbdc6b99)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.082439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.226336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1995908143d4403d87534a39fbdc6b99', 'request_id': 'req-71dca4c5-df42-4110-88e9-5da97ca50e57'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.248984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1995908143d4403d87534a39fbdc6b99', 'request_id': 'req-71dca4c5-df42-4110-88e9-5da97ca50e57'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.270513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1995908143d4403d87534a39fbdc6b99', 'request_id': 'req-71dca4c5-df42-4110-88e9-5da97ca50e57'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.315389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] The token cache is being invalidate because project 1995908143d4403d87534a39fbdc6b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:47.315703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.317289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.320730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2195/4337] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:46 2022] DELETE /identity/v3/projects/1995908143d4403d87534a39fbdc6b99 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:47.325606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.327749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:47.368774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db7f77-1cbf-48a8-a088-4d775acc36d6 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.534582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.535485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.535770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.537008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/domains/db124601877b421cb1a2976564c9fad2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.546312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=db124601877b421cb1a2976564c9fad2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.546312 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:47.546312 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:47.546312 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:47.546312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.592235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.595456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.646223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.647335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.651314 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2143/4338] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:25:47 2022] PATCH /identity/v3/domains/db124601877b421cb1a2976564c9fad2 => generated 278 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:47.656018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.703514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca4c5-df42-4110-88e9-5da97ca50e57 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.840915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a4b68f417d488a9d3f987954f8b6b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82534141ca9d4277ad6226a7afdea064', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.842148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.842821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.843299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] PATH_INFO: `/v3/domains/db124601877b421cb1a2976564c9fad2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.870450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=db124601877b421cb1a2976564c9fad2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.871696 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:47.871696 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:47.871696 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:47.872533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.911366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.941250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'db124601877b421cb1a2976564c9fad2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.024642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.038929 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:48.043608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.061021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.081028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] The token cache is being invalidate because project db124601877b421cb1a2976564c9fad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:48.081318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.084022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.118710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.118710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.120881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-991132a2-fbdd-42c5-af26-d62afc2324b1 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'db124601877b421cb1a2976564c9fad2', 'request_id': 'req-991132a2-fbdd-42c5-af26-d62afc2324b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.164480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2196/4339] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:25:47 2022] DELETE /identity/v3/domains/db124601877b421cb1a2976564c9fad2 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:48.166450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:48.169092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:48.237997 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:48.476720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136fb2-b807-46f3-9eae-29a167f4b1a5 tempest-InheritsV3TestJSON-644772957 tempest-InheritsV3TestJSON-644772957-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:48.743139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:48.745252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.745537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.745985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] PATH_INFO: `/v3/users/707169f096ab423e943673131d89ecd5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.751907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707169f096ab423e943673131d89ecd5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:48.768729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:48.936537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707169f096ab423e943673131d89ecd5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.968575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707169f096ab423e943673131d89ecd5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:48.982613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707169f096ab423e943673131d89ecd5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:49.038778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707169f096ab423e943673131d89ecd5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:49.041520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707169f096ab423e943673131d89ecd5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:49.059712 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2144/4340] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:48 2022] DELETE /identity/v3/users/707169f096ab423e943673131d89ecd5 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:49.063997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:49.064485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:49.064606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:49.103082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:49.106110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:49.198874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2197/4341] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:49.349940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:49.351719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:49.528252 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:49.575455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb12cd6-ddda-474b-ae1e-588119601fc3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:49.587204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:49.588251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:49.588715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:49.589958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:49.633839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:49.642760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:49.665090 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2145/4342] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:51.131918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.133510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.278034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c2665-4505-4f46-8f60-282834bdbdf0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.293586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.295408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.296880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.298339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] PATH_INFO: `/v3/projects/ba17a6209d5c460aa62f4863f0e6a3e6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.302837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba17a6209d5c460aa62f4863f0e6a3e6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.309096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.442292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba17a6209d5c460aa62f4863f0e6a3e6', 'request_id': 'req-eca65d9d-4980-4174-bd4d-08913d5a9085'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.479925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba17a6209d5c460aa62f4863f0e6a3e6', 'request_id': 'req-eca65d9d-4980-4174-bd4d-08913d5a9085'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.507925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba17a6209d5c460aa62f4863f0e6a3e6', 'request_id': 'req-eca65d9d-4980-4174-bd4d-08913d5a9085'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.567165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] The token cache is being invalidate because project ba17a6209d5c460aa62f4863f0e6a3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:51.570754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.574868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.585243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2198/4343] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:51 2022] DELETE /identity/v3/projects/ba17a6209d5c460aa62f4863f0e6a3e6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:51.586482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.679577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991567-af50-43f4-afce-235e5792ecfd service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.872927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.873863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.874148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.874431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] PATH_INFO: `/v3/users/11a4b68f417d488a9d3f987954f8b6b4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.877636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a4b68f417d488a9d3f987954f8b6b4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.879751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.032200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a4b68f417d488a9d3f987954f8b6b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:52.055252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a4b68f417d488a9d3f987954f8b6b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:52.070905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a4b68f417d488a9d3f987954f8b6b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:52.114439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a4b68f417d488a9d3f987954f8b6b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:52.115236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4f3400dc-b3d4-46ab-bfc4-d40fe46a02ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a4b68f417d488a9d3f987954f8b6b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:52.129288 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2146/4344] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:51 2022] DELETE /identity/v3/users/11a4b68f417d488a9d3f987954f8b6b4 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:53.428008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:53.431694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:53.460877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65d9d-4980-4174-bd4d-08913d5a9085 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:53.483243 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:53.626344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:53.628282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.628282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.628282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] PATH_INFO: `/v3/projects/82534141ca9d4277ad6226a7afdea064` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.629761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82534141ca9d4277ad6226a7afdea064)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:53.635363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:53.773237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82534141ca9d4277ad6226a7afdea064', 'request_id': 'req-ae3f0437-ddd2-490c-a1d5-3634b710bff4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.802128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82534141ca9d4277ad6226a7afdea064', 'request_id': 'req-ae3f0437-ddd2-490c-a1d5-3634b710bff4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.830825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82534141ca9d4277ad6226a7afdea064', 'request_id': 'req-ae3f0437-ddd2-490c-a1d5-3634b710bff4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.876189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] The token cache is being invalidate because project 82534141ca9d4277ad6226a7afdea064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:53.876411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.882057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae3f0437-ddd2-490c-a1d5-3634b710bff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.896509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2199/4345] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:53 2022] DELETE /identity/v3/projects/82534141ca9d4277ad6226a7afdea064 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:53.901815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.902772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.903532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.334136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:54.336874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.386720 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:54.470161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2147/4346] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:54.476501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.477358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.477861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.539162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:54.540438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.591082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.592476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2200/4347] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:54.607312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31c1c-d7e3-46b4-97db-84ec577c7018 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.620394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.621091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.621361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.621637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.622418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:54.622732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.624379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.661331 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2148/4348] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:25:54.661718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.677461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1bb53-a26a-4286-ab9f-cb9aa4a30096 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.697806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.698640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.698920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.699189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.701152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.708514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.778790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.786035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2201/4349] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:54.791480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e372d9-9b1a-4ffa-9896-1176a7def5c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.920323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.921108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.921268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.921543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.922329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.924466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.984179 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2149/4350] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:54.988205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.002781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f14b-ed62-4b0d-9e0f-a22608ff8c69 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.019021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.019677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.020138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.020416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.021164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.022997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.036145 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2202/4351] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:55.043957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.068098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662f73e-7d72-4ee4-a6b6-931eb7ec4399 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.089423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.091636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.092132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.092631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.093566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.095450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6ec04-41e5-4cb7-a891-3f1be19cdf0a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.111345 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2150/4352] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:55.116232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.217299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a121e-b551-4064-a031-b4f6e87ea8c2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.225357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.226427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.226813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.227086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] PATH_INFO: `/v3/projects/8064857fde074315827e6627ef8771f9/users/835b02d14a5a4733bcb2174606779f67/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.279997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8064857fde074315827e6627ef8771f9, user_id=835b02d14a5a4733bcb2174606779f67, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.303088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.340306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2203/4353] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:55 2022] PUT /identity/v3/projects/8064857fde074315827e6627ef8771f9/users/835b02d14a5a4733bcb2174606779f67/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:55.342161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.342458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.342740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.406636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] MFA Rules not processed for user `835b02d14a5a4733bcb2174606779f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:55.408132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:55.567193 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2151/4354] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:55.573044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.678156 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:55.724555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9208-3042-4ecc-92be-906cb5f1fc92 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.740206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.741358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.741736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.742113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.742922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.745477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.824366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2204/4355] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/projects => generated 369 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:55.828672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.847576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c4a8-a5cb-411d-8461-7997d6d9422a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.918033 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:56.039778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.040384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.041334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.041573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.042271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.050575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.114996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2152/4356] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:56.119431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.137272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3e6ef-0494-415e-bb59-abbe9a783790 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.174949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.176785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.177236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.177837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.180793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.184664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.236805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2205/4357] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:56.240464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.268968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535179b-bb49-456a-9b28-3b31c7a6dd57 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.281558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.282502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.282783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.283055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] PATH_INFO: `/v3/projects/ffdb6888bd094b7788568250641da274/users/bf7faab814d445e1989306ec087cf551/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.356939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdb6888bd094b7788568250641da274, user_id=bf7faab814d445e1989306ec087cf551, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.366482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.407752 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2153/4358] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:56 2022] PUT /identity/v3/projects/ffdb6888bd094b7788568250641da274/users/bf7faab814d445e1989306ec087cf551/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:56.409229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.434699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e78ef-51c2-4734-980c-11f78020990c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.625411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.626595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.626595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.626937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.627546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.629021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ab0f9-f9f0-493c-b35f-e0594824b3ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.652844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2206/4359] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:56.657077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.671228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b04a-40fc-4dc3-a32b-1ad4792d7ad8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.686874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.688116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.689904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.690359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] PATH_INFO: `/v3/projects/ffdb6888bd094b7788568250641da274/users/bf7faab814d445e1989306ec087cf551/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.697795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdb6888bd094b7788568250641da274, user_id=bf7faab814d445e1989306ec087cf551, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.702559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.726114 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2154/4360] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:56 2022] PUT /identity/v3/projects/ffdb6888bd094b7788568250641da274/users/bf7faab814d445e1989306ec087cf551/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:56.738295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.739767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.739767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.842973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] MFA Rules not processed for user `bf7faab814d445e1989306ec087cf551`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:56.847787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:57.114519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.129984 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2207/4361] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:57.141436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d981b-353b-4bfa-a25b-23bdc9f8d453 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.159869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.160554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.160840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.161116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.162905 n-d-master-1 devstack@keystone.service[80591]: WARNING oslo_log.versionutils [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.162905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.177148 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.177148 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:57.177148 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:57.183293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.232883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.233146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2155/4362] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/policies => generated 230 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:57.246065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76fcf4-4a35-42df-9889-1a9f54ba7410 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.263896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.265134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.265528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.265962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/b81920d74aea4d4daba85ad316846b06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.267123 n-d-master-1 devstack@keystone.service[80590]: WARNING oslo_log.versionutils [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.268093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=b81920d74aea4d4daba85ad316846b06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.269267 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.269267 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:57.269267 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:57.270453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.312977 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2208/4363] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:25:57 2022] PATCH /identity/v3/policies/b81920d74aea4d4daba85ad316846b06 => generated 237 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:57.317524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.331767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382fc0-e96a-48f2-a1f7-abd761fe0012 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.356746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.361131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.361530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.362026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/b81920d74aea4d4daba85ad316846b06` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.364358 n-d-master-1 devstack@keystone.service[80591]: WARNING oslo_log.versionutils [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.367336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=b81920d74aea4d4daba85ad316846b06)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.371129 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.371129 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:25:57.371129 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:25:57.374770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.396577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2156/4364] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:25:57 2022] GET /identity/v3/policies/b81920d74aea4d4daba85ad316846b06 => generated 237 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:57.397723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.419229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e057daf-7200-48b6-abd5-f1496ca9f7cd tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.435593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.436767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.441269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.441605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/b81920d74aea4d4daba85ad316846b06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.442517 n-d-master-1 devstack@keystone.service[80590]: WARNING oslo_log.versionutils [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.443432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b81920d74aea4d4daba85ad316846b06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.444711 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.444711 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:57.444711 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:57.445620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.505582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.508023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2209/4365] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:57 2022] DELETE /identity/v3/policies/b81920d74aea4d4daba85ad316846b06 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:57.522091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489903d3-c48d-4cd9-9b9f-33af7ccb3c98 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.533100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.534347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.534863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.535356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.537050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.540126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.581851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.584383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2157/4366] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/policies => generated 228 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:57.597643 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:57.617776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286496d9-cdc1-4158-9fdb-fca0fd79575c tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.644892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.645631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.645881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.646160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.649373 n-d-master-1 devstack@keystone.service[80590]: WARNING oslo_log.versionutils [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.655319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.656736 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.656736 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:57.656736 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:57.659489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.723470 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2210/4367] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/policies => generated 228 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:57.727900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.746661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83df5a-c354-4b40-aa29-e37db7158891 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.758273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.761966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.762389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.762782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.764187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.769701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57e9e-cac7-4389-99b9-a0a3b4aa9958 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.815203 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2158/4368] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/policies => generated 229 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:57.819394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.843876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.844173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.844462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.846481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3453c0-72b8-4908-8e86-4f7ecb0df1d8 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.859000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.860003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.860483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.861078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.862249 n-d-master-1 devstack@keystone.service[80590]: WARNING oslo_log.versionutils [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 24 01:25:57.863043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.865545 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:25:57.865545 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:25:57.865545 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:25:57.868082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] MFA Rules not processed for user `5ab27e46e8534384abea2875fb9946df`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:57.869433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.870360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:57.891700 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2211/4369] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:25:57 2022] GET /identity/v3/policies => generated 761 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:57.894773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.925690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d990733-9087-4adf-99a4-a9f8e35b0a00 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.947566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.950789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.951679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.952117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/6cd95d339f6640a2b97f9d503cb4f75c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.957425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6cd95d339f6640a2b97f9d503cb4f75c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.964804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.998096 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2212/4370] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:57 2022] DELETE /identity/v3/policies/6cd95d339f6640a2b97f9d503cb4f75c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.002314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.034938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4a2a-921c-4a50-8d64-450eeae13673 tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.049872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.050762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.051044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.051322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/5f4ef0002b804c67b312a89e25413aa4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.052504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=5f4ef0002b804c67b312a89e25413aa4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.079464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.145943 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2213/4371] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:58 2022] DELETE /identity/v3/policies/5f4ef0002b804c67b312a89e25413aa4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:58.157335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.184046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72aecf-de1d-441b-b11b-2586f12f2bfb tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.187971 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2159/4372] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:58.203065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7faab814d445e1989306ec087cf551', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffdb6888bd094b7788568250641da274', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.203847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.204130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.204409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] PATH_INFO: `/v3/policies/876bbfc657a44abbb432b6c4d8924d1b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.205572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=876bbfc657a44abbb432b6c4d8924d1b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.217423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744b67a-43e8-4497-b03a-d49eb10f514a tempest-PoliciesTestJSON-1898902738 tempest-PoliciesTestJSON-1898902738-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.254121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2214/4373] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:58 2022] DELETE /identity/v3/policies/876bbfc657a44abbb432b6c4d8924d1b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.260612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.365221 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:58.442368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3baea-133b-479f-aa69-002d2a058a76 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.449376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.450820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.469335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.469626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] PATH_INFO: `/v3/users/835b02d14a5a4733bcb2174606779f67` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.472069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835b02d14a5a4733bcb2174606779f67)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.475153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.589465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835b02d14a5a4733bcb2174606779f67'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:58.609474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835b02d14a5a4733bcb2174606779f67'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:58.618997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835b02d14a5a4733bcb2174606779f67'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:58.634840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835b02d14a5a4733bcb2174606779f67'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:58.635654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835b02d14a5a4733bcb2174606779f67'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:58.648829 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2160/4374] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:58 2022] DELETE /identity/v3/users/835b02d14a5a4733bcb2174606779f67 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.650626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.651430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.651430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.681474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:58.683101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:58.817561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2215/4375] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:58.842551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.845731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:59.073746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c255-27ff-4b22-b285-0f3c6ab64084 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:59.084785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:59.085472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.088504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.088790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.141256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:59.142839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:59.171382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2161/4376] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:00.166956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:00.168546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:00.199225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb502e-4b29-4612-97ff-ad69d81044f3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:00.204740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:00.205776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.206061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.206337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] PATH_INFO: `/v3/projects/8064857fde074315827e6627ef8771f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.208682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8064857fde074315827e6627ef8771f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:00.211019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:00.322537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8064857fde074315827e6627ef8771f9', 'request_id': 'req-08990c7d-9926-4ee1-b3c3-40d73b943d1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.348272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8064857fde074315827e6627ef8771f9', 'request_id': 'req-08990c7d-9926-4ee1-b3c3-40d73b943d1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.383483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8064857fde074315827e6627ef8771f9', 'request_id': 'req-08990c7d-9926-4ee1-b3c3-40d73b943d1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.409537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] The token cache is being invalidate because project 8064857fde074315827e6627ef8771f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:00.409866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.411447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.413565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2216/4377] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:00 2022] DELETE /identity/v3/projects/8064857fde074315827e6627ef8771f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:00.418025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:00.432725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2da4-cd4c-4d4d-a2f1-4ea6df4f5935 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:00.489988 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:00.554726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:00.557965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.559329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.559931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] PATH_INFO: `/v3/users/bf7faab814d445e1989306ec087cf551` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.561489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7faab814d445e1989306ec087cf551)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:00.564231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:00.720763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7faab814d445e1989306ec087cf551'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.734434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7faab814d445e1989306ec087cf551'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.751702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7faab814d445e1989306ec087cf551'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.790245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7faab814d445e1989306ec087cf551'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.792519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e2e2ecc-408e-48f1-9944-818f558a0b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7faab814d445e1989306ec087cf551'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.816880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2162/4378] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:00 2022] DELETE /identity/v3/users/bf7faab814d445e1989306ec087cf551 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:02.005512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:02.007174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:02.029302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08990c7d-9926-4ee1-b3c3-40d73b943d1a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:02.066774 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:02.170847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:02.172318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.172870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.173401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] PATH_INFO: `/v3/projects/ffdb6888bd094b7788568250641da274` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.176665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdb6888bd094b7788568250641da274)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:02.180033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:02.307942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdb6888bd094b7788568250641da274', 'request_id': 'req-c1ab110b-21d5-4949-95b3-d4527318733e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:02.319436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdb6888bd094b7788568250641da274', 'request_id': 'req-c1ab110b-21d5-4949-95b3-d4527318733e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:02.334968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdb6888bd094b7788568250641da274', 'request_id': 'req-c1ab110b-21d5-4949-95b3-d4527318733e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:02.366921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] The token cache is being invalidate because project ffdb6888bd094b7788568250641da274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:02.367349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:02.368851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c1ab110b-21d5-4949-95b3-d4527318733e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:02.387314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.387919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.387919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.390524 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2217/4379] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:02 2022] DELETE /identity/v3/projects/ffdb6888bd094b7788568250641da274 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:02.423931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:02.431299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:02.577306 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2163/4380] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:02.586165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.586452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.586722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.616277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:02.617516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:02.638677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:02.645494 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2218/4381] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:02.652157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3273f2-6a15-4509-bd1c-7f97726a93d3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:02.657471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:02.658619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.659101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.659545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.660564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:02.661058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:02.663737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:02.694864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:02.701404 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2164/4382] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:02.705849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b38-d625-4cbc-bdc3-189003b1e05d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:02.711515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:02.713048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.713524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.714197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.715214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:02.717361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:02.786909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2219/4383] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:02 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:02.791412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:02.803878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e42b1-8060-4c26-b385-a7ae85ef3b44 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:02.882089 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:02.956838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:02.957591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.957940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.958224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.958972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:02.961304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:03.015261 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2165/4384] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:02 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:03.022481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:03.045747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee73aa-6a2a-4a9a-9930-4e65d1e9e19e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:03.055591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:03.057032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.057434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.057859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.058701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:03.062586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:03.094490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:03.094810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2220/4385] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:03.135343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a37c9b-056b-4efb-88e0-cb37cbc88213 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:03.136795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:03.137275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.137553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.138007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.139122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:03.156942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b664de-b172-492e-b066-05685a4fb993 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:03.191639 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2166/4386] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:03.193375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:03.208188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68a7c-bb23-4d7a-87f7-5f431478f067 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:03.225887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:03.226862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.227142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.227612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] PATH_INFO: `/v3/projects/5f37837568904d39ae2e557139ff7f92/users/4ea49eebb04a4d32b9ba3f5e7784c2ce/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.250439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f37837568904d39ae2e557139ff7f92, user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:03.254043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:03.269935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2221/4387] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:03 2022] PUT /identity/v3/projects/5f37837568904d39ae2e557139ff7f92/users/4ea49eebb04a4d32b9ba3f5e7784c2ce/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:03.280379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.280767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.281115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.329914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] MFA Rules not processed for user `4ea49eebb04a4d32b9ba3f5e7784c2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:03.331442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:03.451850 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2167/4388] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:03.458815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:03.583664 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:03.622067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05580-e8a3-43d8-9628-5eea27ff598d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:03.627502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:03.628263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.628607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.628948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.629805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:03.631879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:03.700662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:03.701279 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2222/4389] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:03 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:03.723518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd68531-dc39-41a6-9ed7-e2037466972e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:03.944583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:03.945281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:03.945568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:03.946074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:03.947610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:03.966008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.010710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2168/4390] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:03 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:04.012009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.038856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c2e7-3d68-46df-ae98-2b246583378c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:04.046750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:04.047852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.048206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.048675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.049699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:04.051697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.070225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2223/4391] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:04.071484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.087591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1d909-17f5-416d-8a4a-7a4422a7454b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:04.108578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:04.108578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.111053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.111376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] PATH_INFO: `/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd/users/0cbba0ffd6fc41f79fbbb50737e02af4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.175929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b0fecf084b404f8deb2bd45ebf89fd, user_id=0cbba0ffd6fc41f79fbbb50737e02af4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:04.178824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.240520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2169/4392] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:04 2022] PUT /identity/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd/users/0cbba0ffd6fc41f79fbbb50737e02af4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:04.241681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.265948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a155b-21f0-4270-a031-6e230008e43c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:04.414336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:04.415289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.416922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.417325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.418321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:04.421311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8600f9-7881-4356-a47a-151373038a94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.450411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2224/4393] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:04.450615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.465578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805b98f-2027-4a8e-952a-63e9f69de235 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:04.489811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:04.490743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.491036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.491317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] PATH_INFO: `/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd/users/0cbba0ffd6fc41f79fbbb50737e02af4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.504884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b0fecf084b404f8deb2bd45ebf89fd, user_id=0cbba0ffd6fc41f79fbbb50737e02af4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:04.515095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.524087 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:04.563130 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2170/4394] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:04 2022] PUT /identity/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd/users/0cbba0ffd6fc41f79fbbb50737e02af4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:04.576454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.576918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.577325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.648748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] MFA Rules not processed for user `0cbba0ffd6fc41f79fbbb50737e02af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:04.650690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:04.828934 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2225/4395] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:04.833870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.849528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596112ca-5f06-469e-b80b-b0675de6d7cb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:04.857423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:04.858467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:04.858956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:04.859993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:04.860918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:04.865092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:04.938882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2171/4396] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:04 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:04.952686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:04.964423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e94bd-c0af-4532-9cc0-814241c11cb3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:05.023564 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:05.053580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:05.055299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:05.055751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:05.056579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:05.057597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:05.060058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:05.107921 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2226/4397] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:04 2022] POST /identity/v3/users => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:05.113228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:05.131200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b7aa-d0cb-4c0b-bdc5-b286d85f1ab2 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:05.143309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:05.146122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:05.146770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:05.147796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/71d95e374b404585a94292abb2588dbc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:05.170290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_user(user_id=71d95e374b404585a94292abb2588dbc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:05.174881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:05.177243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2172/4398] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:26:05 2022] GET /identity/v3/users/71d95e374b404585a94292abb2588dbc => generated 373 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:05.184575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:05.224831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849780-344f-4bf4-b342-45bde62e9aac tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:05.231404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:05.232332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:05.232915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:05.233237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/71d95e374b404585a94292abb2588dbc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:05.234775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_user(user_id=71d95e374b404585a94292abb2588dbc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:05.238423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:05.297312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d95e374b404585a94292abb2588dbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.298318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d95e374b404585a94292abb2588dbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.309440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d95e374b404585a94292abb2588dbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.319524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d95e374b404585a94292abb2588dbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.340618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d95e374b404585a94292abb2588dbc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.352586 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2227/4399] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:05 2022] DELETE /identity/v3/users/71d95e374b404585a94292abb2588dbc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:05.354384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:05.356616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:05.380939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd31f-e6c3-4d5d-afb9-72f486b166f1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:05.492997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:05.494780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:05.495071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:05.495355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/ce706300c2f34d579e7c6d869de35d3a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:05.496641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce706300c2f34d579e7c6d869de35d3a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:05.498692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:05.616567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce706300c2f34d579e7c6d869de35d3a', 'request_id': 'req-a5f1510c-b561-4c0a-bb72-41db0f049170'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.637936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce706300c2f34d579e7c6d869de35d3a', 'request_id': 'req-a5f1510c-b561-4c0a-bb72-41db0f049170'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.650914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce706300c2f34d579e7c6d869de35d3a', 'request_id': 'req-a5f1510c-b561-4c0a-bb72-41db0f049170'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.692606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] The token cache is being invalidate because project ce706300c2f34d579e7c6d869de35d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:05.693355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.694771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:05.697887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2173/4400] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:05 2022] DELETE /identity/v3/projects/ce706300c2f34d579e7c6d869de35d3a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:05.702965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:05.718581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6544a-2317-490c-b765-5f5bd81dec45 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:05.862001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:05.863304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:05.863961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:05.866011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:05.867869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:05.872392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:05.959478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2228/4401] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:05 2022] POST /identity/v3/projects => generated 359 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:05.961525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:05.963210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:05.984462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1510c-b561-4c0a-bb72-41db0f049170 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.073513 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:06.104961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.104961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.104961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.105750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.105750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.115326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.153731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2174/4402] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:05 2022] POST /identity/v3/users => generated 417 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:06.157409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.177146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070ed7a-db28-4ef3-bab8-998b2f9f39ba tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.186100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.187627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.193007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.193537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.194463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.196383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.219133 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2229/4403] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:26:06 2022] POST /identity/v3/roles => generated 240 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:06.224001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.237699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c8377-b673-4033-9672-f68907f71ed3 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.244976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.246269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.246559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.246844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.284607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_user(user_id=fa542cf8ae2a4db8bd78307fb507fa5b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.287804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.296702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.316518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2175/4404] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:26:06 2022] GET /identity/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b => generated 417 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:06.322421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6b715-3f38-40c0-964b-b00f9cb475c6 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.345538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.346709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.347193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.348176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/roles/2f601f8929cc46c7899de8cdf60cc0b5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.354256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_role(role_id=2f601f8929cc46c7899de8cdf60cc0b5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.357089 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:26:06.357089 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:26:06.357089 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:26:06.359381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.367607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.376474 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2230/4405] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:26:06 2022] GET /identity/v3/roles/2f601f8929cc46c7899de8cdf60cc0b5 => generated 240 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:06.383526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927d57-19a2-40f7-a3ba-1e41428d1b31 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.408581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.412415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.412926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.414110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.425258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.425258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.461959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2176/4406] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:06 2022] POST /identity/v3/projects => generated 360 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:06.469164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.479902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff226-577c-413d-bdbb-daedb1e42d07 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.489150 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:06.598558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.610135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.610443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.610726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/5ca1fd6b27384c7b809299d95942662f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.618850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_project(project_id=5ca1fd6b27384c7b809299d95942662f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.621755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.626052 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2231/4407] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:26:06 2022] GET /identity/v3/projects/5ca1fd6b27384c7b809299d95942662f => generated 360 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:06.630025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.642644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b84aa-8cf0-47f8-a1dc-9c82e6905938 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.653847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.655038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.655557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.655942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/5ca1fd6b27384c7b809299d95942662f/users/fa542cf8ae2a4db8bd78307fb507fa5b/roles/2f601f8929cc46c7899de8cdf60cc0b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.658442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1fd6b27384c7b809299d95942662f, user_id=fa542cf8ae2a4db8bd78307fb507fa5b, role_id=2f601f8929cc46c7899de8cdf60cc0b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.661401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.683486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2177/4408] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:06 2022] PUT /identity/v3/projects/5ca1fd6b27384c7b809299d95942662f/users/fa542cf8ae2a4db8bd78307fb507fa5b/roles/2f601f8929cc46c7899de8cdf60cc0b5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:06.688056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.704415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7af3-4bb6-4841-9387-7a7fa93939d0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:06.822954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:06.824047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:06.824548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:06.825039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:06.826093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:06.829136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:06.888895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2232/4409] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:06 2022] POST /identity/v3/projects => generated 358 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:06.892838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:06.908377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e20bf-2668-465d-a7ec-6966f9714a19 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.007725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.008772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.009784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.010192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/cb7376ad71714d16a42ea17dab83b147` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.011528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_project(project_id=cb7376ad71714d16a42ea17dab83b147)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.015272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.017386 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2178/4410] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:26:06 2022] GET /identity/v3/projects/cb7376ad71714d16a42ea17dab83b147 => generated 358 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:07.022062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.036841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651dc0b-1a4c-44ed-9e75-0d05d56c6413 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.043003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.044915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.045207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.046148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/cb7376ad71714d16a42ea17dab83b147/users/fa542cf8ae2a4db8bd78307fb507fa5b/roles/2f601f8929cc46c7899de8cdf60cc0b5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.047959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cb7376ad71714d16a42ea17dab83b147, user_id=fa542cf8ae2a4db8bd78307fb507fa5b, role_id=2f601f8929cc46c7899de8cdf60cc0b5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.052717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.085060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2233/4411] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:07 2022] PUT /identity/v3/projects/cb7376ad71714d16a42ea17dab83b147/users/fa542cf8ae2a4db8bd78307fb507fa5b/roles/2f601f8929cc46c7899de8cdf60cc0b5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:07.090680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.106273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3515b-e398-460b-b73e-cb0f7810a738 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.204778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.205858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.206215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.206564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.208030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=fa542cf8ae2a4db8bd78307fb507fa5b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.210794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.273047 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:07.290101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2179/4412] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:26:07 2022] GET /identity/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b/projects => generated 842 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:07.291963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.302884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fdf8-dacc-434c-941c-6ba6e1e5c02e tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.310509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.311390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.311677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.312018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/cb7376ad71714d16a42ea17dab83b147` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.313433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb7376ad71714d16a42ea17dab83b147)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.315894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.382623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7376ad71714d16a42ea17dab83b147', 'request_id': 'req-f77f46ae-bddc-4efd-b750-55dcab597d91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.390133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7376ad71714d16a42ea17dab83b147', 'request_id': 'req-f77f46ae-bddc-4efd-b750-55dcab597d91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.399459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7376ad71714d16a42ea17dab83b147', 'request_id': 'req-f77f46ae-bddc-4efd-b750-55dcab597d91'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.413788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] The token cache is being invalidate because project cb7376ad71714d16a42ea17dab83b147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:07.414188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.416130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.417641 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2234/4413] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:07 2022] DELETE /identity/v3/projects/cb7376ad71714d16a42ea17dab83b147 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:07.422380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.425240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:07.450623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7d0d7-7332-4a50-94f0-a86450c83ca9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.595745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.598499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.599187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.599592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/5ca1fd6b27384c7b809299d95942662f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.601048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ca1fd6b27384c7b809299d95942662f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.604564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.648230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.651250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:07.669266 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:07.698841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca1fd6b27384c7b809299d95942662f', 'request_id': 'req-ddac2921-d461-46d7-bcf3-dda58ac5b73a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.706521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca1fd6b27384c7b809299d95942662f', 'request_id': 'req-ddac2921-d461-46d7-bcf3-dda58ac5b73a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.714216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca1fd6b27384c7b809299d95942662f', 'request_id': 'req-ddac2921-d461-46d7-bcf3-dda58ac5b73a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.730296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] The token cache is being invalidate because project 5ca1fd6b27384c7b809299d95942662f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:07.731248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.731974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.734079 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2180/4414] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:07 2022] DELETE /identity/v3/projects/5ca1fd6b27384c7b809299d95942662f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:07.738817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.741388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:07.797303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f46ae-bddc-4efd-b750-55dcab597d91 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.864189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac2921-d461-46d7-bcf3-dda58ac5b73a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:07.871407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.872313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.872876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.873150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/roles/2f601f8929cc46c7899de8cdf60cc0b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.874762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2f601f8929cc46c7899de8cdf60cc0b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.876779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.893368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:07.894452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:07.894798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:07.895152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] PATH_INFO: `/v3/users/d82fd738d5bb4d5e838f67b0b76b3b56` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:07.896659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82fd738d5bb4d5e838f67b0b76b3b56)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:07.899114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:07.920151 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:07.931899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invalidating the token cache because role 2f601f8929cc46c7899de8cdf60cc0b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:07.932549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.934132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.937983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2181/4415] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:07 2022] DELETE /identity/v3/roles/2f601f8929cc46c7899de8cdf60cc0b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:07.942625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:07.945219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:07.967003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82fd738d5bb4d5e838f67b0b76b3b56'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.968807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82fd738d5bb4d5e838f67b0b76b3b56'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.981325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82fd738d5bb4d5e838f67b0b76b3b56'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:07.996141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82fd738d5bb4d5e838f67b0b76b3b56'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.020274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82fd738d5bb4d5e838f67b0b76b3b56'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.031154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2235/4416] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:07 2022] DELETE /identity/v3/users/d82fd738d5bb4d5e838f67b0b76b3b56 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:08.043634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a52ce-1a32-438f-9ee0-2e720b2dbb00 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.098793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.100729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.129652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.130915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.131273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.131710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.133372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fa542cf8ae2a4db8bd78307fb507fa5b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.136844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.162429 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:08.224540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa542cf8ae2a4db8bd78307fb507fa5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.233432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c389c-9328-4f12-ace3-a5b8ee02f2b5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.238052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa542cf8ae2a4db8bd78307fb507fa5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.240920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.241746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.242100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.242951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.245492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.247890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa542cf8ae2a4db8bd78307fb507fa5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.264776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa542cf8ae2a4db8bd78307fb507fa5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.264973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.267689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.270061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa542cf8ae2a4db8bd78307fb507fa5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.282299 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2182/4417] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:07 2022] DELETE /identity/v3/users/fa542cf8ae2a4db8bd78307fb507fa5b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:08.283431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.285552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.287508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2236/4418] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:26:08.323910 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:08.373649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.381991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.400235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a41ac-ff29-4344-a3b8-56178b8b40ea tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.406178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.407343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.407796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.408279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/38894ee00181444bbd036b4ecfc0fcfa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.409546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=38894ee00181444bbd036b4ecfc0fcfa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.411540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.468497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2afe-3774-45bc-9eba-c12855f35770 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.473633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38894ee00181444bbd036b4ecfc0fcfa', 'request_id': 'req-fd5828d1-d717-406c-a623-76776e7e2a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.482234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38894ee00181444bbd036b4ecfc0fcfa', 'request_id': 'req-fd5828d1-d717-406c-a623-76776e7e2a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.488710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38894ee00181444bbd036b4ecfc0fcfa', 'request_id': 'req-fd5828d1-d717-406c-a623-76776e7e2a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.505367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] The token cache is being invalidate because project 38894ee00181444bbd036b4ecfc0fcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:08.505635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.506659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.508581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2183/4419] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:08 2022] DELETE /identity/v3/projects/38894ee00181444bbd036b4ecfc0fcfa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:08.516363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.518164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.543625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.545790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.546265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.546619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] PATH_INFO: `/v3/projects/c60507837fec4e06bd0551093bceb959` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.548528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60507837fec4e06bd0551093bceb959)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.550583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.598474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5828d1-d717-406c-a623-76776e7e2a5d tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.608994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60507837fec4e06bd0551093bceb959', 'request_id': 'req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.626192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60507837fec4e06bd0551093bceb959', 'request_id': 'req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.631306 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:08.636844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60507837fec4e06bd0551093bceb959', 'request_id': 'req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.659000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] The token cache is being invalidate because project c60507837fec4e06bd0551093bceb959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:08.660261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.662038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.664990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2237/4420] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:08 2022] DELETE /identity/v3/projects/c60507837fec4e06bd0551093bceb959 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:08.669425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.672395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.677939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.679006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.680160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.680738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.683201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:update_user(user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.687053 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:26:08.687053 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:26:08.687053 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:26:08.687053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.689567 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:08.731514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.741405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invalidating the token cache because user 4ea49eebb04a4d32b9ba3f5e7784c2ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:08.743250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.744127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-98c4caee-f9f4-491e-aadd-1b14156431e0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.746565 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2184/4421] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:26:08 2022] PATCH /identity/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:08.750896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.751421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.751701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.767679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225a2e-41fc-4339-8dfa-9ff204e7f0f4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.773301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.775154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.775440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.776048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] PATH_INFO: `/v3/users/13ae58c891f04b258dbd2709ce7a32b6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.777496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ae58c891f04b258dbd2709ce7a32b6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.779636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.800838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] MFA Rules not processed for user `4ea49eebb04a4d32b9ba3f5e7784c2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:08.803489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.815424 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2185/4422] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:08 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:26:08.818333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.820744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.849296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a08d-7a05-4301-952d-cd51dfcfdab0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:08.858958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:08.860167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:08.860495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:08.860772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:08.862469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:update_user(user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:08.864678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:08.874127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ae58c891f04b258dbd2709ce7a32b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.874944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ae58c891f04b258dbd2709ce7a32b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.892354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ae58c891f04b258dbd2709ce7a32b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.904026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ae58c891f04b258dbd2709ce7a32b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.914530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.923271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec11f566-84b3-4049-b15d-3567ba806f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ae58c891f04b258dbd2709ce7a32b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.931803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invalidating the token cache because user 4ea49eebb04a4d32b9ba3f5e7784c2ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:08.932250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.933067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:08.936167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2186/4424] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:26:08 2022] PATCH /identity/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce => generated 297 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:08.936724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2238/4424] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:08 2022] DELETE /identity/v3/users/13ae58c891f04b258dbd2709ce7a32b6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:08.942694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:08.944264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:08.973625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ed74-792c-4924-a695-3eef72b6026a tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.061932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.062987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.063345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.063855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.094321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:update_user(user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.097130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.171557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.187894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invalidating the token cache because user 4ea49eebb04a4d32b9ba3f5e7784c2ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:09.188390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.189261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.192543 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2187/4425] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:26:08 2022] PATCH /identity/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:09.198482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.198823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.199093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.235944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.237459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.265693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] MFA Rules not processed for user `4ea49eebb04a4d32b9ba3f5e7784c2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:09.266871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.276386 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2239/4426] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 01:26:09.278636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.280301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.300567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269fb4b-c12f-4267-8d5e-7ece92c37896 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.307197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.308339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.308692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.308891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.310431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:update_user(user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.311654 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:26:09.311654 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:26:09.311654 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:26:09.313602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.331597 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:09.365258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd366b3-2655-4f35-b6fc-ac58139b43e9 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.366708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.371211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.372313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.372792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.373198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] PATH_INFO: `/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.374868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61c6d99deff4ac5a3d519d720cfb9f4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.376929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invalidating the token cache because user 4ea49eebb04a4d32b9ba3f5e7784c2ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:09.377428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.377550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.378087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.380436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2240/4427] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:26:09 2022] PATCH /identity/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce => generated 297 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:26:09.386816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.389187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.404195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f6fe0-3411-497d-af27-ae505f80db12 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.410414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.411103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.411386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.411821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.412655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.414750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.443236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2241/4428] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/users => generated 265 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:09.449801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.450784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61c6d99deff4ac5a3d519d720cfb9f4', 'request_id': 'req-674a837d-5c7b-465d-90de-b26bb5959888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.456933 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=12,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:09.457832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61c6d99deff4ac5a3d519d720cfb9f4', 'request_id': 'req-674a837d-5c7b-465d-90de-b26bb5959888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.466106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61c6d99deff4ac5a3d519d720cfb9f4', 'request_id': 'req-674a837d-5c7b-465d-90de-b26bb5959888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.476538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c71d-5069-4dca-840a-a8152e7c0724 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.487086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] The token cache is being invalidate because project f61c6d99deff4ac5a3d519d720cfb9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:09.487389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.488959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-674a837d-5c7b-465d-90de-b26bb5959888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.494301 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2188/4429] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:09 2022] DELETE /identity/v3/projects/f61c6d99deff4ac5a3d519d720cfb9f4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:09.502046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45470a7-e63c-4e76-9455-aa96ef53495c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.503422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45470a7-e63c-4e76-9455-aa96ef53495c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.503715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45470a7-e63c-4e76-9455-aa96ef53495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.534842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c45470a7-e63c-4e76-9455-aa96ef53495c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:09.536058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c45470a7-e63c-4e76-9455-aa96ef53495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.604844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.607845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.608138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.608416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/9ee95c73b1e448d1b71de30b705764f5/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.666789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2189/4430] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:09.674796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.675396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.676361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.728366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:09.745313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:09.776740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2190/4431] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:26:09.778382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.787357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:09.797483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd00caf-4687-4600-aeea-711b9eba1de0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.799306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2242/4432] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/users/9ee95c73b1e448d1b71de30b705764f5/password => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:09.804291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.804903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.805186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.805467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.807007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:09.807318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.809720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.823949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2191/4433] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:09.829067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.848998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e79037-9bb6-4f02-b1b0-bb0feb7845d5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:09.861413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:09.862123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:09.862401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:09.862677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:09.863399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:09.865524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:09.918250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2243/4434] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:09.922467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:09.938594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe7e4-1162-4238-b42b-b7ee327432e8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:10.073290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:10.074388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.074954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.075551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.076665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:10.079501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:10.090195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:10.106646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2192/4435] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:09 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:10.110774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:10.132458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbcbe7-f790-45d6-b831-4e66b5a71b18 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:10.140730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:10.142639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.143194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.143685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.144542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:10.146916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:10.161899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2244/4436] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:26:10.166108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:10.181039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2735c9-7370-4fac-aed0-fa0ffe42babb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:10.186767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:10.187600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.187888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.188169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.188945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:10.190600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6624e-0da9-475e-ba5e-422de5253168 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:10.205995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2193/4437] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:10.207813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:10.220202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbc67-8f1f-4c19-88e2-17d576ec7616 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:10.225532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:10.226922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.227396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.227795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] PATH_INFO: `/v3/projects/a253ae01d6d8460abe1126aec263b625/users/cfca678863924bf9bd6ab0120b222800/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.254708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a253ae01d6d8460abe1126aec263b625, user_id=cfca678863924bf9bd6ab0120b222800, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:10.258740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:10.283088 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2245/4438] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:10 2022] PUT /identity/v3/projects/a253ae01d6d8460abe1126aec263b625/users/cfca678863924bf9bd6ab0120b222800/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:10.288025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8fcb-36b0-424e-a1a4-44d87da6b797 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.288669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8fcb-36b0-424e-a1a4-44d87da6b797 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.289146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8fcb-36b0-424e-a1a4-44d87da6b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.315303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e8f8fcb-36b0-424e-a1a4-44d87da6b797 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:10.316861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e8f8fcb-36b0-424e-a1a4-44d87da6b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:10.421751 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2194/4439] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:10.434560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:10.436534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:10.517798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43078c-7f75-41c3-9508-42963bb71f1a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:10.522181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:10.523292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.523292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.523515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.535440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:10.537085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:10.553646 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2246/4440] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:10.806821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:10.807811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:10.808572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:10.839924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] MFA Rules not processed for user `9ee95c73b1e448d1b71de30b705764f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:10.841147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:10.845183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2195/4441] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:10 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:26:10.849357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:10.850829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:10.866533 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:11.041886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e7f9-d5a9-4a6c-9018-d5c394ee9fef service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.054478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.055226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.055670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.056325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:11.072761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:11.075772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:11.086401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2247/4442] 10.222.0.27 () {56 vars in 1262 bytes} [Sun Jul 24 01:26:10 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 01:26:11.091461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:11.157482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d5d94-f188-4ac1-a0f0-de959d00b38a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.182270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.184510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.185937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.186245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/9ee95c73b1e448d1b71de30b705764f5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:11.190672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9ee95c73b1e448d1b71de30b705764f5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:11.198221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:11.339060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:11.356270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:11.367618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:11.393442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:11.394416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee95c73b1e448d1b71de30b705764f5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:11.402003 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2196/4443] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:11 2022] DELETE /identity/v3/users/9ee95c73b1e448d1b71de30b705764f5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:11.407066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:11.419739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87d8d-985a-4e09-b7c9-004c9820bdc1 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.496656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.497972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.498789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.500380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:11.501212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:11.504040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:11.573654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2248/4444] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:11 2022] POST /identity/v3/users => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:11.575091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:11.576932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:11.595319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacffe0c-f5e5-4549-b4be-0eaedd5a6b70 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.623451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.624145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.624434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.629903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:11.631902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:11.638032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:11.741376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:11.746060 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2197/4445] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:11 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:11.756090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9ec5-fe83-4339-ae33-1277dab946cb tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.854250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.855122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.855406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.855687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/f73261ca036f4775bfc621871d03e19f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:11.894936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:update_user(user_id=f73261ca036f4775bfc621871d03e19f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:11.897093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:11.954541 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:11.963226 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2249/4446] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Jul 24 01:26:11 2022] PATCH /identity/v3/users/f73261ca036f4775bfc621871d03e19f => generated 522 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:11.964473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:11.982456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c50c-080f-4462-85a2-dacf82b8d4f5 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:11.995237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:11.996791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:11.997783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:11.998197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/f73261ca036f4775bfc621871d03e19f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:12.022733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:get_user(user_id=f73261ca036f4775bfc621871d03e19f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:12.026449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:12.031021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2198/4447] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:26:11 2022] GET /identity/v3/users/f73261ca036f4775bfc621871d03e19f => generated 389 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:26:12.034857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:12.046732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08a8a0-ac44-43a2-8e3d-5b5601ac3969 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:12.057234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:12.058156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:12.058439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:12.059309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/projects/f337532684a94745a4ae8f33c489ed7a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:12.060012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f337532684a94745a4ae8f33c489ed7a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:12.061989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:12.211452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f337532684a94745a4ae8f33c489ed7a', 'request_id': 'req-e6abbb34-437b-4c24-b3f2-ad234a0eb952'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.226746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f337532684a94745a4ae8f33c489ed7a', 'request_id': 'req-e6abbb34-437b-4c24-b3f2-ad234a0eb952'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.241594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f337532684a94745a4ae8f33c489ed7a', 'request_id': 'req-e6abbb34-437b-4c24-b3f2-ad234a0eb952'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.273263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] The token cache is being invalidate because project f337532684a94745a4ae8f33c489ed7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:12.273841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.280635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.284134 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2250/4448] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:12 2022] DELETE /identity/v3/projects/f337532684a94745a4ae8f33c489ed7a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:12.288453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:12.290637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:12.313544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0fe1-670d-494d-8baa-4ed0b2e13fc0 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:12.337857 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:12.494934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbba0ffd6fc41f79fbbb50737e02af4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b0fecf084b404f8deb2bd45ebf89fd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:12.496044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:12.496431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:12.499174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] PATH_INFO: `/v3/users/f73261ca036f4775bfc621871d03e19f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:12.502564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f73261ca036f4775bfc621871d03e19f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:12.505821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:12.579279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73261ca036f4775bfc621871d03e19f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.594591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73261ca036f4775bfc621871d03e19f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.608387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73261ca036f4775bfc621871d03e19f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.638782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73261ca036f4775bfc621871d03e19f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.640372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e4b7aa12-4995-4fd7-bb8f-3f7922d5a201 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73261ca036f4775bfc621871d03e19f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:12.649299 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2199/4449] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:12 2022] DELETE /identity/v3/users/f73261ca036f4775bfc621871d03e19f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:12.654215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:12.655846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:12.799631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abbb34-437b-4c24-b3f2-ad234a0eb952 tempest-UsersV3TestJSON-1280695194 tempest-UsersV3TestJSON-1280695194-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:12.920556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:12.922640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:12.922931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:12.923232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] PATH_INFO: `/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:12.944616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea49eebb04a4d32b9ba3f5e7784c2ce)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:12.948337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:12.982215 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:13.032917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:13.033775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:13.046540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:13.060338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:13.081701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea49eebb04a4d32b9ba3f5e7784c2ce'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:13.093052 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2251/4450] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:12 2022] DELETE /identity/v3/users/4ea49eebb04a4d32b9ba3f5e7784c2ce => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:13.097214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:13.097760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:13.097760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:13.136754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:13.137716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:13.291871 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2200/4451] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:13.323353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:13.325151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:13.468772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4199-dd0f-4301-b34d-1ee4a9de9d84 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:13.478711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:13.479395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:13.479677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:13.480623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:13.509844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:13.511323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:13.517768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:13.537074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549efbba-31d0-45b6-9582-cdc2be2d615b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:13.547883 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2252/4452] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:13.548960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:13.549836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:13.550118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:13.550393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:13.554492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:13.581021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:13.582535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:13.605447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2201/4453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:13.860663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:13.862249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:13.986682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c19b-16ac-4bdd-ae87-fd8a95bac4ef service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:13.998809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:13.999487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:13.999855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:14.000059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:14.004841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:14.089453 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:14.132136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:14.136412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:14.185040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2253/4454] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:14.202450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:14.209338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:14.237868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887ec79-686e-48b4-a982-be84d2d3c642 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:14.246102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:14.246981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:14.247261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:14.247663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] PATH_INFO: `/v3/projects/5f37837568904d39ae2e557139ff7f92` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:14.249357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f37837568904d39ae2e557139ff7f92)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:14.251421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:14.267698 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:14.318940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f37837568904d39ae2e557139ff7f92', 'request_id': 'req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.328507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f37837568904d39ae2e557139ff7f92', 'request_id': 'req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.338236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f37837568904d39ae2e557139ff7f92', 'request_id': 'req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.359736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] The token cache is being invalidate because project 5f37837568904d39ae2e557139ff7f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:14.360609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.362888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.367024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2202/4455] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:14 2022] DELETE /identity/v3/projects/5f37837568904d39ae2e557139ff7f92 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:14.371887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:14.385587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06230e4d-0e54-4e88-a0d2-a8204b7f8871 service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:14.500952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:14.502541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:14.502826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:14.503259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] PATH_INFO: `/v3/users/0cbba0ffd6fc41f79fbbb50737e02af4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:14.504933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbba0ffd6fc41f79fbbb50737e02af4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:14.507571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:14.594432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbba0ffd6fc41f79fbbb50737e02af4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.595958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbba0ffd6fc41f79fbbb50737e02af4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.610588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbba0ffd6fc41f79fbbb50737e02af4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.633226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbba0ffd6fc41f79fbbb50737e02af4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.659424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b70d2b08-9b68-4e6a-855b-aad3e9577ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbba0ffd6fc41f79fbbb50737e02af4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:14.677735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2254/4456] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:14 2022] DELETE /identity/v3/users/0cbba0ffd6fc41f79fbbb50737e02af4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:16.595512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:16.597551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:16.624991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1b78-23e8-4e71-ba82-f770f092fbe3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:16.771530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:16.772565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:16.772850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:16.773120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] PATH_INFO: `/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:16.775075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b0fecf084b404f8deb2bd45ebf89fd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:16.781751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:16.919711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b0fecf084b404f8deb2bd45ebf89fd', 'request_id': 'req-7171437d-b460-4b08-a495-825858f12fd9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:16.937409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b0fecf084b404f8deb2bd45ebf89fd', 'request_id': 'req-7171437d-b460-4b08-a495-825858f12fd9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:16.944826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b0fecf084b404f8deb2bd45ebf89fd', 'request_id': 'req-7171437d-b460-4b08-a495-825858f12fd9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:16.972327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] The token cache is being invalidate because project 75b0fecf084b404f8deb2bd45ebf89fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:16.972622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:16.973300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7171437d-b460-4b08-a495-825858f12fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:16.976052 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2203/4457] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:16 2022] DELETE /identity/v3/projects/75b0fecf084b404f8deb2bd45ebf89fd => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:16.985040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:16.985487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:16.987592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.069160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:17.075729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:17.267100 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:17.344328 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2255/4458] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:17.353465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.354086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.354371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.422200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:17.423431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:17.450951 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2204/4459] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:17.455317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:17.472774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b69f1-af36-4bf2-bc55-7ec07f798ff4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:17.497721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:17.498401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.498684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.498964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.500602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:17.500952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:17.505584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:17.532997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2256/4460] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:17.533639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:17.548953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ec1d-c26f-4ccd-8a38-073d12e83524 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:17.553943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:17.554623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.554906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.555183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.555953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:17.562008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:17.614048 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:17.646547 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2205/4461] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:17 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:17.648052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:17.667333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54874-9051-48b1-8fce-cd1a12ee66c9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:17.872529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:17.875975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.876848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.879088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.880125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:17.886310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:17.937306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2257/4462] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:17 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:17.937800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:17.955356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb281d-9a05-4eb9-86bb-4bda970087c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:17.965383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:17.967813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.968558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.969178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.970302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:17.974084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:17.993273 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2206/4463] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:18.000499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.021134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d87f1-e520-412f-9935-0bf163736dd9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.033960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.034655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.034944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.035225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.036379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.037607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38962-5976-4454-9969-b6293a76c0ac admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.065177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.082221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2258/4464] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:18.086546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d17a-c6e6-4977-9efe-ec5c129b993e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.093361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.094692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.094989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.095274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] PATH_INFO: `/v3/projects/702feb8f4dc44945aa14d0d8c7b6f695/users/6caa37ee2a234d9385ac9baf89a63e16/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.144745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702feb8f4dc44945aa14d0d8c7b6f695, user_id=6caa37ee2a234d9385ac9baf89a63e16, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.147584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.193743 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2207/4465] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:18 2022] PUT /identity/v3/projects/702feb8f4dc44945aa14d0d8c7b6f695/users/6caa37ee2a234d9385ac9baf89a63e16/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:18.202962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.203946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.204267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.237493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] MFA Rules not processed for user `6caa37ee2a234d9385ac9baf89a63e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:18.238804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:18.358207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2259/4466] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:18.360510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.581186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369071-4762-4818-b77c-787f4caac481 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.623495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.626728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.628401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.628909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.632408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.640028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.732651 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2208/4467] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:18 2022] POST /identity/v3/projects => generated 369 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:18.734845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.752977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27884a6-b48e-47d8-9ab2-f93f39a91f7d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.865743 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:18.928045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.928817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.929229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.929618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.930642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.937048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.981468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2260/4468] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:18 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:18.987308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.045637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871cee-1312-460e-bde1-9602cffb8985 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.055961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.057831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.058582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.059292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.061531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.066062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.095901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2209/4469] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:19.100913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.126567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec90c6-1d46-4b9b-aa8d-01de114fa4d5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.143334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.145756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.145756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.145756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] PATH_INFO: `/v3/projects/12b9785e471643369020fab19df1e49c/users/d35d6218b34d40fda14465d80b96ea9d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.188374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b9785e471643369020fab19df1e49c, user_id=d35d6218b34d40fda14465d80b96ea9d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.191168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.221210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2261/4470] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:19 2022] PUT /identity/v3/projects/12b9785e471643369020fab19df1e49c/users/d35d6218b34d40fda14465d80b96ea9d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:19.223549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.276575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cc42b-fb8a-4062-8e5e-5f3f96b6cafc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.420895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.421588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.421894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.422163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.422907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.424944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be999066-dad2-4878-9ff1-4d8103629d3b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.453732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2210/4471] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:19.455516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.471624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56c2f-8d89-485c-a380-ec50716c4ed4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.485956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.487308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.487830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.488487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] PATH_INFO: `/v3/projects/12b9785e471643369020fab19df1e49c/users/d35d6218b34d40fda14465d80b96ea9d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.496260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b9785e471643369020fab19df1e49c, user_id=d35d6218b34d40fda14465d80b96ea9d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.499641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.528149 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2262/4472] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:19 2022] PUT /identity/v3/projects/12b9785e471643369020fab19df1e49c/users/d35d6218b34d40fda14465d80b96ea9d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:19.543721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.544104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.544313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.598796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] MFA Rules not processed for user `d35d6218b34d40fda14465d80b96ea9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:19.603024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:19.668414 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:19.817229 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2211/4473] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:19.818413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.846590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464456-917a-46b7-88db-046d7ed4c28f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.888384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.889378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.889871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.890329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.891220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.894250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.981303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2263/4474] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:19 2022] POST /identity/v3/projects => generated 358 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:19.988435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:20.009879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0059-db0d-455d-beef-fcc3e254559f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:20.250124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:20.250874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.251163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.251460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.252189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:20.254679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:20.310772 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2212/4475] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:19 2022] POST /identity/v3/users => generated 371 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:20.318739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:20.347543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec102a08-02bd-4741-bbf0-e5877bf3f81f tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:20.374383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:20.375601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.376113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.376638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.388731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:20.389062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:20.399892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:20.475090 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2264/4476] 10.222.0.27 () {58 vars in 1156 bytes} [Sun Jul 24 01:26:20 2022] GET /identity/v3/users?domain_id=default => generated 8295 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:20.483261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:20.533600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1464-bd07-4163-8911-ad741ab93b9e tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:20.560168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:20.561795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.566789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.567343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/users/3458ffe0f107419e86d57d6dfdef8cfa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.625441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:update_user(user_id=3458ffe0f107419e86d57d6dfdef8cfa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:20.628703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:20.647836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:20.650649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:20.706493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:20.727929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invalidating the token cache because user 3458ffe0f107419e86d57d6dfdef8cfa was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:20.728505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:20.729549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f8aa01b-ef2b-46a3-acef-7e6949daf26d tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:20.732773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2213/4477] 10.222.0.27 () {60 vars in 1243 bytes} [Sun Jul 24 01:26:20 2022] PATCH /identity/v3/users/3458ffe0f107419e86d57d6dfdef8cfa => generated 485 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:20.738064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.738550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.738970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.774475 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.auth.plugins.core [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] User is disabled: 3458ffe0f107419e86d57d6dfdef8cfa: AssertionError: User is disabled: 3458ffe0f107419e86d57d6dfdef8cfa Jul 24 01:26:20.793405 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.server.flask.application [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:26:20.795508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2214/4478] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 59 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 24 01:26:20.800691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:20.805127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:20.839321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811a75-fe2f-47ee-aa44-d30565302719 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:20.850162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:20.850843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.851133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.851503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.852134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb2953-d4c8-4f1b-bb6c-52e6f5abe516 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:20.856917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:20.872200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:20.873354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:20.873912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:20.874384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/users/3458ffe0f107419e86d57d6dfdef8cfa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:20.887307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:20.889262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:20.900686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3458ffe0f107419e86d57d6dfdef8cfa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:20.903172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:20.912912 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2265/4479] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:26:21.002001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.005594 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:21.025202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.042104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.061075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.062213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3458ffe0f107419e86d57d6dfdef8cfa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.070512 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2215/4480] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:20 2022] DELETE /identity/v3/users/3458ffe0f107419e86d57d6dfdef8cfa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:21.074675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.088950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4190-e63f-44d8-bfe1-816668faaf62 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.217821 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:21.255942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.256945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.257235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.257511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/projects/9c42e9d6486646f690a92c2b87be4f2b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.261236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c42e9d6486646f690a92c2b87be4f2b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.263206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:21.374870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c42e9d6486646f690a92c2b87be4f2b', 'request_id': 'req-ee681ae6-fb26-475d-9ed6-b4988fe86339'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.381969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c42e9d6486646f690a92c2b87be4f2b', 'request_id': 'req-ee681ae6-fb26-475d-9ed6-b4988fe86339'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.394499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c42e9d6486646f690a92c2b87be4f2b', 'request_id': 'req-ee681ae6-fb26-475d-9ed6-b4988fe86339'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.418368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] The token cache is being invalidate because project 9c42e9d6486646f690a92c2b87be4f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:21.419659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.421012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.423335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2266/4481] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:21 2022] DELETE /identity/v3/projects/9c42e9d6486646f690a92c2b87be4f2b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:21.428501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.431275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:21.458841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a63b-d244-48e6-ab38-fa08ea31e5bd tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.594701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35d6218b34d40fda14465d80b96ea9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12b9785e471643369020fab19df1e49c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.595637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.596376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.596915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.599068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.601684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-bbc95ad8-3ad9-48fa-972e-030af0ee606a tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Could not find domain: 1ffb8a0df5cf400bbdc6dcd0cfb58654.: keystone.exception.DomainNotFound: Could not find domain: 1ffb8a0df5cf400bbdc6dcd0cfb58654. Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1ffb8a0df5cf400bbdc6dcd0cfb58654. Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:26:21.633938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 24 01:26:21.635511 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:26:21.636779 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:26:21.642493 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:26:21.642493 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1ffb8a0df5cf400bbdc6dcd0cfb58654. Jul 24 01:26:21.642493 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:26:21.642493 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2216/4482] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:21 2022] POST /identity/v3/users => generated 112 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:26:21.643858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.645415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:21.839669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee681ae6-fb26-475d-9ed6-b4988fe86339 tempest-UsersNegativeTest-281031014 tempest-UsersNegativeTest-281031014-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.890666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.891897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.892192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.892673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] PATH_INFO: `/v3/users/6caa37ee2a234d9385ac9baf89a63e16` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.895296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6caa37ee2a234d9385ac9baf89a63e16)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.901980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:22.038779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caa37ee2a234d9385ac9baf89a63e16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.041714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caa37ee2a234d9385ac9baf89a63e16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.063189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caa37ee2a234d9385ac9baf89a63e16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.086939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caa37ee2a234d9385ac9baf89a63e16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.128174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caa37ee2a234d9385ac9baf89a63e16'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.131505 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:22.143334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2267/4483] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:21 2022] DELETE /identity/v3/users/6caa37ee2a234d9385ac9baf89a63e16 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:22.148433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797a59-756e-494c-bb98-918c413fd543 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:22.148927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797a59-756e-494c-bb98-918c413fd543 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:22.149847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797a59-756e-494c-bb98-918c413fd543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:22.190742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4797a59-756e-494c-bb98-918c413fd543 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:22.192003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4797a59-756e-494c-bb98-918c413fd543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:22.437754 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2217/4484] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:22.479238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:22.482067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:22.629224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b3b8-1786-4ff6-b74c-53c111360192 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:22.635225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:22.635888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:22.636176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:22.636456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:22.650735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:22.652838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:22.668578 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2268/4485] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:23.510802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:23.511268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:23.511557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:23.590402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] MFA Rules not processed for user `cfca678863924bf9bd6ab0120b222800`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:23.591766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:23.641604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:23.643207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:23.678921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6b7c5-9620-437f-85b0-b856faaf9f92 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:23.698378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:23.699692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:23.700176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:23.700770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] PATH_INFO: `/v3/projects/702feb8f4dc44945aa14d0d8c7b6f695` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:23.704777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702feb8f4dc44945aa14d0d8c7b6f695)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:23.710985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:23.785181 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:23.833378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2218/4486] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:23.906948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702feb8f4dc44945aa14d0d8c7b6f695', 'request_id': 'req-1d6d2419-a5c8-4431-8f46-26b170f25fd5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:23.922723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702feb8f4dc44945aa14d0d8c7b6f695', 'request_id': 'req-1d6d2419-a5c8-4431-8f46-26b170f25fd5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:23.934019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702feb8f4dc44945aa14d0d8c7b6f695', 'request_id': 'req-1d6d2419-a5c8-4431-8f46-26b170f25fd5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:23.958946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] The token cache is being invalidate because project 702feb8f4dc44945aa14d0d8c7b6f695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:23.959239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:23.963174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:23.965150 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2269/4487] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:23 2022] DELETE /identity/v3/projects/702feb8f4dc44945aa14d0d8c7b6f695 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:23.969046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:24.000103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8ed0-8be6-4ec0-822b-496e8498dc2b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:24.103374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:24.106996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:24.107465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:24.107847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] PATH_INFO: `/v3/users/d35d6218b34d40fda14465d80b96ea9d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:24.109366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35d6218b34d40fda14465d80b96ea9d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:24.111700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:24.216437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35d6218b34d40fda14465d80b96ea9d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:24.236045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35d6218b34d40fda14465d80b96ea9d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:24.256151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35d6218b34d40fda14465d80b96ea9d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:24.309826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35d6218b34d40fda14465d80b96ea9d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:24.312661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35d6218b34d40fda14465d80b96ea9d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:24.327604 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2219/4488] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:23 2022] DELETE /identity/v3/users/d35d6218b34d40fda14465d80b96ea9d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:24.372650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:24.374315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:24.546688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d2419-a5c8-4431-8f46-26b170f25fd5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:24.590591 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:24.693777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:24.694936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:24.695582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:24.696613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:24.704784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:24.843124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:24.845152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baab47-0453-42c6-ae80-8a7dfbd77b97 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:24.862313 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2270/4489] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:26.141223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.143570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:26.238467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23039f-c3d9-41e2-adde-dbd9a7687cad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:26.243874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:26.244763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.245222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.245511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] PATH_INFO: `/v3/projects/12b9785e471643369020fab19df1e49c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.246790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b9785e471643369020fab19df1e49c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:26.248748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:26.267525 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:26.310444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b9785e471643369020fab19df1e49c', 'request_id': 'req-c7215477-345b-4f4f-9a27-29e28b72bada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:26.320167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b9785e471643369020fab19df1e49c', 'request_id': 'req-c7215477-345b-4f4f-9a27-29e28b72bada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:26.329324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b9785e471643369020fab19df1e49c', 'request_id': 'req-c7215477-345b-4f4f-9a27-29e28b72bada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:26.346168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] The token cache is being invalidate because project 12b9785e471643369020fab19df1e49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:26.346414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:26.347371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c7215477-345b-4f4f-9a27-29e28b72bada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:26.349088 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2220/4490] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:26 2022] DELETE /identity/v3/projects/12b9785e471643369020fab19df1e49c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:26.357563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032696d-604f-420e-8b4f-a722b352599b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.358128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032696d-604f-420e-8b4f-a722b352599b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.358411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032696d-604f-420e-8b4f-a722b352599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.379269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e032696d-604f-420e-8b4f-a722b352599b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:26.380899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e032696d-604f-420e-8b4f-a722b352599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:26.466762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.467055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.467343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.471369 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2271/4491] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:26:26.488101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:26.489337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:26.502708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2221/4492] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:26.506993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032696d-604f-420e-8b4f-a722b352599b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.520376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032696d-604f-420e-8b4f-a722b352599b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:26.525935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:26.527318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.527787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.528070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.528854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:26.529166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:26.530834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:26.550338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.557478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2272/4493] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:26.561665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f1076-61c5-4f26-9c86-d127a2c2164f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:26.571975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:26.572997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.573464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.573942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.575047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:26.577322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:26.637827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2222/4494] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:26 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:26.643514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.669791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9b70-172e-4ca7-b71c-451f061a3fa7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:26.794558 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:26.851867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:26.852803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.853094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.853373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.854398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:26.857493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:26.892340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.898111 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2273/4495] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:26 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:26.927478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226f0ce-c3b5-4bcd-b052-876886078e8d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:26.935334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:26.936151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:26.938812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:26.939712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:26.940734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:26.944754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:26.969903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2223/4496] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:26.974009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:26.993756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299361ea-be7c-4975-93f0-5bce008a5190 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:27.013897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:27.014942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:27.015470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:27.015975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:27.017044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:27.019384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766cda-392e-40bb-a225-6a56df2098c7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:27.040329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2274/4497] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:27.044637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:27.060983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e938-b68e-4706-98f0-cc851930feb4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:27.074638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:27.075603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:27.075915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:27.076271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] PATH_INFO: `/v3/projects/db18e5474538441cb86b6cc4ec3be4b4/users/309c56c3aad34001920fe103eb734966/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:27.106942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db18e5474538441cb86b6cc4ec3be4b4, user_id=309c56c3aad34001920fe103eb734966, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:27.111512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:27.138916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2224/4498] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:27 2022] PUT /identity/v3/projects/db18e5474538441cb86b6cc4ec3be4b4/users/309c56c3aad34001920fe103eb734966/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:27.156646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:27.156905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:27.157162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:27.247444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] MFA Rules not processed for user `309c56c3aad34001920fe103eb734966`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:27.249306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:27.397455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2275/4499] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:27.410175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:27.412328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:27.510797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9762ba-168c-490b-baa9-206086b62bfb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:27.515760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:27.516660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:27.517199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:27.517365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:27.528803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:27.530399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2980b-da74-4b96-a9c3-9f686a9dd747 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:27.542324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2225/4500] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:27.678704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:27.799156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023db6e-0dda-4312-9638-f6d545c684c8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:27.804341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:27.807778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:27.808062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:27.809270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] PATH_INFO: `/v3/users/309c56c3aad34001920fe103eb734966` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:27.818974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309c56c3aad34001920fe103eb734966)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:27.823634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:27.913797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309c56c3aad34001920fe103eb734966'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:27.915057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309c56c3aad34001920fe103eb734966'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:27.927745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309c56c3aad34001920fe103eb734966'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:27.931832 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:27.948326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309c56c3aad34001920fe103eb734966'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:27.991904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309c56c3aad34001920fe103eb734966'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:28.011778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2276/4501] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:27 2022] DELETE /identity/v3/users/309c56c3aad34001920fe103eb734966 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:28.016474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:28.016793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:28.017306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:28.055073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:28.057887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:28.154230 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:28.201549 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2226/4502] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:28.211865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:28.213451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:28.347216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567b87-08f2-4c88-9dd7-800cadbcd536 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:28.352866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:28.354012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:28.357819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:28.358767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:28.377104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:28.379673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88016c7d-ed86-4354-8579-59fcc3f377c7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:28.411800 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2277/4503] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:28.951214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:28.953656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:29.005148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973236e8-1602-4627-a440-38c7719b89d3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.024340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.025889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.026347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.026841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] PATH_INFO: `/v3/projects/db18e5474538441cb86b6cc4ec3be4b4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.028652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db18e5474538441cb86b6cc4ec3be4b4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.037884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.149853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db18e5474538441cb86b6cc4ec3be4b4', 'request_id': 'req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:29.161449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db18e5474538441cb86b6cc4ec3be4b4', 'request_id': 'req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:29.171047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db18e5474538441cb86b6cc4ec3be4b4', 'request_id': 'req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:29.199371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] The token cache is being invalidate because project db18e5474538441cb86b6cc4ec3be4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:29.200888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:29.202084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-68b6cdcd-1b4a-4ad7-bcb4-26ab47c34a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:29.205617 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2227/4504] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:28 2022] DELETE /identity/v3/projects/db18e5474538441cb86b6cc4ec3be4b4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:29.210680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.211081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.212008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.232796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:29.234303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:29.317716 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2278/4505] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:29.326555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249215ba-f38b-4e02-b354-a05286883490 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.326767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249215ba-f38b-4e02-b354-a05286883490 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.327025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249215ba-f38b-4e02-b354-a05286883490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.351017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-249215ba-f38b-4e02-b354-a05286883490 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:29.353360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-249215ba-f38b-4e02-b354-a05286883490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:29.369461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.374332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2228/4506] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:29.380038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a286b-7f68-4860-8924-99fb54dd3837 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.386400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.387088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.387461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.387759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.388521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:29.388882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.390601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.416041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2279/4507] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:29.421331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249215ba-f38b-4e02-b354-a05286883490 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.437309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249215ba-f38b-4e02-b354-a05286883490 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.442984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.443624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.443911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.444193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.444913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.449867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.494120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.505496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2229/4508] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:29 2022] POST /identity/v3/projects => generated 359 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:29.507669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34a0ea-f528-480a-b868-fc53e8810476 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.590943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.592133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.592899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.593352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.594283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.599250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.612290 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:29.638702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.651528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2280/4509] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:29 2022] POST /identity/v3/users => generated 280 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:29.652687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6432-2366-41e5-ab21-b82a93b799e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.658673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.659370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.659788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.660079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.660836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.663158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.682498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.692898 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2230/4510] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:29.694602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c504-3cb2-4ca5-b27d-bad54697f1e7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.712043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.712985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.713446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.714289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.715035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.716840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948d4c9-f083-42d1-8d3c-61288441e610 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.728599 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2281/4511] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:29.733400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.745044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15800561-b946-40db-90c4-8f58d90b15ac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:29.751093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:29.752246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.752545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.753157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] PATH_INFO: `/v3/projects/7c04010c36a447c4b0c19d355a5dfe79/users/e0de0773b7674237a1cc21bee2f823a6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.777269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c04010c36a447c4b0c19d355a5dfe79, user_id=e0de0773b7674237a1cc21bee2f823a6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:29.780481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:29.813350 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2231/4512] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:29 2022] PUT /identity/v3/projects/7c04010c36a447c4b0c19d355a5dfe79/users/e0de0773b7674237a1cc21bee2f823a6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:29.814540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:29.815060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:29.815506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:29.845882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] MFA Rules not processed for user `e0de0773b7674237a1cc21bee2f823a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:29.847407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:29.926125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:29.929399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:29.955059 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2282/4513] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:29.967822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:30.050789 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:30.074295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c41310-1c49-44d3-978c-2acb59e8b3d5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:30.078792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7fbe8-14d8-4fc0-9c3d-a970867a84b4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:30.086442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:30.087542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:30.088028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:30.088370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] PATH_INFO: `/v3/users/e0de0773b7674237a1cc21bee2f823a6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:30.089751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0de0773b7674237a1cc21bee2f823a6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:30.090170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:30.091130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:30.091661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:30.092122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:30.092470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:30.095932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:30.171969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0de0773b7674237a1cc21bee2f823a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:30.172801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0de0773b7674237a1cc21bee2f823a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:30.185821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0de0773b7674237a1cc21bee2f823a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:30.205008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0de0773b7674237a1cc21bee2f823a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:30.222226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:30.224173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5277be-81d9-4753-8815-e523cdb4e5e8 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:30.224867 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:30.241723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0de0773b7674237a1cc21bee2f823a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:30.253718 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2232/4514] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:30.257702 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2283/4515] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:29 2022] DELETE /identity/v3/users/e0de0773b7674237a1cc21bee2f823a6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:30.259284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:30.259658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:30.260014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:30.280449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:30.281947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:30.354960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2233/4516] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:30.409416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:30.411348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:30.567575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69696a12-bae7-4661-b278-38c0b64eeb25 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:30.577999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:30.578812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:30.580195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:30.581418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:30.616304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:30.618361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04b9d2-bf87-4af2-b68b-f02e955c5ea6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:30.629867 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2284/4517] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:31.300011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:31.301467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:31.315051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088ac90-13f4-4f7b-92bc-907d5ec00085 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:31.324995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:31.327381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:31.328085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:31.328432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] PATH_INFO: `/v3/projects/7c04010c36a447c4b0c19d355a5dfe79` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:31.330226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c04010c36a447c4b0c19d355a5dfe79)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:31.333193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:31.441955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c04010c36a447c4b0c19d355a5dfe79', 'request_id': 'req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:31.453016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c04010c36a447c4b0c19d355a5dfe79', 'request_id': 'req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:31.462210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c04010c36a447c4b0c19d355a5dfe79', 'request_id': 'req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:31.492297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] The token cache is being invalidate because project 7c04010c36a447c4b0c19d355a5dfe79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:31.493362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:31.494447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d199ff08-1fc3-47e0-8d48-1716f7ccc2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:31.499868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2234/4518] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:31 2022] DELETE /identity/v3/projects/7c04010c36a447c4b0c19d355a5dfe79 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:31.502046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:31.502338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:31.502826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:31.539458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:31.541112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:31.670275 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2285/4519] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:31.682273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:31.682687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:31.683064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:31.704079 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:31.734502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:31.735752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:31.767467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2235/4520] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:31.769557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:31.783545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bf3a8-830f-47e6-9165-a0edbe066b27 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:31.790509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:31.792137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:31.792753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:31.794298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:31.795715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:31.796525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:31.800273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:31.828204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:31.828927 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2286/4521] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:31.839299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80bba5-bb4a-4006-8d88-5bbabed4bceb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:31.844853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:31.845526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:31.845930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:31.846408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:31.847301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:31.849687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:31.890710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2236/4522] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:31 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:31.891814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:31.910699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cd17-0d01-4f3f-b00b-74d4c62389eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.046655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.047465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.047813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.048153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.049860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.053042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.103979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2287/4523] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:31 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:32.106283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.120369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff5b9b-9502-4368-9601-6b07ce679ed3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.134161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.134870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.135149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.135437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.136309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.137993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.151413 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2237/4524] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:32.155902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.170628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9af286-dcbf-4f07-8443-09a04de065ba admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.175657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.176528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.177057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.177410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.178431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.180930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084333-b3f6-43ab-9352-66b05dd43328 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.197267 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:32.201654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2288/4525] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:32.205997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.218095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a41d1e-c13f-41f8-841f-6dbf9ad2b736 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.225097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.226646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.226982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.229890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] PATH_INFO: `/v3/projects/4c1cf4d965d34d7a9023fdc2425b7c43/users/22e3e7e68a0c45a282998a58f1043710/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.282071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1cf4d965d34d7a9023fdc2425b7c43, user_id=22e3e7e68a0c45a282998a58f1043710, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.286553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.314066 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2238/4526] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:32 2022] PUT /identity/v3/projects/4c1cf4d965d34d7a9023fdc2425b7c43/users/22e3e7e68a0c45a282998a58f1043710/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:32.319079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.319723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.319723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.385658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] MFA Rules not processed for user `22e3e7e68a0c45a282998a58f1043710`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:32.387914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:32.500621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2289/4527] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:32.501857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.592208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02304bfb-09e9-4c15-b543-01d8176a193b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.597345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.598273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.598746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.599202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.600155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.603417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.655845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2239/4528] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:32.657476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.670484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0513ff-3734-4bd7-b848-87d76601d7a7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.755603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.756585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.756828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.757497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.758566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.760674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.785741 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2290/4529] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:32 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:32.790363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.802218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab018-a674-491d-9fb5-b3bbc0a74f61 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.808940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.809764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.810067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.810493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.811307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.813188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.829108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2240/4530] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:32.832909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.849100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f434-60f1-4654-88eb-81c01c3fafc9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:32.854221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:32.855286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:32.855667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:32.856332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] PATH_INFO: `/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12/users/a518f752f4934f27b2c553719b567ef6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:32.876660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c83fb1f30c46229f6c0c03a0a61c12, user_id=a518f752f4934f27b2c553719b567ef6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:32.879833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:32.897355 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2291/4531] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:32 2022] PUT /identity/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12/users/a518f752f4934f27b2c553719b567ef6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:32.901223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:32.915018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0c6d-32d8-48cf-a88e-e7b329fbd88a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:33.012977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:33.013706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.013971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.014558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.015155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:33.017556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f914a-acb5-49da-9b71-aeca37cc5961 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:33.030011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2241/4532] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:33.034810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:33.047545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c8de-2c63-4c83-a57e-6085859ca1cd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:33.060103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:33.061325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.061734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.062112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] PATH_INFO: `/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12/users/a518f752f4934f27b2c553719b567ef6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.064781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c83fb1f30c46229f6c0c03a0a61c12, user_id=a518f752f4934f27b2c553719b567ef6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:33.067186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:33.086561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2292/4533] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:33 2022] PUT /identity/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12/users/a518f752f4934f27b2c553719b567ef6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:33.099951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf13d-83ad-43d9-b8ba-2e06fc71d506 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.100255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf13d-83ad-43d9-b8ba-2e06fc71d506 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.100536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bf13d-83ad-43d9-b8ba-2e06fc71d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.150554 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:33.155489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3b5bf13d-83ad-43d9-b8ba-2e06fc71d506 None None] MFA Rules not processed for user `a518f752f4934f27b2c553719b567ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:33.158713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3b5bf13d-83ad-43d9-b8ba-2e06fc71d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:33.266733 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2242/4534] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:33.300836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:33.312366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:33.324958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52b2d-d345-4712-949a-d80610947914 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.325511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52b2d-d345-4712-949a-d80610947914 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.325511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d52b2d-d345-4712-949a-d80610947914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.349443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-90d52b2d-d345-4712-949a-d80610947914 None None] MFA Rules not processed for user `01e7c66073564bb0b78b2309d281d1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:33.350952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-90d52b2d-d345-4712-949a-d80610947914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:33.432547 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:33.450099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac521e9-3856-41d6-89a4-30b4ec3f5c3d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:33.455497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:33.456472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.457066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.457832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.458477 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2243/4535] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:33.473459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:33.475055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:33.486655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2293/4536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:33.848452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:33.849017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:33.850049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:33.905201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:33.907912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:34.015086 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2244/4537] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:34.032003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:34.033732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:34.199491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e519b30-950b-4157-a9b1-eaa88bb4c254 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:34.205955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:34.206922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:34.207214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:34.207496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:34.219413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:34.222976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0e8ce-1032-48e5-b945-16391fcb5fdb service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:34.243309 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2294/4538] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:39.807228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:39.893047 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:39.988091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8122c1-7c4d-4b01-89c6-4f9adc28fd30 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:40.012567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:40.013777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:40.013777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:40.014087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] PATH_INFO: `/v3/users/22e3e7e68a0c45a282998a58f1043710` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:40.015388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e3e7e68a0c45a282998a58f1043710)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:40.017470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:40.147313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e3e7e68a0c45a282998a58f1043710'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:40.164153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e3e7e68a0c45a282998a58f1043710'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:40.177295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e3e7e68a0c45a282998a58f1043710'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:40.212240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e3e7e68a0c45a282998a58f1043710'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:40.213064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e3e7e68a0c45a282998a58f1043710'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:40.235088 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2245/4539] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:39 2022] DELETE /identity/v3/users/22e3e7e68a0c45a282998a58f1043710 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:40.240851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:40.241600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:40.241600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:40.291946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:40.293290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:40.515098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2295/4540] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:40.578660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:40.580143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:40.715302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeef6-184a-4ac6-b7d6-68abaa3d07b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:40.719975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:40.720703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:40.720990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:40.721304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:40.747079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:40.749645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:40.790154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2246/4541] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:43.528253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:43.530842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:43.563295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b51418-0efc-4ac8-9166-9573cab03a75 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:43.596156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:43.597460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:43.598001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:43.598463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] PATH_INFO: `/v3/projects/4c1cf4d965d34d7a9023fdc2425b7c43` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:43.600090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1cf4d965d34d7a9023fdc2425b7c43)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:43.603351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:43.728600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1cf4d965d34d7a9023fdc2425b7c43', 'request_id': 'req-5246a7a7-540f-4654-bf29-7348abd0da04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:43.746276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1cf4d965d34d7a9023fdc2425b7c43', 'request_id': 'req-5246a7a7-540f-4654-bf29-7348abd0da04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:43.762072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1cf4d965d34d7a9023fdc2425b7c43', 'request_id': 'req-5246a7a7-540f-4654-bf29-7348abd0da04'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:43.783722 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:43.793640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] The token cache is being invalidate because project 4c1cf4d965d34d7a9023fdc2425b7c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:43.794312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:43.796921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:43.801062 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2296/4542] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:43 2022] DELETE /identity/v3/projects/4c1cf4d965d34d7a9023fdc2425b7c43 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:43.806359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:43.833940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d340-9586-47f6-89bb-0c38cc538997 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:44.027504 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:44.060063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:44.060958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:44.061238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:44.061512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] PATH_INFO: `/v3/users/a518f752f4934f27b2c553719b567ef6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:44.062782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a518f752f4934f27b2c553719b567ef6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:44.064718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:44.185181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a518f752f4934f27b2c553719b567ef6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:44.220639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a518f752f4934f27b2c553719b567ef6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:44.240498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a518f752f4934f27b2c553719b567ef6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:44.271968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a518f752f4934f27b2c553719b567ef6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:44.274197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e605da2-9631-4135-8342-0d790d4752d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a518f752f4934f27b2c553719b567ef6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:44.294581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2247/4543] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:43 2022] DELETE /identity/v3/users/a518f752f4934f27b2c553719b567ef6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:46.832782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:46.834370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:46.864124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246a7a7-540f-4654-bf29-7348abd0da04 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:46.985316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:46.986608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:46.986889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:46.987640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] PATH_INFO: `/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:46.988509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c83fb1f30c46229f6c0c03a0a61c12)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:46.990679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.062427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c83fb1f30c46229f6c0c03a0a61c12', 'request_id': 'req-868ca786-a2b4-4f60-b37b-9e96835ebb40'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:47.069951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c83fb1f30c46229f6c0c03a0a61c12', 'request_id': 'req-868ca786-a2b4-4f60-b37b-9e96835ebb40'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:47.089787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c83fb1f30c46229f6c0c03a0a61c12', 'request_id': 'req-868ca786-a2b4-4f60-b37b-9e96835ebb40'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:47.109236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] The token cache is being invalidate because project 21c83fb1f30c46229f6c0c03a0a61c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:47.109536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:47.110278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-868ca786-a2b4-4f60-b37b-9e96835ebb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:47.125683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2297/4544] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:46 2022] DELETE /identity/v3/projects/21c83fb1f30c46229f6c0c03a0a61c12 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:47.130633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04829-0919-4630-9328-b041576595f9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.131575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04829-0919-4630-9328-b041576595f9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.133382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c04829-0919-4630-9328-b041576595f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.176170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e0c04829-0919-4630-9328-b041576595f9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:47.179197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0c04829-0919-4630-9328-b041576595f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:47.284738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2248/4545] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:47.292834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.293128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.293864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.315868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:47.317225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:47.329540 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2298/4546] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:26:47.333489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04829-0919-4630-9328-b041576595f9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.345945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c04829-0919-4630-9328-b041576595f9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.354532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.355563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.357064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.357064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.357959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:47.357959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.360046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.386815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2249/4547] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:47.390929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.404587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36694852-5d88-409f-82b9-01d88ba1b693 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.417580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.418296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.418583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.418859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.419595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.421497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.478577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.484488 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2299/4548] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:47 2022] POST /identity/v3/projects => generated 355 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:47.490159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b47b2-0e56-41e8-8778-89db83e09d3f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.604848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.605822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.606442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.606790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.607573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.609642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.624460 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:47.655473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2250/4549] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:47 2022] POST /identity/v3/users => generated 278 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:47.665241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.679332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f682b-628e-4d2d-a818-084de05bffc5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.687521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.688336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.688712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.689061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.689997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.691691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.713833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.732456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2300/4550] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:47.732688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe631fde-3b94-400c-ab38-479dc3d469e9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.745303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.746317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.746853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.747943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.753716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.758855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90244790-646f-4532-b0ef-636fc4f3cd1c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.794700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2251/4551] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:47.807077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:47.831195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4692647-fabd-409a-944d-a110b3d167e6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:47.846532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:47.848719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.849204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.849737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] PATH_INFO: `/v3/projects/4837624d07bd4b0cab0afaeb7a642796/users/516bc6f99a024017a5d5b0c00e9e6a9f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:47.930646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4837624d07bd4b0cab0afaeb7a642796, user_id=516bc6f99a024017a5d5b0c00e9e6a9f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:47.941474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:47.971689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2301/4552] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:47 2022] PUT /identity/v3/projects/4837624d07bd4b0cab0afaeb7a642796/users/516bc6f99a024017a5d5b0c00e9e6a9f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:47.984388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:47.984726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:47.985016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.048538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] MFA Rules not processed for user `516bc6f99a024017a5d5b0c00e9e6a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:48.050419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:48.156469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.156937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2252/4553] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:48.204282 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:48.265657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3300703-ed60-430a-a1a2-d46f31e170a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.271610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.272366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.272737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.273140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.274550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.277128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.327270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2302/4554] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:48 2022] POST /identity/v3/projects => generated 355 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:48.330896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.352108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3340b-7c8d-4427-8f15-f39edf4fb6a2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.477086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.477831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.478121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.478402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.479298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.481642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.523824 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2253/4555] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:48 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:48.525059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.541484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5befc6-5735-4f75-8443-7af50621a008 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.570106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.571659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.573274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.574027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.576814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.583596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.624433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2303/4556] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:48.625391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.640879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a630-ef6b-425e-a7ae-c3856a1e20c7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.670506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.671500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.671689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.672225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] PATH_INFO: `/v3/projects/744b50c48e2347aab11cfe6afee03043/users/fd252eaaaa2a4839ba717c2380245b25/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.716527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b50c48e2347aab11cfe6afee03043, user_id=fd252eaaaa2a4839ba717c2380245b25, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.719283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.760920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2254/4557] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:48 2022] PUT /identity/v3/projects/744b50c48e2347aab11cfe6afee03043/users/fd252eaaaa2a4839ba717c2380245b25/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:48.765614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.783122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e37b-acc5-424a-b68e-d01b50bcc193 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.900595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.901443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.901601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.901895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.902674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.904300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f617fe-b214-4c4d-95aa-881f791da750 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.918536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2304/4558] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:48.922583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:48.938213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb84bb-f094-475e-bc6f-581b6841b2ea admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:48.944729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:48.946932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.947363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.948063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] PATH_INFO: `/v3/projects/744b50c48e2347aab11cfe6afee03043/users/fd252eaaaa2a4839ba717c2380245b25/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:48.954492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b50c48e2347aab11cfe6afee03043, user_id=fd252eaaaa2a4839ba717c2380245b25, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:48.958568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:48.973091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2255/4559] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:48 2022] PUT /identity/v3/projects/744b50c48e2347aab11cfe6afee03043/users/fd252eaaaa2a4839ba717c2380245b25/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:48.987796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:48.988103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:48.988690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:49.037371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] MFA Rules not processed for user `fd252eaaaa2a4839ba717c2380245b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:49.039013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:49.167959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2305/4560] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:48 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:49.172944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:49.186961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6ce2-746d-4162-843b-f012507c53bb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:49.193487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd252eaaaa2a4839ba717c2380245b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b50c48e2347aab11cfe6afee03043', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:49.194864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:49.196114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:49.196669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:49.197508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:49.197841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:49.199746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:49.215680 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2256/4561] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:49.219541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:49.230017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a650c0-0273-4fb6-a56e-b8fa5e03e12b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:49.236766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd252eaaaa2a4839ba717c2380245b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b50c48e2347aab11cfe6afee03043', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:49.237531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:49.237851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:49.238129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:49.239252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:49.241026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:49.268581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:49.283162 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2306/4562] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:49 2022] POST /identity/v3/projects => generated 349 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:49.285560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:49.298643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690fde-39cf-4cd1-8b9c-2ab1a439bfe6 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:49.303222 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:49.369030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd252eaaaa2a4839ba717c2380245b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b50c48e2347aab11cfe6afee03043', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:49.369603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:49.369934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:49.370213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:49.370957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:49.371266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:49.372874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:49.389936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2257/4563] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:26:49.409222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:49.411104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:49.509932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7145f-2965-484f-9b3e-9a6476658410 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:49.514086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:49.514761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:49.515039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:49.515351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:49.527738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:49.529344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:49.549306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2307/4564] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:50.144709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:50.166454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d937a4-c991-4666-b647-feb1a1948c53 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:50.184081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd252eaaaa2a4839ba717c2380245b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b50c48e2347aab11cfe6afee03043', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:50.186398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:50.186957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:50.187646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] PATH_INFO: `/v3/projects/50efd4b501e34291bf89bfe6d9f7bcbd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:50.189415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=50efd4b501e34291bf89bfe6d9f7bcbd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:50.193956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:50.298023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50efd4b501e34291bf89bfe6d9f7bcbd', 'request_id': 'req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.312044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50efd4b501e34291bf89bfe6d9f7bcbd', 'request_id': 'req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.325736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50efd4b501e34291bf89bfe6d9f7bcbd', 'request_id': 'req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.359171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] The token cache is being invalidate because project 50efd4b501e34291bf89bfe6d9f7bcbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:50.359171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.360063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7e5ca6ed-2752-45fa-b2b3-2276eb7bced2 tempest-QuotasTest-559476913 tempest-QuotasTest-559476913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.370114 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2258/4565] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:50 2022] DELETE /identity/v3/projects/50efd4b501e34291bf89bfe6d9f7bcbd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:50.694228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:50.796168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea1e7-dc45-48bf-9d70-d39f20fda802 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:50.868339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:50.869314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:50.869661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:50.870047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] PATH_INFO: `/v3/users/516bc6f99a024017a5d5b0c00e9e6a9f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:50.871376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=516bc6f99a024017a5d5b0c00e9e6a9f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:50.875235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:50.939108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516bc6f99a024017a5d5b0c00e9e6a9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.939871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516bc6f99a024017a5d5b0c00e9e6a9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.944424 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:50.957925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516bc6f99a024017a5d5b0c00e9e6a9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.969705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516bc6f99a024017a5d5b0c00e9e6a9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.986295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516bc6f99a024017a5d5b0c00e9e6a9f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:50.997185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2308/4566] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:50 2022] DELETE /identity/v3/users/516bc6f99a024017a5d5b0c00e9e6a9f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:51.001744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:51.002364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:51.002929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:51.040629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:51.042537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:51.190021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2259/4567] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:51.213516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:51.216232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:51.364285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57892-227a-4bbb-9366-c0a8588e4ebc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:51.378007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:51.378841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:51.379127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:51.379398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:51.391673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:51.394132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:51.405855 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2309/4568] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:52.567598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:52.570039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:52.586645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515af66-9b2b-4ce6-82fc-28e3e1ff4a3d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:52.610092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:52.611601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:52.613700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:52.614182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] PATH_INFO: `/v3/projects/4837624d07bd4b0cab0afaeb7a642796` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:52.615684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4837624d07bd4b0cab0afaeb7a642796)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:52.618114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:52.660580 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:52.736447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4837624d07bd4b0cab0afaeb7a642796', 'request_id': 'req-2648aa0e-5455-4d00-9e91-95527416e517'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:52.756948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4837624d07bd4b0cab0afaeb7a642796', 'request_id': 'req-2648aa0e-5455-4d00-9e91-95527416e517'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:52.764980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4837624d07bd4b0cab0afaeb7a642796', 'request_id': 'req-2648aa0e-5455-4d00-9e91-95527416e517'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:52.792156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] The token cache is being invalidate because project 4837624d07bd4b0cab0afaeb7a642796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:52.793639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:52.797590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:52.801596 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2260/4569] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:52 2022] DELETE /identity/v3/projects/4837624d07bd4b0cab0afaeb7a642796 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:52.806436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:52.821569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1254a-08bd-46f4-ac17-7c44ff15ad5d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:52.963368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:52.964542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:52.966029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:52.967837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] PATH_INFO: `/v3/users/fd252eaaaa2a4839ba717c2380245b25` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:52.972215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd252eaaaa2a4839ba717c2380245b25)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:52.975312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:53.066415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd252eaaaa2a4839ba717c2380245b25'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:53.068032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd252eaaaa2a4839ba717c2380245b25'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:53.098592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd252eaaaa2a4839ba717c2380245b25'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:53.101455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd252eaaaa2a4839ba717c2380245b25'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:53.153222 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:53.167845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25abeb8c-68ba-4e0c-96e2-8b0dfa0795b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd252eaaaa2a4839ba717c2380245b25'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:53.176090 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2310/4570] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:52 2022] DELETE /identity/v3/users/fd252eaaaa2a4839ba717c2380245b25 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:54.377374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:54.378835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:54.405601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648aa0e-5455-4d00-9e91-95527416e517 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:54.557247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:54.558173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:54.558454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:54.558729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] PATH_INFO: `/v3/projects/744b50c48e2347aab11cfe6afee03043` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:54.578776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=744b50c48e2347aab11cfe6afee03043)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:54.580728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:54.685411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744b50c48e2347aab11cfe6afee03043', 'request_id': 'req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:54.698670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744b50c48e2347aab11cfe6afee03043', 'request_id': 'req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:54.716489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744b50c48e2347aab11cfe6afee03043', 'request_id': 'req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:54.740886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] The token cache is being invalidate because project 744b50c48e2347aab11cfe6afee03043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:54.741458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:54.742469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f3ea5c6-6f65-418d-b0c8-1c34d794f83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:54.747938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2261/4571] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:54 2022] DELETE /identity/v3/projects/744b50c48e2347aab11cfe6afee03043 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:54.755106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:54.755960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:54.756937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:54.802439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:54.803815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:54.961046 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2311/4572] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:54.970532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:54.970757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:54.971005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.006347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:55.008207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:55.028990 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2262/4573] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:55.033395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.055141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a6409-198b-4ccd-b5de-9317c5d6fae5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.062102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.062796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.063082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.063843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.064616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:55.064930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.066841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.093750 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2312/4574] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:55.095397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.105381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e2462-10aa-4439-a836-ac1eb8dfa67b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.110576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.111246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.111526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.111800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.112511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.123651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.175903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2263/4575] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:55 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:55.177870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.204346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc1f1c-de94-4a65-a2bd-21e82cb139c5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.321972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.322666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.322952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.323229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.323937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.326871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.356551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2313/4576] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:55 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:55.360415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.377229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15782a5-9288-43a6-b700-f561d32beb42 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.387790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.389451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.389920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.390358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.392095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.394069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.396789 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:55.410475 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2264/4577] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:55.414087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.425754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a8e6-f32d-4f26-a67c-3fc2076866b7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.433727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.434919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.435469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.435855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.437565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.439736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c80d1-f9f3-4135-a247-be68d7719bba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.452338 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2314/4578] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:55.456621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.469605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504333a-8bed-4a41-bb66-00c46f22f6b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.475383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.476736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.477176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.477700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] PATH_INFO: `/v3/projects/378f2549357546dfbd9af0ff48c77dd5/users/3c7fb60c521e4b82ba07cf10e2951480/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.498233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378f2549357546dfbd9af0ff48c77dd5, user_id=3c7fb60c521e4b82ba07cf10e2951480, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.502138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.520918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2265/4579] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:55 2022] PUT /identity/v3/projects/378f2549357546dfbd9af0ff48c77dd5/users/3c7fb60c521e4b82ba07cf10e2951480/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:55.532501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.532899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.533273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.597298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] MFA Rules not processed for user `3c7fb60c521e4b82ba07cf10e2951480`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:55.598837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:55.721694 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:55.795321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2315/4580] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:55.803116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:55.805054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:55.920814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16db64-ab3c-43eb-92db-a7a3644d9bb2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:55.925786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:55.926761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:55.927282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:55.927901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:55.939551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:55.941123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964655a-8276-4a45-bf96-4e0c1689af82 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:55.952710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2266/4581] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:55.989034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:56.171021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9cedc-6d69-495b-8602-ff86e617104b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:56.188784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:56.189877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:56.190281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:56.190798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] PATH_INFO: `/v3/users/3c7fb60c521e4b82ba07cf10e2951480` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:56.192528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7fb60c521e4b82ba07cf10e2951480)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:56.194380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:56.369504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7fb60c521e4b82ba07cf10e2951480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:56.370992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7fb60c521e4b82ba07cf10e2951480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:56.392978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7fb60c521e4b82ba07cf10e2951480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:56.403575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7fb60c521e4b82ba07cf10e2951480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:56.428838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7fb60c521e4b82ba07cf10e2951480'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:56.446994 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2316/4582] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:55 2022] DELETE /identity/v3/users/3c7fb60c521e4b82ba07cf10e2951480 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:56.449218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:56.449744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:56.449867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:56.482880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:56.484174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:56.655059 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2267/4583] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:56.671022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:56.672603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:56.841418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bd68-5454-4cd6-8dc0-af8a0a260639 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:56.849026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:56.849733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:56.850641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:56.850973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:56.862948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:56.864646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:56.878897 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2317/4584] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:26:57.268454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:57.270627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:57.287964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b435d3-23dc-48b4-b07a-205c1238168b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:57.305151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:57.308642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:57.309129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:57.309613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] PATH_INFO: `/v3/users/cfca678863924bf9bd6ab0120b222800` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:57.311924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfca678863924bf9bd6ab0120b222800)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:57.314127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:57.406065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:57.407563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:57.445975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e7be2-9e7c-4045-8c6e-58270389baac service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:57.468160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfca678863924bf9bd6ab0120b222800'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.470211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:57.471107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:57.471946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:57.472272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] PATH_INFO: `/v3/projects/378f2549357546dfbd9af0ff48c77dd5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:57.475346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378f2549357546dfbd9af0ff48c77dd5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:57.480832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:57.483398 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:57.486875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfca678863924bf9bd6ab0120b222800'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.501958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfca678863924bf9bd6ab0120b222800'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.520888 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:57.531250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfca678863924bf9bd6ab0120b222800'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.532048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-51b48af9-3673-4e66-a0fc-1e1e65759588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfca678863924bf9bd6ab0120b222800'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.545653 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2268/4585] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:57 2022] DELETE /identity/v3/users/cfca678863924bf9bd6ab0120b222800 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:57.599928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378f2549357546dfbd9af0ff48c77dd5', 'request_id': 'req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.615601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378f2549357546dfbd9af0ff48c77dd5', 'request_id': 'req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.637802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378f2549357546dfbd9af0ff48c77dd5', 'request_id': 'req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.661073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] The token cache is being invalidate because project 378f2549357546dfbd9af0ff48c77dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:57.661378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.666087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3496a56a-6ed8-4fff-91bb-a51fb9fa5b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:57.669813 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2318/4586] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:57 2022] DELETE /identity/v3/projects/378f2549357546dfbd9af0ff48c77dd5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:57.674902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:57.675221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:57.675501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:57.711357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:57.712607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:57.827159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2269/4587] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:57.834676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:57.838876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:57.839335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:57.918091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:57.919394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:57.928818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2319/4588] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:57.933598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:57.953843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0bec8-5684-4d2b-93e2-ec3aab875d56 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:57.959814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:57.961353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:57.961641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:57.962059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:57.962854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:57.963166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:57.965062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:57.988054 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2270/4589] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:57.992284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.002908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45daf3-9156-4a26-9c40-db365e1abab7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.010702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.011876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.012323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.012750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.013625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.015843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.081589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2320/4590] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:58.082783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.095209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3f92-0eab-42b9-becf-7fc248a9ab9a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.249161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.250493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.250784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.251068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.251796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.253781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.271013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.274064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:58.295502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de26a5-c156-4eec-aad7-7de80a2be9eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.297695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2271/4591] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:58 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:58.301039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.311616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.312856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.313343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.313989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] PATH_INFO: `/v3/projects/a253ae01d6d8460abe1126aec263b625` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.316562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a253ae01d6d8460abe1126aec263b625)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.320965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.323053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736a06c-bdda-4780-bb15-b8083ecc2ea0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.338649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.339470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.339812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.340156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.341484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.344252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.371740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2272/4592] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:58.377175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.395279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735ae9-1dc9-47de-ab08-51872a78e182 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.402221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.402911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.403196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.403672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.404519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.406599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.419677 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2273/4593] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:58.425360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.434313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a253ae01d6d8460abe1126aec263b625', 'request_id': 'req-ca07be67-fd93-40af-b0df-589fa2d94f0d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:58.443596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca876d4-4b88-46ec-bbfb-050d3ed4d71d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:58.445419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a253ae01d6d8460abe1126aec263b625', 'request_id': 'req-ca07be67-fd93-40af-b0df-589fa2d94f0d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:58.457021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a253ae01d6d8460abe1126aec263b625', 'request_id': 'req-ca07be67-fd93-40af-b0df-589fa2d94f0d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:58.482288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] The token cache is being invalidate because project a253ae01d6d8460abe1126aec263b625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:58.482568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:58.488008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ca07be67-fd93-40af-b0df-589fa2d94f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:58.491035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2321/4594] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:58 2022] DELETE /identity/v3/projects/a253ae01d6d8460abe1126aec263b625 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:58.496400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5960-c97f-478b-b500-35f5191333af None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.496682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5960-c97f-478b-b500-35f5191333af None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.496962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5960-c97f-478b-b500-35f5191333af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.544744 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:58.587800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f73c5960-c97f-478b-b500-35f5191333af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:58.588870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f73c5960-c97f-478b-b500-35f5191333af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:58.624649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:58.625564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.625874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.626148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] PATH_INFO: `/v3/projects/4c478d6d10d9445ca50340bbad595174/users/8803f22e6162413886b72622dfdfb9ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.646251 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:58.667626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c478d6d10d9445ca50340bbad595174, user_id=8803f22e6162413886b72622dfdfb9ed, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:58.673051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2843dc-1504-4fb8-89e2-7468f61ef13d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:58.713947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2274/4595] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:58 2022] PUT /identity/v3/projects/4c478d6d10d9445ca50340bbad595174/users/8803f22e6162413886b72622dfdfb9ed/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:26:58.715539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.715808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.716085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.776787 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2322/4596] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:26:58.785296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:58.785653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:58.786044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:58.790697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] MFA Rules not processed for user `8803f22e6162413886b72622dfdfb9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:58.794707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:58.831415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:58.832714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:58.922397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2275/4597] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:58.949660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:58.952054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:59.021256 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2323/4598] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:59.023328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.054907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a18f-5e1a-43c7-884e-4c4807784beb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.070621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.071484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.071766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.072036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.072873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:59.073181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.074839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.110897 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2324/4599] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:59.119311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.143873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e606e-6b4a-4356-92fe-e15ebe71b829 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.148964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d3721-0522-456a-a6a4-dd3143d24e49 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.158863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.159104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.159351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.159504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.163508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.164886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.165425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.165985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.167019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.173831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.176978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.188386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.213700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2276/4600] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:26:59.238171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2325/4601] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:59 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:59.241183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.257905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db9d-6498-42ef-ba33-1002e0b1487a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.320860 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:59.349028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.349867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.350393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.350765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.353160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.355651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.389906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2277/4602] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:59 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:26:59.391616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.407403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0f80f-57c9-4496-9385-e298fbe03fa0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.415868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.416749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.417138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.418187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.419068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.421847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.450496 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2326/4603] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:59.452155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.468488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcfa7c-9197-4d0f-b2b9-765063546bf6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.474147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.474949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.475339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.475720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.477285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.479387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be67b-d5b7-4344-9ef6-f53f98d3c499 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.498536 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2278/4604] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:59.500001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.512682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d140-bdfc-493f-9714-82094b540427 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:59.519577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:59.520686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.521074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.521453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] PATH_INFO: `/v3/projects/e39cbca23eba4208a1c160cfb5aef490/users/b0f04ff3b36d4b0686c9a68ff55ee99d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.587428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39cbca23eba4208a1c160cfb5aef490, user_id=b0f04ff3b36d4b0686c9a68ff55ee99d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:59.594761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:59.617218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2327/4605] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:59 2022] PUT /identity/v3/projects/e39cbca23eba4208a1c160cfb5aef490/users/b0f04ff3b36d4b0686c9a68ff55ee99d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:59.619305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1dd1-a45f-4dc1-ab2e-fa2d2df2b507 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:59.619721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1dd1-a45f-4dc1-ab2e-fa2d2df2b507 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:59.620001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e1dd1-a45f-4dc1-ab2e-fa2d2df2b507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:59.652237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a62e1dd1-a45f-4dc1-ab2e-fa2d2df2b507 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:59.653501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a62e1dd1-a45f-4dc1-ab2e-fa2d2df2b507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:59.782004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2279/4606] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:59.800274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:59.803037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:00.003199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4038-910f-4ecf-af26-9d6d9c676bd2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:00.014695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:00.015707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:00.016219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:00.017005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:00.049898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:00.051784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:00.058068 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:00.071127 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2328/4607] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:05.772864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff5ae-8c35-4c0f-80ed-8237622040e4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:05.774779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff5ae-8c35-4c0f-80ed-8237622040e4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:05.775109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff5ae-8c35-4c0f-80ed-8237622040e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:05.865695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c69ff5ae-8c35-4c0f-80ed-8237622040e4 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:05.867819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c69ff5ae-8c35-4c0f-80ed-8237622040e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:06.081141 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2280/4608] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:06.159170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:06.167960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:06.363786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0bf1-0c0a-4118-9d57-508ee16333ca service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:06.387779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:06.388643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:06.389029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:06.389411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:06.410912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:06.412689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb3bd3-0292-4049-8847-4450221de6ae service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:06.436262 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2329/4609] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:27:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:27:06.715995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:06.715995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:06.715995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:06.718219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2281/4610] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:27:06.723396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:06.723559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:06.724064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:06.760987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:06.763237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:06.922138 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2330/4611] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:06.948404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:06.957505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:07.025559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43843e-c77c-47b3-921c-e7981f508876 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:07.049910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:07.052485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:07.055623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:07.057543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:07.118688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:07.136823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:07.167785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2282/4612] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:12.433162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:12.434673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:12.458839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2bf81-140b-45ad-b418-053500c39577 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:12.472859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:12.474286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:12.474619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:12.474843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] PATH_INFO: `/v3/users/785eebaf851240da958ed7c13d121121` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:12.479844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=785eebaf851240da958ed7c13d121121)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:12.484244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:12.611582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785eebaf851240da958ed7c13d121121'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:12.612194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785eebaf851240da958ed7c13d121121'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:12.636894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785eebaf851240da958ed7c13d121121'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:12.676551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785eebaf851240da958ed7c13d121121'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:12.722359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-86679be6-ce29-4cfa-8a2f-6d48e8bda28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785eebaf851240da958ed7c13d121121'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:12.723995 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:12.738340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2331/4613] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:27:12 2022] DELETE /identity/v3/users/785eebaf851240da958ed7c13d121121 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:13.597742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:13.625300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c061e-d0a0-4301-8e5a-c5acdabcbe24 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:13.753827 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:13.780054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:13.781037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:13.783000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:13.783370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] PATH_INFO: `/v3/projects/b20fd219605f4e0c8e04a9289764a40d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:13.793082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20fd219605f4e0c8e04a9289764a40d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:13.795301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:13.947997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20fd219605f4e0c8e04a9289764a40d', 'request_id': 'req-e730f1b3-d2f1-4811-bca5-041285b9bc5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:13.965422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20fd219605f4e0c8e04a9289764a40d', 'request_id': 'req-e730f1b3-d2f1-4811-bca5-041285b9bc5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:13.973785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20fd219605f4e0c8e04a9289764a40d', 'request_id': 'req-e730f1b3-d2f1-4811-bca5-041285b9bc5b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:14.004115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] The token cache is being invalidate because project b20fd219605f4e0c8e04a9289764a40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:27:14.004698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:14.007861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e730f1b3-d2f1-4811-bca5-041285b9bc5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:14.024914 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2283/4614] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:13 2022] DELETE /identity/v3/projects/b20fd219605f4e0c8e04a9289764a40d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:14.032584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dae2ec-da20-47f2-b8a5-8bfeaf525660 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.033116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dae2ec-da20-47f2-b8a5-8bfeaf525660 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.033184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dae2ec-da20-47f2-b8a5-8bfeaf525660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.198652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a9dae2ec-da20-47f2-b8a5-8bfeaf525660 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:14.200203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9dae2ec-da20-47f2-b8a5-8bfeaf525660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:14.295597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a955c-a62a-494f-98a7-9e17a29ebc1a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.295882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a955c-a62a-494f-98a7-9e17a29ebc1a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.296279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a955c-a62a-494f-98a7-9e17a29ebc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.316657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2332/4615] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:14.325947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.326433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.326879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.354255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fc0a955c-a62a-494f-98a7-9e17a29ebc1a None None] MFA Rules not processed for user `b0f04ff3b36d4b0686c9a68ff55ee99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:14.355827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fc0a955c-a62a-494f-98a7-9e17a29ebc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:14.357645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:14.358916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:14.369061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2333/4616] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:14.373271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.395375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5a7a-8a57-44b3-ac15-ad5a827aea72 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.405195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.406331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.407110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.407686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.408760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:27:14.409327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.411704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.461598 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2334/4617] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:27:14.461968 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2284/4618] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:27:14.463188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.475675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.476444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.476815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.490288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbb0a2-14ce-4488-9a76-bae5376d4690 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.503472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.505362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.508525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.509045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.510522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.514224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] MFA Rules not processed for user `b0f04ff3b36d4b0686c9a68ff55ee99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:14.515635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.515741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:14.524967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2285/4619] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:27:14.541182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.542522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:14.606668 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2335/4620] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:27:14.612605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.639376 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:14.699251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372191-848a-4436-ada6-df58dfa0d691 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.736919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f6884-f22c-4712-9947-64b722998f93 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.743834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.745167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.745906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.746388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.747769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.750423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.779621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2336/4621] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:27:14.784154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.806571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89f6f5-b0c3-43e0-840e-e3f277ce05c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.812234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.813016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.813405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.813795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.814609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.817379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.834551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2337/4622] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:27:14.837564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.849199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644ead-9160-47f5-8256-d81a97ce0276 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.854885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.855798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.856550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.857003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.858186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.860047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.877745 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2338/4623] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:27:14.879028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:14.894732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.895292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e36ce-ebb1-49d4-ae57-d2c75779443f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:14.895422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.895590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.896004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.903413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:14.905432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.906056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.906538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] PATH_INFO: `/v3/projects/a4fe90029c99433ba86341f96ffc70af/users/f3a842684b4a4020a9e8e6839c2a2748/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:14.917820 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:14.955322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fe90029c99433ba86341f96ffc70af, user_id=f3a842684b4a4020a9e8e6839c2a2748, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:14.958841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac50ac-e599-4e3f-853a-f59d0209f977 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:14.984527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2339/4624] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:27:14 2022] PUT /identity/v3/projects/a4fe90029c99433ba86341f96ffc70af/users/f3a842684b4a4020a9e8e6839c2a2748/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:14.996453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:14.996875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:14.997242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:15.050142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:15.051960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5751b-41ff-40dd-9d09-704fe9418639 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:15.063163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2286/4625] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:15.065823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] MFA Rules not processed for user `f3a842684b4a4020a9e8e6839c2a2748`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:15.068310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:15.196268 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2340/4626] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:15.208144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:15.208449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:15.208677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:15.233386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] MFA Rules not processed for user `f3a842684b4a4020a9e8e6839c2a2748`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:15.235774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:15.250055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2287/4627] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:15.256552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:15.258138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:15.381318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a93c8b-9a42-44fd-9762-d3ffcb3fe1ce None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:15.389812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:15.390481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:15.390764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:15.391089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:15.401659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:15.404053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0be13-d790-49fc-8e6f-5566b22a2a4a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:15.429778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2341/4628] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:25.228715 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=63 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:25.411679 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:46.570360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:46.571831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:46.723319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a03bb-6aee-4871-ad29-dca31ffa0196 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:46.730060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:46.731353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:46.732388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:46.732769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] PATH_INFO: `/v3/users/08f48bfc09ad4b0c83c9300f1ae59ab9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:46.734188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f48bfc09ad4b0c83c9300f1ae59ab9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:46.736751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:46.860609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f48bfc09ad4b0c83c9300f1ae59ab9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:46.874333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f48bfc09ad4b0c83c9300f1ae59ab9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:46.885585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f48bfc09ad4b0c83c9300f1ae59ab9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:46.907255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f48bfc09ad4b0c83c9300f1ae59ab9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:46.908280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f48bfc09ad4b0c83c9300f1ae59ab9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:46.922857 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2288/4629] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:27:46 2022] DELETE /identity/v3/users/08f48bfc09ad4b0c83c9300f1ae59ab9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:46.924229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:46.924681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:46.924783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:46.955078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:46.956477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:47.084556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2342/4630] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:27:47.156762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:47.158275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:47.309474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34512f6-b09c-4a63-80f8-88566b46953f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:47.322013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:47.322907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:47.323298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:47.323677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:47.354897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:47.356863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eb038-6591-4292-9f2b-444247aabdf1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:47.383496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2289/4631] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:47.817749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:47.820165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:47.853506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aba55a-f877-461b-8aca-8c188bc2c268 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:47.858725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:47.859595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:47.860020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:47.860454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:47.862998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:47.901039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:47.903489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:47.928326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2343/4632] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:48.000221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.001362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.001907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.031012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:48.032837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.079457 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:48.091152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:48.093853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.115217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7361da-9075-4605-8ca9-9f9a4acacaee service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:48.126886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:48.129453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.131561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.132217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] PATH_INFO: `/v3/projects/c29c5066e32041b68c80a27b57e7b327` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.134146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c5066e32041b68c80a27b57e7b327)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:48.138946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:48.248904 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2290/4633] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:48.256029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:48.261153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.325000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c5066e32041b68c80a27b57e7b327', 'request_id': 'req-32a94011-aca2-49ef-a4b3-2ea78500c7ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:48.341231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c5066e32041b68c80a27b57e7b327', 'request_id': 'req-32a94011-aca2-49ef-a4b3-2ea78500c7ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:48.364459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c5066e32041b68c80a27b57e7b327', 'request_id': 'req-32a94011-aca2-49ef-a4b3-2ea78500c7ed'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:48.393390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] The token cache is being invalidate because project c29c5066e32041b68c80a27b57e7b327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:27:48.393581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:48.394645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32a94011-aca2-49ef-a4b3-2ea78500c7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:27:48.402415 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2344/4634] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:27:48 2022] DELETE /identity/v3/projects/c29c5066e32041b68c80a27b57e7b327 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:48.404559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a803b-9a32-4a08-b137-d0219cea7ab3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.404852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a803b-9a32-4a08-b137-d0219cea7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.405511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a803b-9a32-4a08-b137-d0219cea7ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.436808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dc0a803b-9a32-4a08-b137-d0219cea7ab3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:48.438088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc0a803b-9a32-4a08-b137-d0219cea7ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.488011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc0fe5-16a7-41a4-965d-58a17f725140 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:48.577456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2345/4635] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:27:48.579606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.579914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.580195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.621326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:48.622709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.648475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2346/4636] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:48.649394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:48.657888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:48.659000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.659286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.659577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.661505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:48.664533 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:48.669109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f5cf4-5a86-407f-aac5-e07cc9f73a43 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:48.681830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:48.682516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.682806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.683081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.683841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:27:48.684152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:48.685786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:48.715692 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2347/4637] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:27:48.720243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:48.744407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89796479-6a84-4b47-a59e-72403d7fb025 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:48.761446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:48.762392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:48.762505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:48.762710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:48.763430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:48.770556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:48.853841 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2348/4638] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:27:48 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:27:48.853841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:48.872094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:48.874603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:48.888810 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2291/4639] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:27:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:27:49.293081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dcf19-2fb5-486a-9386-b49ce7dea24a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:49.318630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:49.320641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:49.321114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:49.321625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:49.333975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:49.336691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:49.434745 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2349/4640] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:27:48 2022] POST /identity/v3/users => generated 291 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:27:49.438979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:49.463500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32f29-b815-4482-af19-3a8b06bcda72 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:49.478156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:49.478856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:49.479142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:49.479423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:49.481957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:49.485634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:49.504998 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:49.517658 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2292/4641] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:27:49.520696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:49.557747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d52926-0943-4e98-869a-411e2894997e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:49.578552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:49.579294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:49.579580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:49.579856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:49.583064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:49.585746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f99c9-e63b-4ce6-95c9-0be34c67d7d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:49.632363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2350/4642] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:27:49.637039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:49.657387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0775c-2a6d-412f-8e44-3376daab8783 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:49.691820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:49.693479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:49.693851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:49.694210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] PATH_INFO: `/v3/projects/af5412362d9b4478b8fcd9990cf3b924/users/e4edfaa9996c4b1b805d13322bda6290/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:49.799427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5412362d9b4478b8fcd9990cf3b924, user_id=e4edfaa9996c4b1b805d13322bda6290, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:49.803775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:49.846013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2293/4643] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:27:49 2022] PUT /identity/v3/projects/af5412362d9b4478b8fcd9990cf3b924/users/e4edfaa9996c4b1b805d13322bda6290/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:27:49.857526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8fb4-8b66-4c8e-8ff3-3a9a2fa04252 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:49.857893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8fb4-8b66-4c8e-8ff3-3a9a2fa04252 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:49.858210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8fb4-8b66-4c8e-8ff3-3a9a2fa04252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:49.943377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-11bb8fb4-8b66-4c8e-8ff3-3a9a2fa04252 None None] MFA Rules not processed for user `e4edfaa9996c4b1b805d13322bda6290`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:49.945268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-11bb8fb4-8b66-4c8e-8ff3-3a9a2fa04252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:50.220938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2351/4644] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:27:50.328946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:27:50.330802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:50.450934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6138ad-4983-43ca-9211-87e176058eb4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:27:50.455184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:27:50.456249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:50.456626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:50.456953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:50.467435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:27:50.469044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:27:50.482166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2294/4645] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:27:52.530514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585907e-cea4-4515-a9fe-baf0acfeefad None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:27:52.531362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585907e-cea4-4515-a9fe-baf0acfeefad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:27:52.531793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585907e-cea4-4515-a9fe-baf0acfeefad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:27:52.560750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b585907e-cea4-4515-a9fe-baf0acfeefad None None] MFA Rules not processed for user `5ab27e46e8534384abea2875fb9946df`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:27:52.562261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b585907e-cea4-4515-a9fe-baf0acfeefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:27:52.639228 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:27:52.708715 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2352/4646] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:27:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:00.482236 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:02.383445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:02.384904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:02.600640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1ec8-d7cb-4c53-adb8-1caddbfb57d7 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:02.619823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:02.621627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:02.624352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:02.624761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] PATH_INFO: `/v3/users/f3a842684b4a4020a9e8e6839c2a2748` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:02.630792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a842684b4a4020a9e8e6839c2a2748)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:02.636994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:02.679959 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:02.787773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a842684b4a4020a9e8e6839c2a2748'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:02.798571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a842684b4a4020a9e8e6839c2a2748'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:02.808976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a842684b4a4020a9e8e6839c2a2748'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:02.824556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a842684b4a4020a9e8e6839c2a2748'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:02.825298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a842684b4a4020a9e8e6839c2a2748'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:02.832175 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2295/4647] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:02 2022] DELETE /identity/v3/users/f3a842684b4a4020a9e8e6839c2a2748 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:28:02.837281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:02.837709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:02.838073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:02.866795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:02.868474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:03.016176 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2353/4648] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:03.087039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:03.088909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:03.267793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2ac29-9594-40fd-9868-e36d1fde87e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:03.277315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:03.278887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:03.279174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:03.279455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:03.302802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:03.305175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce71c2-cf50-4b34-9776-cbd5b428f15f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:03.335406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2296/4649] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:05.751163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:05.753797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:05.790418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ca745-1984-4b38-91c7-09d77bad8639 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:05.812457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:05.813992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:05.813992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:05.822025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] PATH_INFO: `/v3/projects/a4fe90029c99433ba86341f96ffc70af` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:05.829349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fe90029c99433ba86341f96ffc70af)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:05.839961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:05.957136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fe90029c99433ba86341f96ffc70af', 'request_id': 'req-5cbfab0e-741c-409a-8f99-68b5de3edc4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:05.969819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fe90029c99433ba86341f96ffc70af', 'request_id': 'req-5cbfab0e-741c-409a-8f99-68b5de3edc4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:05.985646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fe90029c99433ba86341f96ffc70af', 'request_id': 'req-5cbfab0e-741c-409a-8f99-68b5de3edc4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:06.010853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] The token cache is being invalidate because project a4fe90029c99433ba86341f96ffc70af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:06.011265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:06.012023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cbfab0e-741c-409a-8f99-68b5de3edc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:06.014045 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2354/4650] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:05 2022] DELETE /identity/v3/projects/a4fe90029c99433ba86341f96ffc70af => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:06.019511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.020005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.021411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.057382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:06.061694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:06.112669 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:06.249714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2297/4651] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:06.258808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.259162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.259536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.293637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:06.309606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:06.330774 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2355/4652] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:06.336276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:06.358247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c52b-22d4-4ef5-8b01-3a47fdf2a7ac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:06.374375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:06.375412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.376957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.377350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.378443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:06.379833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:06.383866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:06.423960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2298/4653] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:28:06.424991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:06.442780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dccfd-434e-4c0a-a819-4fade8981a29 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:06.463023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:06.463934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.464381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.464799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.465686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:06.467764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:06.536733 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2356/4654] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:06 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:28:06.538526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:06.554137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385e482-8f3c-4afd-b9a4-48046f96dbea admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:06.750888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:06.752987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.754923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.755723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.759075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:06.761925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:06.804258 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2299/4655] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:06 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:06.807372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:06.826154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d741-f824-4953-b23d-0498062981a3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:06.834485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:06.835184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.835468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.835941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.836843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:06.838696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:06.863927 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2357/4656] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:06.866055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:06.882825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effaf4f-673f-46d7-88bb-1e2d41e5927f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:06.906062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:06.909965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:06.910352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:06.910531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:06.911836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:06.925018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7574df-c22f-4907-891a-0388d8b8d07a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:06.994998 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2300/4657] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:28:07.001298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:07.030521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0062-bcb8-4d98-8d4a-6dd0e701a880 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:07.046217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:07.047124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:07.047402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:07.047675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] PATH_INFO: `/v3/projects/da60c4b9da1b4445a038238d0db2927e/users/014d9b85786b4a22b71463e346159fc4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:07.093819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da60c4b9da1b4445a038238d0db2927e, user_id=014d9b85786b4a22b71463e346159fc4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:07.099649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:07.142956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2358/4658] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:07 2022] PUT /identity/v3/projects/da60c4b9da1b4445a038238d0db2927e/users/014d9b85786b4a22b71463e346159fc4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:07.151602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:07.152731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:07.153123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:07.241479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:07.253893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:07.489977 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2301/4659] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:07.520551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:07.522622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:07.627761 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:07.729961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aef7c-9ce4-4dca-be10-fc3ac62dd17f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:07.738188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:07.739923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:07.740668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:07.741202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:07.755258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:07.756908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:07.769755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2359/4660] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:14.553059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:14.555135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:14.587186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6db29-3ff3-4802-80f1-a951bcbd1cf0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:14.605562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:14.609335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:14.609918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:14.610304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] PATH_INFO: `/v3/users/5553b37350644a20b64ce76ebf60b44b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:14.616011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5553b37350644a20b64ce76ebf60b44b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:14.618217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:14.761880 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:14.810752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5553b37350644a20b64ce76ebf60b44b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:14.833302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5553b37350644a20b64ce76ebf60b44b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:14.847975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5553b37350644a20b64ce76ebf60b44b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:14.875090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5553b37350644a20b64ce76ebf60b44b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:14.876005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5553b37350644a20b64ce76ebf60b44b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:14.890254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2302/4661] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:14 2022] DELETE /identity/v3/users/5553b37350644a20b64ce76ebf60b44b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:15.852333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:15.871453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69bbf-7b5d-40f6-b0fc-997527aac112 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:16.097614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:16.098934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:16.104939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:16.105420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] PATH_INFO: `/v3/projects/37d719380c51434683b3dcd83722913f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:16.107414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d719380c51434683b3dcd83722913f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:16.110033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:16.111319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:16.117780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.299000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d719380c51434683b3dcd83722913f', 'request_id': 'req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.308993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d719380c51434683b3dcd83722913f', 'request_id': 'req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.312747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d9234-0ae8-4e9c-98a5-8dcb8e090da7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:16.327376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d719380c51434683b3dcd83722913f', 'request_id': 'req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.357313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] The token cache is being invalidate because project 37d719380c51434683b3dcd83722913f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:16.358029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.359227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.374976 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2360/4662] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:15 2022] DELETE /identity/v3/projects/37d719380c51434683b3dcd83722913f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:16.385794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:16.400802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.446026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:16.446735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:16.447021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:16.447299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:16.451851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.512914 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:16.579774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf3f02-4cad-4e9c-a66c-b18bd9d10e7c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:16.588368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:16.589062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:16.589876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:16.590164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:16.599368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:16.601052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:16.602575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:16.604453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:16.612783 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2303/4663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:16.614791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:16.616454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.632878 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2361/4664] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:16.633394 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:16.809239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff94ca-af2e-4456-9512-b60181e46e6e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:16.815142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:16.816042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:16.816321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:16.816595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] PATH_INFO: `/v3/users/79c009db00ac498faa7671fd4477aacb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:16.819095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c009db00ac498faa7671fd4477aacb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:16.822104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:16.869233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:16.871400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.920633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b65d9-d233-47e9-abcf-a01c293ff7d9 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:16.935271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:16.936053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:16.936345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:16.936625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:16.943255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:16.975673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c009db00ac498faa7671fd4477aacb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:16.982838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:16.986509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b5853-a302-4d83-bd41-47ffee53908c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:16.992154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c009db00ac498faa7671fd4477aacb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:17.016842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c009db00ac498faa7671fd4477aacb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:17.028253 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2362/4665] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:28:17.058177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c009db00ac498faa7671fd4477aacb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:17.058940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c009db00ac498faa7671fd4477aacb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:17.070318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2304/4666] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:16 2022] DELETE /identity/v3/users/79c009db00ac498faa7671fd4477aacb => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:17.571502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:17.571502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:17.571502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:17.599177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:17.601659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:17.724637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:17.727291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:17.732233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2363/4667] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:17.883375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523a05-4312-4e6f-9ced-0dbdb4612b58 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:17.889492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:17.890191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:17.890410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:17.890730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:17.913372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:17.915152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f31b4a-5902-4f04-98bb-4af86749c48c service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:17.938980 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2305/4668] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:28:18.046920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:18.050186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:18.310384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfda304-cf10-48e8-9820-16f079ce8be7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:18.321636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:18.322789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:18.323088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:18.323191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] PATH_INFO: `/v3/projects/e487e705f29346409a8478acc0795293` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:18.326333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e487e705f29346409a8478acc0795293)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:18.329079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:18.402141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e487e705f29346409a8478acc0795293', 'request_id': 'req-80cf1c58-100f-4986-8e0e-639875f63a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:18.409084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e487e705f29346409a8478acc0795293', 'request_id': 'req-80cf1c58-100f-4986-8e0e-639875f63a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:18.419699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e487e705f29346409a8478acc0795293', 'request_id': 'req-80cf1c58-100f-4986-8e0e-639875f63a23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:18.431238 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:18.437250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] The token cache is being invalidate because project e487e705f29346409a8478acc0795293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:18.437932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:18.439612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-80cf1c58-100f-4986-8e0e-639875f63a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:18.442530 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2364/4669] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:18 2022] DELETE /identity/v3/projects/e487e705f29346409a8478acc0795293 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:18.450664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:18.451852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:18.452765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:18.503075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:18.509264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:18.553389 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:18.690434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2306/4670] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:18.700109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:18.700508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:18.700797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:18.741996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:18.746140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:18.772412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2365/4671] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:18.774805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:18.791040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b8ba3-d53e-4acb-9943-1054e3a3a905 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:18.806617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:18.808952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:18.810311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:18.810610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:18.814031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:18.814372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:18.818575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:18.859390 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2307/4672] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:28:18.863177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:18.878597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff7900-2c4b-4f14-9b68-99026544af69 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:18.890021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:18.892114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:18.892410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:18.895054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:18.897280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:18.904263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36552a6-b98d-4d88-ba62-c715eee997b5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:18.985786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2366/4673] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:18 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:18.987755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:19.001367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.001660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.001981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.012850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc6cd-55a2-4f8a-89e2-e35069902df1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:19.074986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] MFA Rules not processed for user `b0f04ff3b36d4b0686c9a68ff55ee99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:19.076234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:19.175700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:19.177193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.177969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.178254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.178980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:19.183466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:19.215598 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2367/4674] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:19.241909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2308/4675] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:18 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:19.245657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:19.258414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9af6a-934e-4763-b47c-2fc4ab3e1e8f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:19.282546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:19.284366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.284671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.284949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.286424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:19.296295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:19.336973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2368/4676] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:19.341231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:19.355803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a740-a42d-4717-b665-b21ff8c65451 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:19.361390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:19.362166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.362319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.362919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.364467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:19.367058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4961-3fce-42c9-867b-f49b1cc072f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:19.402472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2309/4677] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:19.406475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:19.421978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb0c3-4511-42ff-8822-e059300e94e4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:19.438288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:19.439403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.439780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.440068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] PATH_INFO: `/v3/projects/217f2c9b33dc4d63a778c93abc91f70f/users/a1e6810811b14037afc8e2891be22039/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.463783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=217f2c9b33dc4d63a778c93abc91f70f, user_id=a1e6810811b14037afc8e2891be22039, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:19.476691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:19.496654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2369/4678] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:19 2022] PUT /identity/v3/projects/217f2c9b33dc4d63a778c93abc91f70f/users/a1e6810811b14037afc8e2891be22039/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:28:19.502315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:19.502612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:19.506046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:19.546825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:19.552776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:19.755064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2310/4679] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:19.843560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:19.846029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:20.054559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a85b-1f92-4480-be50-de43796348fa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:20.059812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:20.060737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:20.061175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:20.061617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:20.076495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:20.079527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122acfb-dac7-4fe3-8806-42ab6cd5a4ab service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:20.102049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2370/4680] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:22.961225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:22.962830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:22.985455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fce63-4e19-4b8d-95f3-1619d1c0b5b8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:22.990198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:22.991681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:22.992173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:22.992717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:22.995627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:23.033060 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:23.149640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:23.151207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956fd5-25f0-4c30-9b44-d537a98c264b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:23.166372 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2311/4681] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:26.855593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:26.856389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:26.856496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:26.977875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:26.979834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:27.104142 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:27.254250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2371/4682] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:27.265915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:27.266547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:27.266547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:27.313664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:27.317539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:27.339740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2312/4683] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:27.424143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:27.425395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:27.453345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:27.454714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:27.476767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f96b63-3b37-4080-a2fe-9751ee042add None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:27.486956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:27.487886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:27.488186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:27.489140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] PATH_INFO: `/v3/users/01e7c66073564bb0b78b2309d281d1f1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:27.498814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e7c66073564bb0b78b2309d281d1f1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:27.500855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:27.503639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144007a-8925-4eef-b248-4c5690b29954 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:27.515916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:27.516879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:27.518337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:27.520838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:27.545253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:27.549388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a797-85a7-4dbe-a8e3-0988ab2f92c4 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:27.576810 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2313/4684] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:27.707753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e7c66073564bb0b78b2309d281d1f1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:27.709999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e7c66073564bb0b78b2309d281d1f1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:27.736451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e7c66073564bb0b78b2309d281d1f1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:27.769150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e7c66073564bb0b78b2309d281d1f1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:27.819860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e7c66073564bb0b78b2309d281d1f1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:27.841917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2372/4685] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:27 2022] DELETE /identity/v3/users/01e7c66073564bb0b78b2309d281d1f1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:27.843345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:27.843633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:27.843915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:27.892478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:27.898294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:28.090853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2314/4686] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:28.183506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:28.189195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:28.336227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294c56-7e33-4385-a78f-632c4003c6bc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:28.355665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:28.356611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:28.364724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:28.366052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:28.441092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:28.447091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:28.516579 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2373/4687] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:31.285024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:31.286581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:31.312337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2188d-af30-4667-9d12-bc09ca264e38 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:31.334754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:31.336103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:31.336567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:31.337001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] PATH_INFO: `/v3/projects/74794638ee6a4b18aef9ff780d461b73` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:31.339163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74794638ee6a4b18aef9ff780d461b73)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:31.342197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:31.493530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74794638ee6a4b18aef9ff780d461b73', 'request_id': 'req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.512873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74794638ee6a4b18aef9ff780d461b73', 'request_id': 'req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.526227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74794638ee6a4b18aef9ff780d461b73', 'request_id': 'req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.562171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] The token cache is being invalidate because project 74794638ee6a4b18aef9ff780d461b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:31.563616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.564461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.574560 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2315/4688] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:31 2022] DELETE /identity/v3/projects/74794638ee6a4b18aef9ff780d461b73 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:31.578618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:31.595699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e845a3-a3da-4f55-b050-98446f12a768 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:31.695105 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:31.744321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:31.745235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:31.745525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:31.745835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] PATH_INFO: `/v3/users/f05b985e50f44940b352b6148fc10763` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:31.749996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05b985e50f44940b352b6148fc10763)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:31.752107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:31.871050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05b985e50f44940b352b6148fc10763'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.871781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05b985e50f44940b352b6148fc10763'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.888537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05b985e50f44940b352b6148fc10763'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.902027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05b985e50f44940b352b6148fc10763'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.932206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c3d8030-fc04-4e67-b5ce-4c3dd4557ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05b985e50f44940b352b6148fc10763'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:31.949842 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2374/4689] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:31 2022] DELETE /identity/v3/users/f05b985e50f44940b352b6148fc10763 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:33.160646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:33.164981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:33.229758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68fba-bc51-4cdd-97b0-d4a078ae8905 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:33.295636 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:33.475059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:33.475942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:33.476219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:33.477019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] PATH_INFO: `/v3/projects/4343432978b644a286aa3cf937ba8320` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:33.481026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4343432978b644a286aa3cf937ba8320)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:33.483823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:33.600177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4343432978b644a286aa3cf937ba8320', 'request_id': 'req-dd325d98-2837-4682-b9d0-94c7e02b4ab6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:33.610905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4343432978b644a286aa3cf937ba8320', 'request_id': 'req-dd325d98-2837-4682-b9d0-94c7e02b4ab6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:33.630606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4343432978b644a286aa3cf937ba8320', 'request_id': 'req-dd325d98-2837-4682-b9d0-94c7e02b4ab6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:33.667060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] The token cache is being invalidate because project 4343432978b644a286aa3cf937ba8320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:33.667657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:33.692026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd325d98-2837-4682-b9d0-94c7e02b4ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:33.694622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2316/4690] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:33 2022] DELETE /identity/v3/projects/4343432978b644a286aa3cf937ba8320 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:33.699599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:33.700454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:33.701336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:33.761732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:33.764741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:34.001715 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2375/4691] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:34.006585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.006876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.007158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.073797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:34.092051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:34.124281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.125464 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2317/4692] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:34.146996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a449012-c468-4a81-8039-ae8db3c50a23 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.157398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.158378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.158805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.159223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.160272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:34.160796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.164434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.192673 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2376/4693] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:28:34.197194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.220890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624334-9fbf-445e-acd5-2a5854fa3e37 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.255323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.258963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.259413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.260001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.263615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.271321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.333453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2318/4694] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:34.337886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.356384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491f9b-ef95-4df3-adf8-c680bfec8244 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.510707 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:34.534607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.535697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.535991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.536270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.537100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.539788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.575658 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2377/4695] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/users => generated 279 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:34.579544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.604622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d650-7308-4392-a215-3d535bd2e1ef admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.620799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.622353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.622867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.623512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.626098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.628392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc58410-b07f-45ea-b470-e9e8fb7a51e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.661254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2319/4696] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:34.671779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.675013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fa73-bfdb-4329-8b1e-1cb312025076 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.675307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fa73-bfdb-4329-8b1e-1cb312025076 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.675629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546fa73-bfdb-4329-8b1e-1cb312025076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.694889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd50cb-39a9-49cd-bdcd-6fe978e2572d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.705517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.706209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.706642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.707862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.709455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.711462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.716216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3546fa73-bfdb-4329-8b1e-1cb312025076 None None] MFA Rules not processed for user `a1e6810811b14037afc8e2891be22039`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:34.718664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3546fa73-bfdb-4329-8b1e-1cb312025076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:34.732306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2378/4697] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:34.733467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:34.746013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a635d-574f-4461-85bf-f83d5d0533ce admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:34.751748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:34.752781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.753211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.753489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] PATH_INFO: `/v3/projects/933cf746a95043c19669829383b1f340/users/bdedbdc9d96c4b049695a23962b6623b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.789695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933cf746a95043c19669829383b1f340, user_id=bdedbdc9d96c4b049695a23962b6623b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:34.801206 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:34.803601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992813-e1cc-41c8-a947-5c79bcedd826 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:34.822644 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2320/4698] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:34.832609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.833074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.833574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.853517 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2379/4699] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:34 2022] PUT /identity/v3/projects/933cf746a95043c19669829383b1f340/users/bdedbdc9d96c4b049695a23962b6623b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:34.864516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:34.864817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:34.865101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:34.868688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] MFA Rules not processed for user `a1e6810811b14037afc8e2891be22039`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:34.869965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:34.924396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] MFA Rules not processed for user `bdedbdc9d96c4b049695a23962b6623b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:34.926842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:34.959037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2321/4700] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:35.092293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2380/4701] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:35.094031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.262407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a848-52a5-4132-8f76-b5c306efe3aa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:35.275816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:35.276690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:35.277153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:35.277582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:35.278506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:35.280674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:35.335465 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2322/4702] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:35 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:35.339540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.360735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bdd31-d031-4575-9019-f5c82077c679 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:35.505547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:35.506280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:35.507062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:35.507062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:35.507529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:35.509482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:35.546251 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2381/4703] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:35 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:35.549648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.580751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7727b-03c7-4927-a225-2f1c6c3f83bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:35.610451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:35.611288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:35.611576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:35.611854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:35.612168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.614641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:35.624215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:35.624215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:35.659079 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2323/4704] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:35.663612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.687797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2d45-5c47-4695-aa76-259e9479d3a3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:35.688545 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:35.709535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:35.710751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:35.710944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:35.711229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] PATH_INFO: `/v3/projects/19ce14d7bd954434a63636c461c534de/users/c94495eafbad4095a4f856eda3b01c01/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:35.774047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ce14d7bd954434a63636c461c534de, user_id=c94495eafbad4095a4f856eda3b01c01, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:35.777098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:35.821206 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2324/4705] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:35 2022] PUT /identity/v3/projects/19ce14d7bd954434a63636c461c534de/users/c94495eafbad4095a4f856eda3b01c01/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:35.822178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:35.872632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188c1c-795a-4687-ae00-3cf9cf5f0c9b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:36.014368 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:36.041653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ab8a9-cd28-4cd8-9f5a-e2445c4bf177 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:36.059840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:36.060540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:36.060822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:36.061104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:36.062291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:36.065383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:36.091339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2325/4706] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:36.094879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:36.113331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:36.114318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:36.114600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:36.114872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:36.168090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38b5dd-6ecb-49b9-a5bf-c4741ef00eb5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:36.189436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:36.190398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:36.190694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:36.190985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] PATH_INFO: `/v3/projects/19ce14d7bd954434a63636c461c534de/users/c94495eafbad4095a4f856eda3b01c01/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:36.198956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ce14d7bd954434a63636c461c534de, user_id=c94495eafbad4095a4f856eda3b01c01, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:36.201726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e63e8-2d4f-4576-9941-b80bf1e0f97c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:36.237479 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2326/4707] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:36 2022] PUT /identity/v3/projects/19ce14d7bd954434a63636c461c534de/users/c94495eafbad4095a4f856eda3b01c01/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:36.249535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:36.249878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:36.250155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:36.287037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:36.288722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:36.320286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2382/4708] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:36.325808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] MFA Rules not processed for user `c94495eafbad4095a4f856eda3b01c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:36.327062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:36.510718 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2327/4709] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:37.080402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:37.082618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:37.139488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ade01-b397-4ac0-85fd-b43d591970ef service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:37.267062 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:37.323614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:37.324480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:37.324884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:37.325174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:37.352440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:37.354095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:37.388049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2383/4710] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:39.295970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:39.298221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:39.528632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce7709-1db8-4b84-9001-12828d403939 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:39.545085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:39.546047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:39.546160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:39.546417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:39.557091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:39.592861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:39.609441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937a085-16a1-4c32-afd8-746fe903dd6e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:39.644743 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2328/4711] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:41.985106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:42.177559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fff91-3d6f-4d02-98f9-aad023935586 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:42.183824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:42.185274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:42.185747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:42.186450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] PATH_INFO: `/v3/users/bdedbdc9d96c4b049695a23962b6623b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:42.188002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdedbdc9d96c4b049695a23962b6623b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:42.192233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:42.285779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdedbdc9d96c4b049695a23962b6623b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:42.287438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdedbdc9d96c4b049695a23962b6623b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:42.321297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdedbdc9d96c4b049695a23962b6623b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:42.336268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdedbdc9d96c4b049695a23962b6623b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:42.355191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdedbdc9d96c4b049695a23962b6623b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:42.381559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:42.383032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:42.383565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:42.385506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2384/4712] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:41 2022] DELETE /identity/v3/users/bdedbdc9d96c4b049695a23962b6623b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:42.411777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:42.414766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:42.549781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2329/4713] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:42.601468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:42.603665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:42.791572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27958-2dd4-49b3-92ce-c3be1ac148d8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:42.802289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:42.802989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:42.803210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:42.803492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:42.835485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:42.836979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:42.869806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2385/4714] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:45.034284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:45.044078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:45.066762 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:45.087150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74af52-4088-4ab1-ad4d-1e690ff378c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:45.102492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:45.105935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:45.107906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:45.108467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] PATH_INFO: `/v3/projects/933cf746a95043c19669829383b1f340` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:45.118187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933cf746a95043c19669829383b1f340)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:45.120263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:45.229273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933cf746a95043c19669829383b1f340', 'request_id': 'req-f7f6dbd4-834b-475f-8c41-8a9975b12372'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.250467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933cf746a95043c19669829383b1f340', 'request_id': 'req-f7f6dbd4-834b-475f-8c41-8a9975b12372'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.259821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933cf746a95043c19669829383b1f340', 'request_id': 'req-f7f6dbd4-834b-475f-8c41-8a9975b12372'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.281971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] The token cache is being invalidate because project 933cf746a95043c19669829383b1f340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:45.283025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.284360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.288796 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2330/4715] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:45 2022] DELETE /identity/v3/projects/933cf746a95043c19669829383b1f340 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:45.293386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:45.302556 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:45.312418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeefa3-a1c9-4190-9375-de00de39832c service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:45.387790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:45.388724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:45.389009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:45.389283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] PATH_INFO: `/v3/users/c94495eafbad4095a4f856eda3b01c01` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:45.391510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94495eafbad4095a4f856eda3b01c01)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:45.393616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:45.456233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94495eafbad4095a4f856eda3b01c01'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.457386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94495eafbad4095a4f856eda3b01c01'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.467616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94495eafbad4095a4f856eda3b01c01'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.483745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94495eafbad4095a4f856eda3b01c01'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.502923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d8eb618-f18e-4d4b-9ee2-79c862d76fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94495eafbad4095a4f856eda3b01c01'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:45.521821 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2386/4716] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:45 2022] DELETE /identity/v3/users/c94495eafbad4095a4f856eda3b01c01 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:46.189481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.192713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:46.217207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6dbd4-834b-475f-8c41-8a9975b12372 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:46.292509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:46.294218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.294610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.295019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] PATH_INFO: `/v3/projects/19ce14d7bd954434a63636c461c534de` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.296476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ce14d7bd954434a63636c461c534de)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:46.298532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:46.361301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ce14d7bd954434a63636c461c534de', 'request_id': 'req-24693314-581d-42b2-8fee-d3329bf4681f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:46.371252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ce14d7bd954434a63636c461c534de', 'request_id': 'req-24693314-581d-42b2-8fee-d3329bf4681f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:46.378344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ce14d7bd954434a63636c461c534de', 'request_id': 'req-24693314-581d-42b2-8fee-d3329bf4681f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:46.399295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] The token cache is being invalidate because project 19ce14d7bd954434a63636c461c534de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:46.399967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:46.400841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24693314-581d-42b2-8fee-d3329bf4681f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:46.411965 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2331/4717] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:46 2022] DELETE /identity/v3/projects/19ce14d7bd954434a63636c461c534de => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:46.414460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.414943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.415736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.437911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:46.439343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:46.526283 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2387/4718] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:46.534123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.534839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.535547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.562844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:46.566983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:46.583819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.586700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2332/4719] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:46.595623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceca92-6fe9-4224-a6e0-e96691713c49 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:46.608120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:46.608774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.609935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.610541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.611558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:46.612011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:46.615467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:46.633658 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2388/4720] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:28:46.638060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.651105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5acfad-7ff3-4b69-a66a-1b616cf9222c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:46.662397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:46.663238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.663626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.664006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.664827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:46.667175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:46.676928 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:46.746254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2333/4721] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:46 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:46.750186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.766360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c19f2-c59a-48e7-87bd-b58aece303af admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:46.774810 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:46.849116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:46.850079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.850554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.850967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.851917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:46.855088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:46.891416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2389/4722] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:46 2022] POST /identity/v3/users => generated 304 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:28:46.895243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.911653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4202b9f-0da6-40a4-829d-e0f9802ad77d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:46.918493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:46.919539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:46.920058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:46.920730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:46.938973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:46.944334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:46.971512 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2334/4723] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:46.975901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:46.992806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95e9b6-9602-40a9-b7fc-e91f224cf35d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:47.001543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:47.002561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.003053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.003667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.005348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:47.008016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f675c-f7ea-475d-89c2-28451bc8265b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:47.028775 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2390/4724] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:47.030086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:47.047139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ab52-6311-43e4-8e09-20c1eb800105 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:47.059086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:47.060137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.061200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.061885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] PATH_INFO: `/v3/projects/59e3b64beccb431cb56759cc945d1873/users/c4d9039d882d4470b70aa0119615d9d4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.089116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e3b64beccb431cb56759cc945d1873, user_id=c4d9039d882d4470b70aa0119615d9d4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:47.095572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f33d8-ee4e-43cf-bdb4-f2eaa9e6ad62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:47.150181 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2335/4725] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:47 2022] PUT /identity/v3/projects/59e3b64beccb431cb56759cc945d1873/users/c4d9039d882d4470b70aa0119615d9d4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:47.152641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.153301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.153757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.233049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] MFA Rules not processed for user `c4d9039d882d4470b70aa0119615d9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:47.238298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:47.287542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.288821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.289327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.311566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] MFA Rules not processed for user `472ff2bf65fb473ba60274de014b08a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:47.313767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:47.407842 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2336/4726] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:47.449643 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2391/4727] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:47.451016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:47.626062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5297-55b4-4899-9f64-a265cf17e8dc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:47.632852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:47.633555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.633914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.634195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.635226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:47.637782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:47.681118 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2337/4728] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:47 2022] POST /identity/v3/projects => generated 409 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:47.685003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:47.701535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6a0f-8c28-4f4f-80fd-300e507c2194 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:47.857259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:47.858142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.859808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.860197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.862500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:47.865768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:47.932956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2392/4729] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:47 2022] POST /identity/v3/users => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:47.936950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:47.962676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d35f-dc9d-4134-ba62-1210f77ec6b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:47.977584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:47.978341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:47.982266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:47.982910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:47.983397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.007647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.044173 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2338/4730] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:48.049635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.062295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beea3c3-c6cc-4a2e-84cf-ffbfcf4f2a7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:48.074575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:48.076119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.076385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.076668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] PATH_INFO: `/v3/projects/1830a44074dc4694b793b78a9d880457/users/8f08280ce3c3436c8b8f437dc1457660/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.084755 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:48.101860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1830a44074dc4694b793b78a9d880457, user_id=8f08280ce3c3436c8b8f437dc1457660, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.105444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.134824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2393/4731] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:48 2022] PUT /identity/v3/projects/1830a44074dc4694b793b78a9d880457/users/8f08280ce3c3436c8b8f437dc1457660/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:48.139082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.159584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c843b-4f7a-4c2b-90ae-c7e664d414ca admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:48.226668 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:48.288383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:48.289085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.290376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.291170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.292281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.295596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24b8b-d3de-4393-b8e7-f496da1881b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.314723 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2339/4732] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:48.319991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.339750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34ab7-5654-4865-a1ca-80ae33888495 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:48.345334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:48.346323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.346699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.347711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] PATH_INFO: `/v3/projects/1830a44074dc4694b793b78a9d880457/users/8f08280ce3c3436c8b8f437dc1457660/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.352131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1830a44074dc4694b793b78a9d880457, user_id=8f08280ce3c3436c8b8f437dc1457660, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.358252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.407968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2394/4733] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:48 2022] PUT /identity/v3/projects/1830a44074dc4694b793b78a9d880457/users/8f08280ce3c3436c8b8f437dc1457660/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:48.410057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.410586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.411092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.460751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] MFA Rules not processed for user `8f08280ce3c3436c8b8f437dc1457660`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:48.462183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:48.619908 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2340/4734] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:48.627546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.728766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f3214-9974-47eb-995b-2d8466425e13 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:48.735823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:48.736854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.737206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.737545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] PATH_INFO: `/v3/users/c4d9039d882d4470b70aa0119615d9d4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.739776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d9039d882d4470b70aa0119615d9d4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.743280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.798278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.799783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:48.810512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d9039d882d4470b70aa0119615d9d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.811173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d9039d882d4470b70aa0119615d9d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.821064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d9039d882d4470b70aa0119615d9d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.829056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d9039d882d4470b70aa0119615d9d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.829231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5e17-53b1-40ca-bd15-4df123df403c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:48.835356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:48.836331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.836678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.837131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] PATH_INFO: `/v3/users/e4edfaa9996c4b1b805d13322bda6290` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.838564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4edfaa9996c4b1b805d13322bda6290)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:48.840903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:48.842321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-578674d8-20c9-456a-b47c-55b31ea66115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d9039d882d4470b70aa0119615d9d4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.850281 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2395/4735] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:48 2022] DELETE /identity/v3/users/c4d9039d882d4470b70aa0119615d9d4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:48.854713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.855199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.855652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.881227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:48.882435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:48.915902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4edfaa9996c4b1b805d13322bda6290'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.923975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4edfaa9996c4b1b805d13322bda6290'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.932398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4edfaa9996c4b1b805d13322bda6290'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.943725 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:48.947161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4edfaa9996c4b1b805d13322bda6290'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.948490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0a833975-8122-4dad-8f4e-46b31fcc7748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4edfaa9996c4b1b805d13322bda6290'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:48.959845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2341/4736] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:48 2022] DELETE /identity/v3/users/e4edfaa9996c4b1b805d13322bda6290 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:28:48.961232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:48.961521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:48.961831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:48.969916 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2396/4737] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:48.982574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:48.984413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:48.984590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:48.985905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:49.000723 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:49.058193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1889188-ebf2-47ca-9a6e-6effd70fcbd1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:49.110741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2342/4738] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:49.132732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:49.186064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:49.187079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:49.187697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:49.188463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:49.200926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:49.202708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:49.229651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2397/4739] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:28:49.241320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978886b-b408-4e1f-af42-ca6302361d4f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:49.246703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:49.247174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:49.247492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:49.247826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:49.260823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:49.263734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:49.277835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2343/4740] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:28:49.691607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:49.693638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:49.717921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77a56-89ad-41df-9d53-d6ae89183622 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:49.739255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:49.741036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:49.741938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:49.742440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] PATH_INFO: `/v3/projects/af5412362d9b4478b8fcd9990cf3b924` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:49.743912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5412362d9b4478b8fcd9990cf3b924)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:49.747858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:49.822280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:49.830686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:49.864043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b401a-8095-424b-8182-645475e47b8d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:49.870748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5412362d9b4478b8fcd9990cf3b924', 'request_id': 'req-27fdb69f-7c47-467e-aa14-d8781faf0a96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:49.881782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5412362d9b4478b8fcd9990cf3b924', 'request_id': 'req-27fdb69f-7c47-467e-aa14-d8781faf0a96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:49.914351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5412362d9b4478b8fcd9990cf3b924', 'request_id': 'req-27fdb69f-7c47-467e-aa14-d8781faf0a96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:49.943574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] The token cache is being invalidate because project af5412362d9b4478b8fcd9990cf3b924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:49.943969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:49.945635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-27fdb69f-7c47-467e-aa14-d8781faf0a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:49.949186 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2398/4741] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:49 2022] DELETE /identity/v3/projects/af5412362d9b4478b8fcd9990cf3b924 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:49.959842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595192-a014-421b-aba3-57f082bc5e9a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:49.966362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595192-a014-421b-aba3-57f082bc5e9a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:49.966641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595192-a014-421b-aba3-57f082bc5e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.011680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1f595192-a014-421b-aba3-57f082bc5e9a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:50.016516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1f595192-a014-421b-aba3-57f082bc5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:50.026753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.027705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.027984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.028270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] PATH_INFO: `/v3/projects/59e3b64beccb431cb56759cc945d1873` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.029905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e3b64beccb431cb56759cc945d1873)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.031849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.040381 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2399/4742] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:50.049914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.050848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.050848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.095568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:50.099089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:50.123034 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2400/4743] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:50.126921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.132319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e3b64beccb431cb56759cc945d1873', 'request_id': 'req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.142300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e3b64beccb431cb56759cc945d1873', 'request_id': 'req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.146126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd7863-6ed7-417c-936e-a77f6d66bba4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.150250 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:50.152557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e3b64beccb431cb56759cc945d1873', 'request_id': 'req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.179338 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:50.183224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] The token cache is being invalidate because project 59e3b64beccb431cb56759cc945d1873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:50.183526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.185474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.191750 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2344/4744] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:49 2022] DELETE /identity/v3/projects/59e3b64beccb431cb56759cc945d1873 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:28:50.195993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.198852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:50.276897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.277847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.278275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.278696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.279815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:50.280394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.282175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.303262 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2401/4745] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:28:50.304509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.307007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:50.326876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4ceca-2b73-4fcd-89a3-4bc364b65ee5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.344195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573c4a0-9a38-4fab-87d9-3a453e2b80a1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.344325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.345051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.345336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.348506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.349508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.352913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.356484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.357384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.357752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.357971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] PATH_INFO: `/v3/users/8f08280ce3c3436c8b8f437dc1457660` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.360577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f08280ce3c3436c8b8f437dc1457660)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.367630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.423246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2402/4746] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:50 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:50.424757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.474805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f08280ce3c3436c8b8f437dc1457660'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.492944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f08280ce3c3436c8b8f437dc1457660'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.506289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f08280ce3c3436c8b8f437dc1457660'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.540966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f08280ce3c3436c8b8f437dc1457660'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.541749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f08280ce3c3436c8b8f437dc1457660'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:50.561860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2345/4747] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:50 2022] DELETE /identity/v3/users/8f08280ce3c3436c8b8f437dc1457660 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:50.575817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be75ec-cb1f-4497-9784-5e853a592479 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.673872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.686232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.687063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.687425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.688593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.691657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.724606 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2403/4748] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:50 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:50.739187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.740804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:50.757112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390679-6d99-4575-b3c4-b438f5536805 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.764316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.765376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.765959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.766443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.767435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.770172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.786882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2346/4749] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:50.790569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.803500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed5b2-2d58-4e0c-b268-ef1741b1e94e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.811037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.812974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.813496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.814063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.827549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.833588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.857279 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2404/4750] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:50.858673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:50.871825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc373373-7dce-41de-aaf3-74a7356fa0b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:50.883958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:50.885251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:50.886570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:50.887038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] PATH_INFO: `/v3/projects/f5c5d72c5b304cfd89bced7f8b52f258/users/5dfadb07948d4fa49089f330f06b0294/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:50.907798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c5d72c5b304cfd89bced7f8b52f258, user_id=5dfadb07948d4fa49089f330f06b0294, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:50.912740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cca12-a773-45f0-93b4-6c9288569585 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:50.933638 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2347/4751] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:50 2022] PUT /identity/v3/projects/f5c5d72c5b304cfd89bced7f8b52f258/users/5dfadb07948d4fa49089f330f06b0294/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:51.013448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.015620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.038102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.038406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.038659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.056271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c10d-230c-4da8-8e16-700024f23b78 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:51.070566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] MFA Rules not processed for user `5dfadb07948d4fa49089f330f06b0294`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:51.071798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.088811 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:51.100954 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:51.172988 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2348/4752] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:28:51.180519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:51.181421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.181718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.181998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] PATH_INFO: `/v3/projects/1830a44074dc4694b793b78a9d880457` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.184272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1830a44074dc4694b793b78a9d880457)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:51.185865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:51.197010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.199235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.281849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1830a44074dc4694b793b78a9d880457', 'request_id': 'req-68f9af0a-800d-47ba-be0a-fc1385fac1d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:51.294822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1412-457f-4e39-b9be-d9dc3b888099 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:51.297731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1830a44074dc4694b793b78a9d880457', 'request_id': 'req-68f9af0a-800d-47ba-be0a-fc1385fac1d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:51.318721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1830a44074dc4694b793b78a9d880457', 'request_id': 'req-68f9af0a-800d-47ba-be0a-fc1385fac1d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:51.346250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] The token cache is being invalidate because project 1830a44074dc4694b793b78a9d880457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:51.346555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:51.349416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68f9af0a-800d-47ba-be0a-fc1385fac1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:51.355204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:51.356914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.357700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.358183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.359717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2405/4753] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:51 2022] DELETE /identity/v3/projects/1830a44074dc4694b793b78a9d880457 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:51.361030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.361160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.361451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.366271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.411242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:51.416381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.435113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:51.436753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dc4c6-36ae-48d3-aadd-95d08a2c84a8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:51.449285 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2349/4754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:28:51.582202 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2406/4755] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:51.591073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.591433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.591814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.634076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:51.636378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:51.656920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2350/4756] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:51.662259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.678086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a9bc-7039-40ed-bc0f-297215481423 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:51.692840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:51.693725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.695765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.696052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.697467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:28:51.698770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:51.701867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:51.733577 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2407/4757] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:28:51.735018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.750388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8a5e-17b8-4ddb-a747-95995078a0a6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:51.757453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:51.758553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.759757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.760256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.761226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:51.763663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:51.817196 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2351/4758] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:51 2022] POST /identity/v3/projects => generated 401 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:51.821389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.835799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ecb7-c14d-43ac-866d-61311d0f0401 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:51.882973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:51.927752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:51.928575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:51.928927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:51.929304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:51.930496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:51.934172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:51.976608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2408/4759] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:51 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:51.980983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:51.991936 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:52.000068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa5a3-52ae-4e69-816e-2d200609145f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.008584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.009819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.010173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.010639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.011719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.014356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.035552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.035813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2352/4760] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:52.051487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdc42b-2283-4dcb-bb22-ccb263f2c1d0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.057566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.062168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.062675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.063098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.064014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.067511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b667f-385b-4e62-a785-25fa4c282351 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.080744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2409/4761] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:28:52.086715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.100820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a2e28-5f1f-49d3-bc39-a1962635be5d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.121606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.123251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.123535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.124231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] PATH_INFO: `/v3/projects/29e6215a8c094ed88817fabac5138511/users/b684b719c4b34bfb991a7c733119e59a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.164281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e6215a8c094ed88817fabac5138511, user_id=b684b719c4b34bfb991a7c733119e59a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.167021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.205412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2353/4762] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:52 2022] PUT /identity/v3/projects/29e6215a8c094ed88817fabac5138511/users/b684b719c4b34bfb991a7c733119e59a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:52.219262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.219553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.219831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.281118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] MFA Rules not processed for user `b684b719c4b34bfb991a7c733119e59a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:52.283218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:52.431126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2410/4763] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:52.435671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.587504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f575-f0ca-4180-a6f0-9adf011725e3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.594016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.594718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.595003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.595282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.596008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.598521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.670764 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2354/4764] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:28:52 2022] POST /identity/v3/projects => generated 401 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:52.671117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.692533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeaf97-b015-44fa-a033-9a091fb2deb9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.821657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.822401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.824358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.825262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.826212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.829663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.869717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2411/4765] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:28:52 2022] POST /identity/v3/users => generated 307 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:28:52.872449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.898746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ebd7-5779-4cca-82ce-2d4e57fcd857 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.905941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.906764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.909148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.909414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:52.910676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:52.913411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:52.942154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2355/4766] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:52.943485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:52.969285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e379c-defc-47c8-ab40-2eab7a4d5d12 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:52.979398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:52.989545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:52.989545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:52.989892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] PATH_INFO: `/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af/users/bfa1d3bd352044b4912bf491a594f167/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:53.077560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c3ad7c12984998a8f74b1c652ca5af, user_id=bfa1d3bd352044b4912bf491a594f167, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:53.082116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:53.108722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2412/4767] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:52 2022] PUT /identity/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af/users/bfa1d3bd352044b4912bf491a594f167/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:53.114158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:53.139654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde8b8-7579-4357-bb3f-210dbfe3047e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:53.284840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:53.286887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:53.287888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:53.288315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:53.289629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:53.293689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf84b5e-191d-4b9a-9c7b-15de36c4817c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:53.312110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2356/4768] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:28:53.316683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:53.335569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45203b38-54cc-4913-9ce1-326cd362ac60 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:53.341533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:53.342732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:53.343162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:53.343579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] PATH_INFO: `/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af/users/bfa1d3bd352044b4912bf491a594f167/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:53.347328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c3ad7c12984998a8f74b1c652ca5af, user_id=bfa1d3bd352044b4912bf491a594f167, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:53.351088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:53.354458 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:53.369360 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2413/4769] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:28:53 2022] PUT /identity/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af/users/bfa1d3bd352044b4912bf491a594f167/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:53.381481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:53.382076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:53.382552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:53.432454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] MFA Rules not processed for user `bfa1d3bd352044b4912bf491a594f167`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:53.434902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:53.509224 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:53.577711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2357/4770] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:53.601003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:53.603818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:53.794612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e60de-6c9d-4913-90fa-44e7e728131a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:53.805884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:53.806700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:53.807216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:53.807635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:53.820396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:53.822343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:53.845902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2414/4771] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:54.947088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:54.950050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:54.986706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00629bef-3138-4454-a2ae-6825f1432d1f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:54.995548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:54.996699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:54.997192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:54.997870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:55.000805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:55.055093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:55.056805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:55.082888 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2358/4772] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:55.559646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:55.578624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ec75-c1c5-4e70-966b-10672996e39c service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:55.586806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:55.587478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:55.587765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:55.588043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:55.704873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:55.708086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd62e-ac4b-4b4a-92f0-6938023c47c5 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:55.725829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2415/4773] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:28:55.760154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:55.930375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45351b57-bbd4-4150-89a1-07f1fa7c74ff service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:55.939545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:55.941865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:55.942408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:55.942897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] PATH_INFO: `/v3/users/b684b719c4b34bfb991a7c733119e59a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:55.947635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b684b719c4b34bfb991a7c733119e59a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:55.965280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:56.063678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b684b719c4b34bfb991a7c733119e59a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:56.079481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b684b719c4b34bfb991a7c733119e59a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:56.092207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b684b719c4b34bfb991a7c733119e59a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:56.121316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b684b719c4b34bfb991a7c733119e59a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:56.122571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b684b719c4b34bfb991a7c733119e59a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:56.133363 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2359/4774] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:55 2022] DELETE /identity/v3/users/b684b719c4b34bfb991a7c733119e59a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:56.137655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:56.137971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:56.138260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:56.169954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:56.177606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:56.281724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2416/4775] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:56.345010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:56.349435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:56.407235 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:56.456916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad19bc6-3126-4d0a-9bb8-406746b04950 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:56.462688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:56.464029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:56.465583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:56.466063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:56.515240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:56.517460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:56.554659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2360/4776] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:28:58.264997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:58.269378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:58.292695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa825149-6dde-42c8-88dc-50364ffc49e0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:58.297816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:58.301460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:58.305340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:58.305919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] PATH_INFO: `/v3/projects/29e6215a8c094ed88817fabac5138511` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:58.309419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e6215a8c094ed88817fabac5138511)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:58.312393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:58.339201 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:28:58.416151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e6215a8c094ed88817fabac5138511', 'request_id': 'req-6b424c57-901a-4172-865c-ff2432f86971'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.423442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e6215a8c094ed88817fabac5138511', 'request_id': 'req-6b424c57-901a-4172-865c-ff2432f86971'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.436193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e6215a8c094ed88817fabac5138511', 'request_id': 'req-6b424c57-901a-4172-865c-ff2432f86971'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.452147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] The token cache is being invalidate because project 29e6215a8c094ed88817fabac5138511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:28:58.452732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.453633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b424c57-901a-4172-865c-ff2432f86971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.455925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2417/4777] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:58 2022] DELETE /identity/v3/projects/29e6215a8c094ed88817fabac5138511 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:58.460370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:58.481791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00260fd-f171-4745-b3bc-ace2f30cfca8 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:28:58.614334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:28:58.620680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:58.621282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:58.621743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] PATH_INFO: `/v3/users/bfa1d3bd352044b4912bf491a594f167` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:58.623452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa1d3bd352044b4912bf491a594f167)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:28:58.625540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:28:58.715130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa1d3bd352044b4912bf491a594f167'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.729528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa1d3bd352044b4912bf491a594f167'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.741744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa1d3bd352044b4912bf491a594f167'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.758601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa1d3bd352044b4912bf491a594f167'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.759615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa1d3bd352044b4912bf491a594f167'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:28:58.760331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b740-0ec5-43b4-b3a4-229e9b1b4e3d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:28:58.760745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b740-0ec5-43b4-b3a4-229e9b1b4e3d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:28:58.761022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9b740-0ec5-43b4-b3a4-229e9b1b4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:28:58.771679 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2361/4778] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:28:58 2022] DELETE /identity/v3/users/bfa1d3bd352044b4912bf491a594f167 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:28:58.793002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ecb9b740-0ec5-43b4-b3a4-229e9b1b4e3d None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:28:58.795012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ecb9b740-0ec5-43b4-b3a4-229e9b1b4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:58.890262 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2418/4779] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:28:59.887414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:28:59.889494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:28:59.995232 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:00.012114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3b13f-0cd0-4040-a0be-fa0566aecf53 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:00.020251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:00.021554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.022064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.022561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] PATH_INFO: `/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.039806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c3ad7c12984998a8f74b1c652ca5af)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:00.043025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:00.208845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c3ad7c12984998a8f74b1c652ca5af', 'request_id': 'req-943d40a0-6fc6-47fe-ab96-a155c745d5d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:00.221172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c3ad7c12984998a8f74b1c652ca5af', 'request_id': 'req-943d40a0-6fc6-47fe-ab96-a155c745d5d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:00.232246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c3ad7c12984998a8f74b1c652ca5af', 'request_id': 'req-943d40a0-6fc6-47fe-ab96-a155c745d5d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:00.257298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] The token cache is being invalidate because project d4c3ad7c12984998a8f74b1c652ca5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:00.258057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:00.260667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-943d40a0-6fc6-47fe-ab96-a155c745d5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:00.282858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2362/4780] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:28:59 2022] DELETE /identity/v3/projects/d4c3ad7c12984998a8f74b1c652ca5af => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:00.306372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.307286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.307717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.352469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:00.355587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:00.481971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2419/4781] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:00.491227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.491589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.493218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.517910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:00.519797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:00.531260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2363/4782] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:00.535466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:00.580182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4c92-7968-466a-b1ac-ab0e6967c4e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:00.596220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:00.598125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.598676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.610825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.613541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:00.614372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:00.615015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:00.617012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:00.617594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:00.664495 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2420/4783] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:00.666574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:00.697094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537136d7-b311-4eb2-8779-c64c70d7f430 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:00.723665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:00.730117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.731535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.732021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.733107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:00.735862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:00.767929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc7831-3417-43e2-ba68-1d309d951bc9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:00.772584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:00.773319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.773646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.773968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.776627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:00.788101 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2421/4784] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:00 2022] POST /identity/v3/projects => generated 395 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:00.790619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:00.834442 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:00.918772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:00.920264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:00.945332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2364/4785] 10.222.0.27 () {60 vars in 1396 bytes} [Sun Jul 24 01:29:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:00.968096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616b3aa-fddf-4000-864a-dfa47aa4c39e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:00.991927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:00.992851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:00.993205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:00.993582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:00.994437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:00.997392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:01.027854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2422/4786] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:00 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:01.031941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:01.048970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f070c-8915-4bf6-b881-3c516ecf3b8d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:01.058611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:01.059592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:01.060074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:01.060546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:01.061871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:01.064587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:01.092005 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2365/4787] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:29:01.094891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:01.136321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c764-314d-44f8-aa44-a91380249a05 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:01.143889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:01.144576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:01.144858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:01.145652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:01.146714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:01.148761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3471d-e743-4322-99c5-2ff891049da5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:01.189812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2423/4788] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:01.195921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:01.214061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6423b07-e4b9-44ae-b293-b507b4ecfc79 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:01.222480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:01.223734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:01.224252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:01.225416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] PATH_INFO: `/v3/projects/fa9a45e048e2414e8e6bf26604ad85d5/users/09bd196b3fa749229907457ebf0030b2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:01.257950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9a45e048e2414e8e6bf26604ad85d5, user_id=09bd196b3fa749229907457ebf0030b2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:01.261852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:01.268933 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:01.325858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2366/4789] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:01 2022] PUT /identity/v3/projects/fa9a45e048e2414e8e6bf26604ad85d5/users/09bd196b3fa749229907457ebf0030b2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:29:01.339204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:01.340078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:01.340698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:01.439702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] MFA Rules not processed for user `09bd196b3fa749229907457ebf0030b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:01.444781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:01.634863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:01.637099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:01.650967 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2424/4790] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:01.794759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0250-359a-40c5-8047-9403f74239e2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:01.804497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:01.805855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:01.806661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:01.806661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:01.806911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:01.809241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:01.810687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:01.940936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:01.942800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:01.967145 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2367/4791] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:29:01.994677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:02.045162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931d625-6ead-4692-bca6-e103e85c7aba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:02.067450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:02.070477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:02.072375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:02.073419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:02.101114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:02.104341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:02.144795 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2425/4792] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:29:02.152002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1a95e-22fb-4973-b97b-13a6f8614993 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:02.157324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:02.158275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:02.158763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:02.159966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:02.163528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:02.178521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:02.180335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc884c-7cf3-4f9d-8f8e-0547c606421f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:02.194243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2368/4793] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:29:02.550116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:02.558101 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:02.632975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7d12-3d19-4d9a-9865-41ddf21b628e service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:02.639176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:02.640686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:02.641335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:02.641802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] PATH_INFO: `/v3/users/09bd196b3fa749229907457ebf0030b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:02.643191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=09bd196b3fa749229907457ebf0030b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:02.647106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:02.733509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09bd196b3fa749229907457ebf0030b2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:02.739296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09bd196b3fa749229907457ebf0030b2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:02.758663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09bd196b3fa749229907457ebf0030b2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:02.776695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09bd196b3fa749229907457ebf0030b2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:02.820671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09bd196b3fa749229907457ebf0030b2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:02.836519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2426/4794] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:29:02 2022] DELETE /identity/v3/users/09bd196b3fa749229907457ebf0030b2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:29:02.841433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:02.842539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:02.843013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:02.888361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:02.889785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:03.022197 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:03.072954 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2369/4795] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:03.091733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:03.093305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:03.261300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38785b3f-fbd8-4076-909b-f5ea856bdfdc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:03.272327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:03.272993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:03.273270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:03.273542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:03.304022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:03.305506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9d99-1da2-498a-95a4-3197d5ed3613 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:03.346544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2427/4796] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:05.164311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:05.166860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:05.185110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78d8a-e349-4e3e-85ef-87a7f6331f1e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:05.193926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:05.195059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:05.195561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:05.196280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] PATH_INFO: `/v3/projects/fa9a45e048e2414e8e6bf26604ad85d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:05.198149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9a45e048e2414e8e6bf26604ad85d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:05.200794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:05.355598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9a45e048e2414e8e6bf26604ad85d5', 'request_id': 'req-eebba27a-f590-4956-9e6c-697639c065fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:05.375317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9a45e048e2414e8e6bf26604ad85d5', 'request_id': 'req-eebba27a-f590-4956-9e6c-697639c065fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:05.402269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9a45e048e2414e8e6bf26604ad85d5', 'request_id': 'req-eebba27a-f590-4956-9e6c-697639c065fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:05.438511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] The token cache is being invalidate because project fa9a45e048e2414e8e6bf26604ad85d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:05.438875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:05.439669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eebba27a-f590-4956-9e6c-697639c065fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:05.441807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2370/4797] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:05 2022] DELETE /identity/v3/projects/fa9a45e048e2414e8e6bf26604ad85d5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:05.446898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:05.447358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:05.447358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:05.480031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:05.481134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:05.526835 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:05.647200 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2428/4798] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:05.648952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:05.649439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:05.649902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:05.700859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:05.711488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:05.729792 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2371/4799] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:05.734356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:05.752830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada637c-5d04-4c5c-a563-1089d558a403 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:05.766016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:05.767011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:05.767533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:05.768009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:05.770065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:05.770469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:05.772613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:05.787930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2429/4800] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:05.791925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:05.824079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07afc8-848e-4d1b-a12a-0d4125399919 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:05.833951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:05.834902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:05.835182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:05.835454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:05.836156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:05.838289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:05.898536 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2372/4801] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:05 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:05.902470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:05.921376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729de790-ceac-4529-a763-ada7a7cd7bbc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:06.094795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:06.095765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:06.096048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:06.096319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:06.097620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:06.114333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:06.191990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2430/4802] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:05 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:06.194465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:06.213198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c432e74-dbf8-4be7-8ce0-8c7ab6b4d3f3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:06.227397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:06.228355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:06.228821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:06.229279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:06.230215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:06.232284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:06.265248 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2373/4803] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:06.266787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:06.282165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5984f-9549-4c26-9de6-ce1ce8a8c650 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:06.298923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:06.299855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:06.300297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:06.301109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:06.302296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:06.304177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00111985-5500-41c2-ad8d-dac8e2dc246b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:06.340276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2431/4804] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:06.341446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:06.354642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee35c-c51d-469b-89f7-ea1f8fb17700 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:06.360925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:06.362980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:06.363465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:06.364909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] PATH_INFO: `/v3/projects/717a2a132e4e4f1096c3093b564dd125/users/b6eafce876174eb5a438f02cd62e8129/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:06.393777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=717a2a132e4e4f1096c3093b564dd125, user_id=b6eafce876174eb5a438f02cd62e8129, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:06.396933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:06.441776 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2374/4805] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:06 2022] PUT /identity/v3/projects/717a2a132e4e4f1096c3093b564dd125/users/b6eafce876174eb5a438f02cd62e8129/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:06.445624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:06.446985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:06.447919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:06.508049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] MFA Rules not processed for user `b6eafce876174eb5a438f02cd62e8129`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:06.511615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:06.741160 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2432/4806] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:06.798675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:06.800875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:06.983472 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:07.002207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c6ab-5c50-4c9f-a70e-6c2e49447d7c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:07.022964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:07.023650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:07.023937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:07.024217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:07.055099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:07.056914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e971-081f-4677-b2c4-7db0a615cf21 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:07.076732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2375/4807] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:11.643601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:11.709409 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:11.792112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae9ed4-5fc3-4959-9368-dcc97bec33ab None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:11.798742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:11.800486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:11.801604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:11.802087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] PATH_INFO: `/v3/users/b6eafce876174eb5a438f02cd62e8129` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:11.803649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6eafce876174eb5a438f02cd62e8129)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:11.805855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:11.912232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6eafce876174eb5a438f02cd62e8129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:11.922254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6eafce876174eb5a438f02cd62e8129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:11.936609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6eafce876174eb5a438f02cd62e8129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:11.948867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6eafce876174eb5a438f02cd62e8129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:11.967992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6eafce876174eb5a438f02cd62e8129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:11.982302 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2433/4808] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:29:11 2022] DELETE /identity/v3/users/b6eafce876174eb5a438f02cd62e8129 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:11.986693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:11.987342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:11.987527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:12.007787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:12.009831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:12.165614 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2376/4809] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:12.188109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:12.201136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:12.349958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d6ac6-72a0-4ea3-821c-8010f398af42 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:12.354484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:12.355666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:12.356439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:12.356944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:12.376290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:12.378511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdc56f-342f-416c-aeba-d62faf2a4cd8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:12.398143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2434/4810] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:14.677101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:14.678738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:14.722922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdaa241-f624-4b77-90c5-b697952da5e7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:14.730040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:14.731680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:14.732249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:14.732671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] PATH_INFO: `/v3/projects/717a2a132e4e4f1096c3093b564dd125` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:14.734700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717a2a132e4e4f1096c3093b564dd125)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:14.737188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:14.819312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717a2a132e4e4f1096c3093b564dd125', 'request_id': 'req-e95d1668-6cc4-43b5-9aee-9832fce5fca5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:14.828320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717a2a132e4e4f1096c3093b564dd125', 'request_id': 'req-e95d1668-6cc4-43b5-9aee-9832fce5fca5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:14.836064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717a2a132e4e4f1096c3093b564dd125', 'request_id': 'req-e95d1668-6cc4-43b5-9aee-9832fce5fca5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:14.870181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] The token cache is being invalidate because project 717a2a132e4e4f1096c3093b564dd125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:14.871410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:14.876002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e95d1668-6cc4-43b5-9aee-9832fce5fca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:14.881541 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2377/4811] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:14 2022] DELETE /identity/v3/projects/717a2a132e4e4f1096c3093b564dd125 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:14.888783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:14.890759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:14.891451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:14.935283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:14.938244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:15.057581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:15.120601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2435/4812] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:15.123658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.123939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.124212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.149915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:15.151151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:15.174065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2378/4813] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:15.178760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.199222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ef876-9cda-46cb-9d4b-65cd16dcf0db None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.207311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.208097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.208473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.209519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.210389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:15.210767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.212507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.239864 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2436/4814] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:15.241059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.250827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b9b10-dd8d-4a04-801a-56a75f6e776f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.265505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.266370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.266762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.267613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.268496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.273515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.337414 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2379/4815] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:15 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:15.342176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.366907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ef26-4b9c-41ff-9e74-5ff936e28ffe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.473380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.476055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.476565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.477044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.481603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.493014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.559778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2437/4816] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:15 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:29:15.564089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.581465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a577-6810-4ca5-8653-a95eff6c28a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.594498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.597877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.598602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.599776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.603011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.607006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.637436 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2380/4817] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:15.638263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.682601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f747f9-8872-4234-bc27-b088565f5b4d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.695756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.697585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.709151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.713355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.715386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.726887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a28ae7-7f6e-4b21-a581-eb1c31484229 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.769165 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2438/4818] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:29:15.771794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:15.786335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5073f4-1228-4d45-bd8c-2b54e6d661af admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:15.797331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:15.800119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.800403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.803858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] PATH_INFO: `/v3/projects/b97b2217fca247759ee6e9f15d150866/users/f6a5e8716f324b53b51e8d34cb704321/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.831738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97b2217fca247759ee6e9f15d150866, user_id=f6a5e8716f324b53b51e8d34cb704321, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:15.835307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:15.872404 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2381/4819] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:15 2022] PUT /identity/v3/projects/b97b2217fca247759ee6e9f15d150866/users/f6a5e8716f324b53b51e8d34cb704321/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:29:15.879467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:15.879769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:15.880199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:15.909018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:15.912730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:16.032035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2439/4820] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:16.085588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:16.091092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:16.107189 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:16.224730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bbaae-cd7c-4214-9740-adac80e17a9e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:16.232441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:16.233258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:16.233935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:16.234407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:16.263917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:16.266408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:16.297187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2382/4821] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:23.011231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:23.012713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:23.145628 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:23.194476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a4f0c-e77b-46a9-b8f9-28d8cd598d80 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:23.203306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:23.206371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:23.206954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:23.207567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:23.212474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:23.243628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:23.246178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:23.272669 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2440/4822] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:23.970646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:23.972779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:24.170707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a609-ff9b-483a-bd2d-711a0bc7230b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:24.181582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:24.185495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:24.185495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:24.185495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:24.188266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:24.211630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:24.212656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6772-7fb2-4cde-ae9b-6545631aeebf service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:24.228168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2383/4823] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:24.318314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:24.319812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:24.348242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607532b1-959e-4a5b-8ede-0a28adf993a6 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:24.355802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:24.357309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:24.357929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:24.361600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] PATH_INFO: `/v3/users/a1e6810811b14037afc8e2891be22039` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:24.364977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e6810811b14037afc8e2891be22039)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:24.367791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:24.530242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e6810811b14037afc8e2891be22039'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:24.532573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e6810811b14037afc8e2891be22039'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:24.550141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e6810811b14037afc8e2891be22039'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:24.563797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e6810811b14037afc8e2891be22039'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:24.594747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e6810811b14037afc8e2891be22039'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:24.612909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2441/4824] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:29:24 2022] DELETE /identity/v3/users/a1e6810811b14037afc8e2891be22039 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:24.637648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:24.638247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:24.638746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:24.662741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:24.664307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:24.766066 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2384/4825] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:24.835474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:24.841135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:25.002919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3533-265b-42fd-87a7-c58bf19c7b94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:25.010791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:25.011402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:25.011691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:25.012028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:25.033862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:25.035940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c90b6-0341-4159-a23a-92f027bca467 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:25.061655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2442/4826] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:25.126784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:25.131011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:25.228885 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:25.252731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885fc6a-bd46-4093-ab29-90a450854460 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:25.257723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:25.258668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:25.258937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:25.259219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] PATH_INFO: `/v3/projects/217f2c9b33dc4d63a778c93abc91f70f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:25.260649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217f2c9b33dc4d63a778c93abc91f70f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:25.262867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:25.367284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217f2c9b33dc4d63a778c93abc91f70f', 'request_id': 'req-743dab4b-0775-49cc-b79e-f863417eafc8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:25.390439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217f2c9b33dc4d63a778c93abc91f70f', 'request_id': 'req-743dab4b-0775-49cc-b79e-f863417eafc8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:25.405384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217f2c9b33dc4d63a778c93abc91f70f', 'request_id': 'req-743dab4b-0775-49cc-b79e-f863417eafc8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:25.435898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] The token cache is being invalidate because project 217f2c9b33dc4d63a778c93abc91f70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:25.436307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:25.437296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-743dab4b-0775-49cc-b79e-f863417eafc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:25.444712 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2385/4827] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:25 2022] DELETE /identity/v3/projects/217f2c9b33dc4d63a778c93abc91f70f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:25.448973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096849-b981-42c7-b044-d85e02482387 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:25.449923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096849-b981-42c7-b044-d85e02482387 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:25.450355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096849-b981-42c7-b044-d85e02482387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:25.555586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10096849-b981-42c7-b044-d85e02482387 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:25.556713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10096849-b981-42c7-b044-d85e02482387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:25.736363 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:25.873512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2443/4828] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:25.884314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:25.884855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:25.885110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:25.955831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:25.960034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:25.997473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2386/4829] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:25.999617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096849-b981-42c7-b044-d85e02482387 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.014459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096849-b981-42c7-b044-d85e02482387 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.028980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.029764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.031351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.031737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.032629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:26.054722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.057520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.091305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2444/4830] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:26.095189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.110197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3f5e9-8d5f-4520-8586-30ea4f90d939 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.136426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.137117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.138697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.142064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.143195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.145623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.199221 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2387/4831] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:26 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:26.203261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.223480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b024-996a-467a-bea1-6713ca28472a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.414615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.415326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.415744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.415936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.417820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.419907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.467772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2445/4832] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:26 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:26.468382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.484531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b9dd-bc73-4a64-954b-1c3466d61c03 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.498447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.500910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.501810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.503607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.506668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.508474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.545708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2388/4833] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:26.550138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.566071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf06e3-4e01-480d-9129-8af38509f2cc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.576471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.577186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.577443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.577754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.578500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.584191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081ffb9-c2ad-4593-acd4-97f82fbc3257 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.611465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.612991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2446/4834] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:26.625372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd4a2-ab15-44b2-adda-664801eaf6a0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:26.638102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:26.640217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.640505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.643366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] PATH_INFO: `/v3/projects/972661c3565a4312b050c50083f3c91f/users/803ee2ed518446dc8953a707f171cbc4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.691640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=972661c3565a4312b050c50083f3c91f, user_id=803ee2ed518446dc8953a707f171cbc4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:26.697303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:26.727513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2389/4835] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:26 2022] PUT /identity/v3/projects/972661c3565a4312b050c50083f3c91f/users/803ee2ed518446dc8953a707f171cbc4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:29:26.733576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:26.733900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:26.734181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:26.770449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:26.773660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:26.890575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:26.893240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:26.991333 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2447/4836] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:27.129822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3573-8d71-467d-bd0a-9f8176ba9d0c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:27.136191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:27.137131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:27.138168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:27.138606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:27.140727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:27.157718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:27.158168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:27.159975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:27.160108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:27.166434 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:27.186133 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2390/4837] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:27.291719 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:27.319671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44d082-73a9-4614-8583-2afd62dadedd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:27.325508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:27.326421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:27.326800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:27.327170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:27.340532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:27.342181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51dc15-4460-40d4-a250-b09ae1ebf1ca service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:27.365012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2448/4838] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:28.993725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:28.996021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:29.031152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9870-b290-4e4a-96ed-2c7142630525 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:29.047099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:29.047777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:29.050239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:29.050623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:29.057877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:29.146181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:29.147956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:29.168736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2391/4839] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:32.199588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd70df8-1b76-4693-8e7c-b6deff8b4484 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:32.200140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd70df8-1b76-4693-8e7c-b6deff8b4484 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:32.200352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd70df8-1b76-4693-8e7c-b6deff8b4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:32.245978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fdd70df8-1b76-4693-8e7c-b6deff8b4484 None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:32.247709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fdd70df8-1b76-4693-8e7c-b6deff8b4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:32.412056 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2449/4840] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:32.438091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:32.440990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:32.478522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe704a-38e8-4d55-9438-e4a19f16258a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:32.485579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:32.486592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:32.487044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:32.489158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:32.499075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:32.501022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:32.526010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2392/4841] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:34.225702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020455-e596-48c0-834a-1d0ef27c4466 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:34.226385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020455-e596-48c0-834a-1d0ef27c4466 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:34.226778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020455-e596-48c0-834a-1d0ef27c4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:34.280808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6e020455-e596-48c0-834a-1d0ef27c4466 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:34.286213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e020455-e596-48c0-834a-1d0ef27c4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:34.433158 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2450/4842] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:36.357803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:36.372743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:36.405464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d460363-d889-4187-8dff-b93bd5e939ae service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:36.420365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:36.422525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:36.422980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:36.423604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] PATH_INFO: `/v3/users/5dfadb07948d4fa49089f330f06b0294` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:36.461356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfadb07948d4fa49089f330f06b0294)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:36.471692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:36.628065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfadb07948d4fa49089f330f06b0294'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:36.646669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfadb07948d4fa49089f330f06b0294'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:36.658430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfadb07948d4fa49089f330f06b0294'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:36.692070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfadb07948d4fa49089f330f06b0294'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:36.693085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfadb07948d4fa49089f330f06b0294'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:36.713442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2393/4843] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:29:36 2022] DELETE /identity/v3/users/5dfadb07948d4fa49089f330f06b0294 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:36.715245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:36.716800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:36.717321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:36.819748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:36.843027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:37.092806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2451/4844] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:37.104317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:37.106472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:37.357185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854fbb8-6a4b-4b37-8a23-e923ffe1c803 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:37.366928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:37.367611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:37.368101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:37.369207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:37.391469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:37.393564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ae90b-ab0e-47ab-83f7-af88024e6490 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:37.421393 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2394/4845] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:37.983734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:37.986755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:38.016509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21154f20-23e1-4fcb-a177-d912089f3568 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:38.036417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:38.037605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:38.038164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:38.038988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] PATH_INFO: `/v3/projects/f5c5d72c5b304cfd89bced7f8b52f258` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:38.050411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c5d72c5b304cfd89bced7f8b52f258)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:38.053523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:38.151796 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:38.290845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c5d72c5b304cfd89bced7f8b52f258', 'request_id': 'req-389d7cfd-01b0-4d93-a47c-c6038f4549a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:38.343043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c5d72c5b304cfd89bced7f8b52f258', 'request_id': 'req-389d7cfd-01b0-4d93-a47c-c6038f4549a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:38.374957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c5d72c5b304cfd89bced7f8b52f258', 'request_id': 'req-389d7cfd-01b0-4d93-a47c-c6038f4549a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:38.428596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] The token cache is being invalidate because project f5c5d72c5b304cfd89bced7f8b52f258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:38.428898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:38.438072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-389d7cfd-01b0-4d93-a47c-c6038f4549a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:38.447933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2452/4846] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:37 2022] DELETE /identity/v3/projects/f5c5d72c5b304cfd89bced7f8b52f258 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:38.454946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:38.455473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:38.455710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:38.505188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:38.515737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:38.661766 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:38.712797 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2395/4847] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:38.714067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:38.714373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:38.714652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:38.797988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:38.811430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:38.874907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2453/4848] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:38.879753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:38.900253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265b4c6-41c6-4598-b0b3-b2604511ceac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:38.905359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:38.906097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:38.906372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:38.906657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:38.907412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:38.907804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:38.909579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:38.952914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:38.958607 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2396/4849] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:38.964152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb72313-4013-4f1d-9496-81de70c57d73 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:38.990428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:38.991824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:38.992321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:38.992832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:38.993764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:39.006852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:39.097462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:39.099006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2454/4850] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:38 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:39.134061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8414-868f-44be-bc98-9c2889c2d795 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:39.349970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:39.359316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:39.359916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:39.360375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:39.362255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:39.364479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:39.433891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2397/4851] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:39 2022] POST /identity/v3/users => generated 282 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:29:39.434814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:39.454152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b129-4fcd-4b60-9031-c9c97e40b33a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:39.494364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:39.495070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:39.495352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:39.495625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:39.496372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:39.512369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:39.561065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2455/4852] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:29:39.566099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:39.586465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622feea-fa1d-4ebf-aebc-f3b8a2ca4359 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:39.615930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:39.617395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:39.617876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:39.618157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:39.620100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:39.624074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b6eab-8efe-4117-b410-9c9cbd0806b7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:39.680381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2398/4853] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:39.681589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:39.700778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4214-e415-420f-82ff-6ad975b349bb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:39.723965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539665-c91c-4030-a702-d90210096263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:39.724896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539665-c91c-4030-a702-d90210096263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:39.725179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539665-c91c-4030-a702-d90210096263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:39.725455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539665-c91c-4030-a702-d90210096263 admin admin] PATH_INFO: `/v3/projects/8655f96fdcb24c529199de8c0c090e0f/users/670d80842fec4128b660ed94e523c1bb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:39.812138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539665-c91c-4030-a702-d90210096263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8655f96fdcb24c529199de8c0c090e0f, user_id=670d80842fec4128b660ed94e523c1bb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:39.816376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539665-c91c-4030-a702-d90210096263 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:39.867236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2456/4854] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:39 2022] PUT /identity/v3/projects/8655f96fdcb24c529199de8c0c090e0f/users/670d80842fec4128b660ed94e523c1bb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:39.880590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea763-41e6-4603-a7b7-2230d44ddb28 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:39.880884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea763-41e6-4603-a7b7-2230d44ddb28 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:39.881160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea763-41e6-4603-a7b7-2230d44ddb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.039332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-48eea763-41e6-4603-a7b7-2230d44ddb28 None None] MFA Rules not processed for user `670d80842fec4128b660ed94e523c1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:40.044530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-48eea763-41e6-4603-a7b7-2230d44ddb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:40.253272 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2399/4855] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:40.257858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539665-c91c-4030-a702-d90210096263 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:40.432185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026633-1619-489b-aded-132a016a2277 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.432519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026633-1619-489b-aded-132a016a2277 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.432815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026633-1619-489b-aded-132a016a2277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.441959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539665-c91c-4030-a702-d90210096263 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:40.463210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:40.463896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.464175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.464449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.465208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:40.467431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:40.481535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8a026633-1619-489b-aded-132a016a2277 None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:40.482878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8a026633-1619-489b-aded-132a016a2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:40.535755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2457/4856] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:40 2022] POST /identity/v3/projects => generated 363 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:40.539444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:40.607594 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:40.631010 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:40.633733 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2400/4857] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:40.705638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59f84-e100-47a2-8f18-004a39badf07 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:40.722845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:40.725169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.726303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.726584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.728620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:40.734474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503541a0-5ab9-4b16-90d9-84974df964f8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:40.796978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a026633-1619-489b-aded-132a016a2277 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:40.798990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2458/4858] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:40 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:29:40.819199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.823362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a026633-1619-489b-aded-132a016a2277 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:40.826735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.827082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.846859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:40.847936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.849989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.850270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:40.851020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:40.852638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:40.872977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:40.885195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:40.891008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2401/4859] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:40.895825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:40.925853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684ab92-c3ad-4cf1-8d70-04e9e5cca771 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:40.969896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:40.974027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:40.974384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:40.974589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] PATH_INFO: `/v3/projects/1c98015caa554565a87c8a06554439ab/users/761646aa13f64e32a57acd7a5ba38bdf/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:41.058471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c98015caa554565a87c8a06554439ab, user_id=761646aa13f64e32a57acd7a5ba38bdf, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:41.061833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:41.099002 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2402/4860] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:40 2022] PUT /identity/v3/projects/1c98015caa554565a87c8a06554439ab/users/761646aa13f64e32a57acd7a5ba38bdf/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:41.100752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:41.114307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2459/4861] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:41.279871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accda58c-c252-4c31-aa60-05e78c761112 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:41.292830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:41.293526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:41.293873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:41.294149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:41.294887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:41.297268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd7080-67d7-4ffb-9c8c-07d44054921c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:41.330709 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2403/4862] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:41.332263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:41.354994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff818bf-5c7c-461a-9890-196526f78c7c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:41.369474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:41.370427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:41.370709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:41.370985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] PATH_INFO: `/v3/projects/1c98015caa554565a87c8a06554439ab/users/761646aa13f64e32a57acd7a5ba38bdf/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:41.380625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c98015caa554565a87c8a06554439ab, user_id=761646aa13f64e32a57acd7a5ba38bdf, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:41.384180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:41.419651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2460/4863] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:41 2022] PUT /identity/v3/projects/1c98015caa554565a87c8a06554439ab/users/761646aa13f64e32a57acd7a5ba38bdf/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:41.429980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:41.430526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:41.431096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:41.490425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] MFA Rules not processed for user `761646aa13f64e32a57acd7a5ba38bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:41.492122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:41.616701 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2404/4864] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:41.632088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:41.633959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:41.717685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac00bbc-9d51-4da1-94b2-b95fba68e876 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:41.721780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:41.722383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:41.722646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:41.722920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:41.735043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:41.737037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:41.750829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2461/4865] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:41.917956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:41.938173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34437c1-0534-439e-9eb8-ef822a1d2801 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:41.955454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:41.956477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:41.957479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:41.957934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:42.030550 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:42.092836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:42.094595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e446-13f3-444a-affe-6eb0b6a21b42 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:42.130295 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2405/4866] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:43.697914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:43.700445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:43.873011 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:43.928705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b7294-64e2-4461-bc58-9296f22ac9e9 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:43.942053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:43.942817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:43.943170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:43.943513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:43.949714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:43.978191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:43.982877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:44.014972 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2462/4867] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:47.856522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ecc9-45aa-4d5b-b9cc-28c300eed367 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:47.857067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ecc9-45aa-4d5b-b9cc-28c300eed367 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:47.857067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ecc9-45aa-4d5b-b9cc-28c300eed367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:47.890546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b824ecc9-45aa-4d5b-b9cc-28c300eed367 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:47.892355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b824ecc9-45aa-4d5b-b9cc-28c300eed367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:48.049537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2406/4868] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:48.404510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:48.406651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:48.575947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e4741-75e1-4518-95a7-90a9d199aec9 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:48.598839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:48.599936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:48.600772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:48.601885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] PATH_INFO: `/v3/users/5ab27e46e8534384abea2875fb9946df` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:48.602767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab27e46e8534384abea2875fb9946df)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:48.605056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:48.765834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab27e46e8534384abea2875fb9946df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:48.767096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab27e46e8534384abea2875fb9946df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:48.784822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab27e46e8534384abea2875fb9946df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:48.811575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab27e46e8534384abea2875fb9946df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:48.857314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b9aa4e7f-3bc7-4952-ba8f-05558324abb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab27e46e8534384abea2875fb9946df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:48.872637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2463/4869] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:29:48 2022] DELETE /identity/v3/users/5ab27e46e8534384abea2875fb9946df => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:49.727562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec858-ab45-476c-a6eb-14376062bf52 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:49.728145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec858-ab45-476c-a6eb-14376062bf52 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:49.728468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ec858-ab45-476c-a6eb-14376062bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:49.788439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2d3ec858-ab45-476c-a6eb-14376062bf52 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:49.792177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2d3ec858-ab45-476c-a6eb-14376062bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:50.015951 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2407/4870] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:50.427431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:50.428631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:50.429163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:50.477030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] MFA Rules not processed for user `803ee2ed518446dc8953a707f171cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:50.478753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:50.549884 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:50.582945 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2464/4871] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:50.593250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:50.594271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:50.595412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:50.643024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] MFA Rules not processed for user `803ee2ed518446dc8953a707f171cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:50.644374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:50.668969 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2408/4872] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:51.100861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:51.102840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:51.317993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e270-485b-4171-83c4-d034a56ef14c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:51.338691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:51.339623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:51.339912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:51.340194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] PATH_INFO: `/v3/projects/2ff39f2632ca408e9795b48dbcefc815` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:51.348729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff39f2632ca408e9795b48dbcefc815)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:51.359126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:51.499876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:51.502275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:51.638874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff39f2632ca408e9795b48dbcefc815', 'request_id': 'req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:51.676418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff39f2632ca408e9795b48dbcefc815', 'request_id': 'req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:51.707840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff39f2632ca408e9795b48dbcefc815', 'request_id': 'req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:51.762795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] The token cache is being invalidate because project 2ff39f2632ca408e9795b48dbcefc815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:29:51.763101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:51.767323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f96e5cc6-9d92-43ea-a0d9-cd6cc66b5ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:29:51.773250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2465/4873] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:29:51 2022] DELETE /identity/v3/projects/2ff39f2632ca408e9795b48dbcefc815 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:51.782594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ec08-a388-4e09-8b49-f0fb521fb098 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:51.783455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ec08-a388-4e09-8b49-f0fb521fb098 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:51.783756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ec08-a388-4e09-8b49-f0fb521fb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:51.806210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab933ba6-43ec-4b18-adca-1c18f6f6746c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:51.817383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-34a9ec08-a388-4e09-8b49-f0fb521fb098 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:51.818707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-34a9ec08-a388-4e09-8b49-f0fb521fb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:51.853319 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:51.996075 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2466/4874] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:51.998621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.000143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.000978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.069852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:52.070638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:52.075697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.076675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.081614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.089055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:52.100967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:52.113202 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2467/4875] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:52.119161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:52.143743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c631-0833-4e06-b6ff-70937415caea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:52.165408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:52.166403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.166843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.167958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.169276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:29:52.169768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:52.174081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:52.200736 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:52.225010 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2468/4876] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:29:52.230760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:52.271212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be7379-078b-45ee-acbc-200c7340f130 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:52.293765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:52.294455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.294741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.295016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.295726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:52.297748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:52.368098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:52.379811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:52.420233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2469/4877] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:29:52 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:29:52.422427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2409/4878] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 923 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:52.432480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:52.697489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cb0-9376-4157-9d0f-ddbf477e7620 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:52.714346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:52.716455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.718884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.722005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.725535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:52.741308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b339b6e-a171-4bc2-8f6d-a03d3ac55434 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:52.825351 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2470/4879] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:29:52 2022] POST /identity/v3/users => generated 287 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:29:52.826616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:52.849249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf129-6c30-4f0f-bcaa-f1532c91c899 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:52.876429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e903-0d52-42a9-8976-73cdadb49b69 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.876782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e903-0d52-42a9-8976-73cdadb49b69 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.877280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e903-0d52-42a9-8976-73cdadb49b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.900870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:52.901574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:52.901887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:52.902168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:52.902917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:52.904599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:52.956534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a9f6e903-0d52-42a9-8976-73cdadb49b69 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:52.957969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9f6e903-0d52-42a9-8976-73cdadb49b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:52.960412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2410/4880] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:52.961627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:52.987923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5b13-02b9-41c2-9cfc-25269139f38a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:53.006368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:53.007890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:53.008387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:53.008853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:53.009862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:53.011739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:53.041442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2411/4881] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:29:53.045891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:53.067211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c182b8-a3ee-4305-b7e7-f1aa8ed2b7cf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:53.076133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:53.077486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:53.079898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:53.081285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] PATH_INFO: `/v3/projects/b70a645a17fa4e0597bdff92b8011131/users/0a7378d2a7a949ddaa2265cc1c49f6f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:53.104475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2471/4882] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:53.115005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70a645a17fa4e0597bdff92b8011131, user_id=0a7378d2a7a949ddaa2265cc1c49f6f3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:53.118456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d19464-3f12-414b-89a1-90324bb00ffd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:53.165485 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2412/4883] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:29:53 2022] PUT /identity/v3/projects/b70a645a17fa4e0597bdff92b8011131/users/0a7378d2a7a949ddaa2265cc1c49f6f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:29:53.165876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:53.166173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:53.166456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:53.255652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] MFA Rules not processed for user `0a7378d2a7a949ddaa2265cc1c49f6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:53.257000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:53.568155 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2472/4884] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:53.590426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d4ff-2a0f-4133-825e-917bc341434e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:53.591061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d4ff-2a0f-4133-825e-917bc341434e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:53.591533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d4ff-2a0f-4133-825e-917bc341434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:53.815885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6133d4ff-2a0f-4133-825e-917bc341434e None None] MFA Rules not processed for user `0a7378d2a7a949ddaa2265cc1c49f6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:53.826401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6133d4ff-2a0f-4133-825e-917bc341434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:53.868519 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2413/4885] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:55.474157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:55.477330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:55.484040 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:55.748134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af8829-751c-4e1c-9f82-0a6ad1c1e40a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:55.776519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:55.777333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:55.777782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:55.777936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:55.804689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:55.806974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c30e-4309-4d1e-9e25-592f4d2f0509 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:55.851389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2473/4886] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:29:56.874177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414bf0-2f7f-4722-8809-05c2954331f0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:56.875135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414bf0-2f7f-4722-8809-05c2954331f0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:56.875685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414bf0-2f7f-4722-8809-05c2954331f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:56.926933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-74414bf0-2f7f-4722-8809-05c2954331f0 None None] MFA Rules not processed for user `0a7378d2a7a949ddaa2265cc1c49f6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:56.929096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-74414bf0-2f7f-4722-8809-05c2954331f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:56.963401 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2414/4887] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:57.064069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:57.064728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:57.064728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:57.101076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:57.104887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:57.417305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2474/4888] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:57.733191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eeefe-1c96-4e76-90ad-22762bce7333 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:57.733526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eeefe-1c96-4e76-90ad-22762bce7333 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:57.733837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eeefe-1c96-4e76-90ad-22762bce7333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:57.770152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-245eeefe-1c96-4e76-90ad-22762bce7333 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:57.774051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-245eeefe-1c96-4e76-90ad-22762bce7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:57.841041 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:57.855789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2415/4889] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:29:57.871135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:57.872902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:58.109987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b051d-f132-4b78-b4ec-4c475be53897 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:58.142643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:58.144399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:58.145101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:58.145653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:58.157340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:58.159912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6f820-7dae-49cf-a548-697508746c7c service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:58.174137 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2475/4890] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:29:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:29:59.757009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739f40-df0f-4303-9314-d438b634a98f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:59.758440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739f40-df0f-4303-9314-d438b634a98f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:59.758950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739f40-df0f-4303-9314-d438b634a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:59.835836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-97739f40-df0f-4303-9314-d438b634a98f None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:59.837246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-97739f40-df0f-4303-9314-d438b634a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:59.887430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdee0b-b4ba-448f-b8bb-ee2f3d8dad9f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:59.888352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdee0b-b4ba-448f-b8bb-ee2f3d8dad9f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:59.888799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdee0b-b4ba-448f-b8bb-ee2f3d8dad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:59.890864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2416/4891] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:29:59.927417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3acdee0b-b4ba-448f-b8bb-ee2f3d8dad9f None None] MFA Rules not processed for user `b0f04ff3b36d4b0686c9a68ff55ee99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:29:59.928905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3acdee0b-b4ba-448f-b8bb-ee2f3d8dad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:59.990849 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:00.113790 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2476/4892] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:30:01.990176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70e09-e824-4453-998f-0a2e1cfd64b1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:01.992158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70e09-e824-4453-998f-0a2e1cfd64b1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:01.996295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70e09-e824-4453-998f-0a2e1cfd64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:02.038775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bfe70e09-e824-4453-998f-0a2e1cfd64b1 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:02.040069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bfe70e09-e824-4453-998f-0a2e1cfd64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:02.061955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2417/4893] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:05.329887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:05.330810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:05.331339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:05.378475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:05.379824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:05.403208 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2477/4894] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:05.951740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3196-6a18-4bbd-82f4-f1c6bb77b95f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:05.952244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3196-6a18-4bbd-82f4-f1c6bb77b95f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:05.952335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a3196-6a18-4bbd-82f4-f1c6bb77b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:05.974889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd3a3196-6a18-4bbd-82f4-f1c6bb77b95f None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:05.976097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd3a3196-6a18-4bbd-82f4-f1c6bb77b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:05.999715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2418/4895] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:06.001288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:06.026923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea86849-10a0-4310-b277-0695ab48d1bf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:06.043968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:06.044650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:06.044934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:06.045202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:06.070298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:06.071934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:06.085400 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2478/4896] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:10.879423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7f12-887c-4670-8b08-f4b222078907 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:10.879983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7f12-887c-4670-8b08-f4b222078907 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:10.879983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7f12-887c-4670-8b08-f4b222078907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:10.935303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cd6d7f12-887c-4670-8b08-f4b222078907 None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:10.936828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cd6d7f12-887c-4670-8b08-f4b222078907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:10.969207 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2419/4897] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:30:16.081192 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=24 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:20.911746 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=14 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:22.052634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:22.054534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:22.206097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57470a55-cd31-4de6-bda9-d728b4311c0d service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:22.220922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:22.222822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:22.223627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:22.224067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] PATH_INFO: `/v3/users/670d80842fec4128b660ed94e523c1bb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:22.230721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] RBAC: Authorizing `identity:delete_user(user_id=670d80842fec4128b660ed94e523c1bb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:22.234893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:22.342761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670d80842fec4128b660ed94e523c1bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:22.344438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670d80842fec4128b660ed94e523c1bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:22.358780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670d80842fec4128b660ed94e523c1bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:22.380105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670d80842fec4128b660ed94e523c1bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:22.412836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670d80842fec4128b660ed94e523c1bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:22.429871 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2479/4898] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:30:22 2022] DELETE /identity/v3/users/670d80842fec4128b660ed94e523c1bb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:22.431747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:22.432240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:22.432341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:22.482976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:22.485226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:22.610566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2420/4899] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:22.617627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:22.619564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:22.730154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5714b-95ff-4a88-b9dd-195ca1fe449a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:22.735366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:22.736500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:22.737019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:22.737527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:22.760383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:22.762124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:22.799458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2480/4900] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:24.130049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:24.132235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:24.158016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe558c-08f9-472d-8fef-0409849adc37 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:24.163273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:24.164342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:24.164798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:24.165241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] PATH_INFO: `/v3/projects/8655f96fdcb24c529199de8c0c090e0f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:24.166678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8655f96fdcb24c529199de8c0c090e0f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:24.175812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:24.280428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8655f96fdcb24c529199de8c0c090e0f', 'request_id': 'req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.308280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8655f96fdcb24c529199de8c0c090e0f', 'request_id': 'req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.323733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8655f96fdcb24c529199de8c0c090e0f', 'request_id': 'req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.354093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] The token cache is being invalidate because project 8655f96fdcb24c529199de8c0c090e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:30:24.355201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.356163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb07d573-3c4a-4eb5-9d5e-216aa5e9ca21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.361297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2421/4901] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:24 2022] DELETE /identity/v3/projects/8655f96fdcb24c529199de8c0c090e0f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:24.366424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:24.379540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bf009-38d2-4206-bcd7-4d57b7c91ec3 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:24.434068 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:24.537899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:24.539988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:24.540508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:24.541022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] PATH_INFO: `/v3/users/761646aa13f64e32a57acd7a5ba38bdf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:24.542548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=761646aa13f64e32a57acd7a5ba38bdf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:24.545138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:24.645119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761646aa13f64e32a57acd7a5ba38bdf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.653140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761646aa13f64e32a57acd7a5ba38bdf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.673352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761646aa13f64e32a57acd7a5ba38bdf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.688626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761646aa13f64e32a57acd7a5ba38bdf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.710003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761646aa13f64e32a57acd7a5ba38bdf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:24.723940 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2481/4902] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:30:24 2022] DELETE /identity/v3/users/761646aa13f64e32a57acd7a5ba38bdf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:25.515255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0d4b-9885-45f7-9921-2e588c815f3a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:25.515879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0d4b-9885-45f7-9921-2e588c815f3a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:25.515879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0d4b-9885-45f7-9921-2e588c815f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:25.569973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3fdc0d4b-9885-45f7-9921-2e588c815f3a None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:25.572796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3fdc0d4b-9885-45f7-9921-2e588c815f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:25.751742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2422/4903] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:26.024749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:26.027111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:26.162765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f732d-92c0-49b6-a8ad-af5ba97c3dec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:26.167951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:26.169015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.169308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.169582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] PATH_INFO: `/v3/projects/1c98015caa554565a87c8a06554439ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.171154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c98015caa554565a87c8a06554439ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:26.173308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:26.253948 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:26.258338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c98015caa554565a87c8a06554439ab', 'request_id': 'req-252de262-6bda-420b-929a-4e300df48f2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:26.268086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c98015caa554565a87c8a06554439ab', 'request_id': 'req-252de262-6bda-420b-929a-4e300df48f2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:26.280631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c98015caa554565a87c8a06554439ab', 'request_id': 'req-252de262-6bda-420b-929a-4e300df48f2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:26.302061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] The token cache is being invalidate because project 1c98015caa554565a87c8a06554439ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:30:26.302475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:26.303253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-252de262-6bda-420b-929a-4e300df48f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:26.308444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2482/4904] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:26 2022] DELETE /identity/v3/projects/1c98015caa554565a87c8a06554439ab => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:26.310179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.310488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.310743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.341231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:26.342512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:26.400716 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:26.499500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2423/4905] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:26.500352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.500772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.501144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.543424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:26.544796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:26.566329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2483/4906] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:30:26.570401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:26.583179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08b303-7e71-4aaa-8702-3d41974f7a19 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:26.591136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:26.592783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.593303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.594371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.595642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:30:26.596173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:26.598051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972174f-0eab-4b0d-9c23-090c6a33031d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:26.617949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2424/4907] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:30:26.622042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:26.641039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9776f8-2446-4212-84cf-742a1eeba823 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:26.675549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:26.676507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.677025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.677558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.678540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:26.699863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:26.752566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:26.753151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:26.753800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:26.778596 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2484/4908] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:30:26 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:30:26.783004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:26.791083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:26.792536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:27.029091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2425/4909] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:30:27.131481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833380a-bf2f-45b1-8986-6f72142f3d3c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:27.164078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:27.164777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:27.165716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:27.165990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:27.166696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:27.175057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:27.262336 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2485/4910] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:30:26 2022] POST /identity/v3/users => generated 292 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:30:27.266222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:27.289620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f169-8064-41dc-a46a-f96c60096afe None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:27.306588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:27.315266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:27.319304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:27.319706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:27.320643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:27.326003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:27.370570 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2426/4911] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:27.375564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:27.397805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278c2c1-3b4c-4a70-9ee3-b60a38361c1d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:27.453743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:27.453743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:27.453743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:27.453743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:27.454444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:27.454444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b622b84-aa0d-4619-9895-831f70418832 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:27.495161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:27.514402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2486/4912] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:27.516121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84009c0e-37bb-4464-9282-88cda46df1c4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:27.538112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:27.539094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:27.539371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:27.546226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] PATH_INFO: `/v3/projects/761163f4b25d4d6da7c1b164ecb868ed/users/a5c3bab09678422b97397764530e5d2f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:27.598451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761163f4b25d4d6da7c1b164ecb868ed, user_id=a5c3bab09678422b97397764530e5d2f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:27.603529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:27.636400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2427/4913] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:30:27 2022] PUT /identity/v3/projects/761163f4b25d4d6da7c1b164ecb868ed/users/a5c3bab09678422b97397764530e5d2f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:30:27.647925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:27.648668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:27.649246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:27.736312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] MFA Rules not processed for user `a5c3bab09678422b97397764530e5d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:27.737653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:27.966305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:27.966607 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2487/4914] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:28.111246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccd018-ec59-49b1-82e2-a2121396ffd7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.132780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.134296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.134914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.135340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.136483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.138601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:28.196786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2428/4915] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:30:27 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:30:28.200790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:28.232990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38b5f-33cd-4240-8ad8-95ce764d2d68 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.245393 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:28.357226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.358255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.359474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.359474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.359698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.361583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:28.428537 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2488/4916] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:30:28 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:30:28.433651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:28.465171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a75f9b-c5e1-41c8-a50c-ff7ba6c017c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.494412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.495114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.495395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.495671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.496415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.502367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:28.518186 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:28.536708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2429/4917] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:28.540914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:28.554805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb450cb-f37c-4a78-9af7-7e52b1f97009 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.567845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.569329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.570008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.570590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] PATH_INFO: `/v3/projects/916568798ce44878958685fc48954370/users/395e456b484d4aed8929b2ac9c6793db/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.622126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=916568798ce44878958685fc48954370, user_id=395e456b484d4aed8929b2ac9c6793db, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.626797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:28.677711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2489/4918] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:30:28 2022] PUT /identity/v3/projects/916568798ce44878958685fc48954370/users/395e456b484d4aed8929b2ac9c6793db/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:28.685817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:28.732730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa6a6c-e18b-4eb4-8faa-08ee633652de admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.845324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.846689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.847202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.847700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.848681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.860578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89ca7-f1fe-44e9-ba7a-321e21e173d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:28.912358 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2430/4919] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:28.918149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:28.931830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19da5-0734-4e02-b3ff-e92e0b14ba1f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:28.962944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:28.963927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:28.964160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:28.964440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] PATH_INFO: `/v3/projects/916568798ce44878958685fc48954370/users/395e456b484d4aed8929b2ac9c6793db/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:28.975489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916568798ce44878958685fc48954370, user_id=395e456b484d4aed8929b2ac9c6793db, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:28.992150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:29.061343 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2490/4920] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:30:28 2022] PUT /identity/v3/projects/916568798ce44878958685fc48954370/users/395e456b484d4aed8929b2ac9c6793db/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:29.063941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:29.064983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:29.065445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:29.190582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] MFA Rules not processed for user `395e456b484d4aed8929b2ac9c6793db`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:29.196787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:29.489085 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2431/4921] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:29.502763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:29.504834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:29.715563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c208-9ee0-4803-ae00-608e96d45521 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:29.726789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:29.729812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:29.730382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:29.734744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:29.958318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:29.961103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:30.008137 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2491/4922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:39.481173 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=63 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:39.984246 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:41.175538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:41.179291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:41.409640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb5385-54dc-4852-99aa-0ec3a7c014c0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:41.418014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:41.418927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:41.422317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:41.422803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:41.424871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:41.484587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:41.486277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:41.685416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:41.688062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:41.703566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2432/4923] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:41.727790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7775-6405-4016-9168-8920a195e57c service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:41.737166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:41.738626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:41.739183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:41.739678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] PATH_INFO: `/v3/users/803ee2ed518446dc8953a707f171cbc4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:41.742556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] RBAC: Authorizing `identity:delete_user(user_id=803ee2ed518446dc8953a707f171cbc4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:41.746452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:41.889543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803ee2ed518446dc8953a707f171cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:41.892202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803ee2ed518446dc8953a707f171cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:41.917735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803ee2ed518446dc8953a707f171cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:41.930844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803ee2ed518446dc8953a707f171cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:41.956919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:41.961604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:41.966502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803ee2ed518446dc8953a707f171cbc4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:41.977465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2492/4924] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:30:41 2022] DELETE /identity/v3/users/803ee2ed518446dc8953a707f171cbc4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:30:42.153124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85789-70e2-44d4-8d27-5c708e6b257b service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:42.279565 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:42.292473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:42.295613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:42.296763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:42.297830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:42.309907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:42.334520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:42.336155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:42.365535 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2433/4925] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:42.547673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:42.549782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:42.572331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c71c-ea48-4539-b6a7-8fd2b9ab600d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:42.587838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:42.588531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:42.588821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:42.589103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:42.592539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:42.671433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:42.673110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:42.797625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:42.801241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba541f-b9c2-4c13-8b1d-dfc551b835e8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:42.825939 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2493/4926] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:42.840762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80d8a4-da74-459d-9ff7-a3c72a3d66fe service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:42.846508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:42.847432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:42.847718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:42.847984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] PATH_INFO: `/v3/projects/972661c3565a4312b050c50083f3c91f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:42.849760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=972661c3565a4312b050c50083f3c91f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:42.851717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:42.922998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972661c3565a4312b050c50083f3c91f', 'request_id': 'req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:42.932418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972661c3565a4312b050c50083f3c91f', 'request_id': 'req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:42.948434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972661c3565a4312b050c50083f3c91f', 'request_id': 'req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:42.985462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] The token cache is being invalidate because project 972661c3565a4312b050c50083f3c91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:30:42.985665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:42.986618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-79c14e36-abeb-43c3-8e16-0b1b9dc53a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:30:42.989053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2434/4927] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:30:42 2022] DELETE /identity/v3/projects/972661c3565a4312b050c50083f3c91f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:42.994443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:42.994919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:42.995465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.026727 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:43.048691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:43.050479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:43.137534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2494/4928] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:43.146240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.146437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.146706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.210509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:43.217116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:43.269322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:43.279792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6a28-97a7-4344-9eec-a64e5b2180cb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:43.280613 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2435/4929] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:43.314822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:43.320889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.322894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.323206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.326071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:30:43.326393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:43.352077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:43.438547 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2495/4930] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:30:43.444688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:43.465098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339276-3cb2-4876-8735-20efc7ec21d5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:43.476724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:43.477916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.480413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.482119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.482889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:43.485790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328531-2fbc-4af2-9e24-2b60be278304 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:43.593361 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2436/4931] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:30:43 2022] POST /identity/v3/projects => generated 395 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:30:43.596649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:43.645432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed37df8-a7ec-46bd-a398-0acb79fb08d2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:43.912636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:43.913917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.914411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.914796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.915961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:43.919864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:43.949205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.949495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.949841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.950716 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2496/4932] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:30:43 2022] POST /identity/v3/users => generated 298 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:30:43.957751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:43.984784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25231f-c2ca-49e5-8b5f-e696e5ae9171 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:43.995617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:43.996473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:43.996871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:43.997348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:43.998266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:44.000676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:44.019178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:44.020428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:44.022526 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2497/4933] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:44.034397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:44.054931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b3d8-b19c-440f-b15e-b16fd5fcc7e0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:44.069426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:44.069426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:44.069426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:44.069426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:44.070135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:44.075570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:44.114274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2498/4934] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:30:44.115993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:44.142620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba0c-2ec1-4c61-8004-575ea8e7388e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:44.151159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:44.152348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:44.152787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:44.153485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] PATH_INFO: `/v3/projects/4136a7dd7cdb4d84a9ec2aae5a9601d2/users/1ffc6952f95b4fbc9281bb3557fb5842/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:44.206742 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:44.236181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4136a7dd7cdb4d84a9ec2aae5a9601d2, user_id=1ffc6952f95b4fbc9281bb3557fb5842, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:44.240206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a77fec-fda7-4469-a86a-dbc1ca199d5f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:44.245400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2437/4935] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:44.262423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:44.263853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:44.272621 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2499/4936] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:30:44 2022] PUT /identity/v3/projects/4136a7dd7cdb4d84a9ec2aae5a9601d2/users/1ffc6952f95b4fbc9281bb3557fb5842/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:30:44.279811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:44.280294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:44.282283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:44.324209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:44.328380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:44.389576 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:30:44.440873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083e18-b77e-45ef-9f0b-c2a7fcc5815e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:44.443335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2500/4937] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:44.457893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:44.460031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:44.552966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:44.553636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:44.553948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:44.554222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:44.607097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb24572-11ef-4ece-b43a-4f26a93d1d6c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:44.626980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:44.626980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:44.626980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:44.626980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:44.648793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:44.653136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816e4a2-5838-44c3-aa58-eb57a079418f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:44.680991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2501/4938] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:30:44.701869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:44.703869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986614d-a663-44d6-be03-3a9550885d65 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:44.724223 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2438/4939] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:30:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:30:47.346642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:47.349078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:47.350765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:47.378884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:47.379411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:47.379411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:47.382752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] MFA Rules not processed for user `014d9b85786b4a22b71463e346159fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:47.384544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:47.447412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:30:47.452648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:47.487486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2439/4940] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:47.507249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:47.531970 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2502/4941] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:30:47.550411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d882c-f79d-401f-b388-a3389cc1132a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:47.570828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:47.571603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:47.571784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:47.572969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:47.600582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:47.602381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d56f7-965b-4264-892a-ec67c4cb7c27 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:47.630253 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2440/4942] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:30:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:30:53.240845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:30:53.281498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588d740-9ec5-4433-94cc-cf06a60c08ac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:30:53.307039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:30:53.308072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:30:53.309301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:30:53.310334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:30:53.316798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:30:53.533445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:30:53.536035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90884f85-7aa5-47d8-a70e-92bf988dc9d3 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:30:53.549013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2503/4943] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:30:57.624578 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:00.763996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:00.765114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:00.765614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:00.943603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:00.946953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:01.269214 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2441/4944] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:01.288006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86ec2-cb7d-4916-ae6e-6b139e0f8c74 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:01.288578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86ec2-cb7d-4916-ae6e-6b139e0f8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:01.288812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86ec2-cb7d-4916-ae6e-6b139e0f8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:01.333169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f5d86ec2-cb7d-4916-ae6e-6b139e0f8c74 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:01.336071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f5d86ec2-cb7d-4916-ae6e-6b139e0f8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:01.366656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2504/4945] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:05.652623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:05.655139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:05.683210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56009e6-4a78-4f68-bb3d-b5f440ad2be2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:05.708824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:05.709814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:05.710100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:05.710377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] PATH_INFO: `/v3/users/0a7378d2a7a949ddaa2265cc1c49f6f3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:05.712638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7378d2a7a949ddaa2265cc1c49f6f3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:05.716608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:05.821378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7378d2a7a949ddaa2265cc1c49f6f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:05.852361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7378d2a7a949ddaa2265cc1c49f6f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:05.878938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7378d2a7a949ddaa2265cc1c49f6f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:05.930102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7378d2a7a949ddaa2265cc1c49f6f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:05.931419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7378d2a7a949ddaa2265cc1c49f6f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:05.948444 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2442/4946] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:05 2022] DELETE /identity/v3/users/0a7378d2a7a949ddaa2265cc1c49f6f3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:05.950516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:05.951100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:05.951100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:06.005562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:06.009308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:06.036720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:06.037867 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:06.038766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:06.222546 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:06.253933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2505/4947] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:06.267239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:06.271893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:06.293699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969d492-c081-42ec-ab10-6d8a23917cb9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:06.306130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:06.307500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:06.307790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:06.308069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:06.310239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:06.485148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160857d-0a0c-4546-8dd2-082fcfc5c45a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:06.509866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:06.514841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:06.515892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:06.516204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:06.547352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:06.550055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82ab3-2f2c-4979-ad83-be2d4536f507 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:06.558407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:06.568885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:06.582135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2443/4948] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:31:06.614796 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2506/4949] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:07.034861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:07.036655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:07.037055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:07.082106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:07.084777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:07.313945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2444/4950] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:07.362217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:07.365297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:07.477969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:07.495801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6a7d-e350-4a1c-b8bf-2b840b91c708 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:07.541501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:07.543184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:07.544442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:07.546347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:07.566912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:07.597491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37e66-b270-42b6-83f1-e37ea3312f92 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:07.607694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:07.609188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:07.614049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:07.618186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:07.618519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:07.618803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:07.641260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2445/4951] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:07.680752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:07.688121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def7fa3-0f96-4aa3-bd47-57caa0478a16 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:07.724331 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2507/4952] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:07.737448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:07.739013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:07.777705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9820-da3d-4089-a4b5-1fe41443f3d7 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:07.795264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:07.796153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:07.796432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:07.796707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] PATH_INFO: `/v3/projects/b70a645a17fa4e0597bdff92b8011131` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:07.799951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70a645a17fa4e0597bdff92b8011131)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:07.801839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:07.899672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70a645a17fa4e0597bdff92b8011131', 'request_id': 'req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:07.923076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70a645a17fa4e0597bdff92b8011131', 'request_id': 'req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:07.956063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70a645a17fa4e0597bdff92b8011131', 'request_id': 'req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:08.040702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] The token cache is being invalidate because project b70a645a17fa4e0597bdff92b8011131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:08.041414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:08.046718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10a4cdd0-a3e4-4e64-8f38-ed2e7b8306cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:08.055620 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2446/4953] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:07 2022] DELETE /identity/v3/projects/b70a645a17fa4e0597bdff92b8011131 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:31:08.060949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:08.064817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:08.065336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:08.097397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:08.099177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:08.205611 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:08.283564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2508/4954] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:08.292631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:08.292845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:08.293047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:08.359720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:08.365563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:08.395806 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2447/4955] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:08.399989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:08.421648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57ee6c-98a9-41e6-ab7f-7538655fe050 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:08.432239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:08.433272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:08.433753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:08.434467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:08.435554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:08.436147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:08.439643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:08.484118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:08.486340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2509/4956] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:08.500162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7715b6-0eb6-4cf9-a43c-850a995def3a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:08.539624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:08.540838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:08.541233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:08.542016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:08.543093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:08.552794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:08.565402 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:08.652131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:08.676513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2448/4957] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:08.688120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100732-6b85-4962-8570-bd885a5b1c0b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:08.904422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:08.909949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:08.911245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:08.911875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:08.912766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:08.921342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:08.996825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:09.007567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2510/4958] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:08 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:09.013557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345959a1-afb5-44db-8050-34cdcfd1b70b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:09.029171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:09.030922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:09.031201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:09.031467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:09.032261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:09.042332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:09.082816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:09.088004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2449/4959] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:09.097410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8236b-8534-4fde-85c0-e75adeff3728 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:09.107970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:09.108845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:09.109282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:09.109752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:09.110808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:09.113039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667f2b9-48dd-4357-8d60-9ec5705e1491 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:09.132162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:09.143659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2511/4960] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:09.149985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4004832-9246-4004-9599-5f026f489e77 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:09.157775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:09.159403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:09.160018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:09.160608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] PATH_INFO: `/v3/projects/72bca16f74744f9f9218326e5e95f9e5/users/0b34de1d4aa342f4a328d3d6610eab48/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:09.189157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bca16f74744f9f9218326e5e95f9e5, user_id=0b34de1d4aa342f4a328d3d6610eab48, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:09.192521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:09.249189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2450/4961] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:09 2022] PUT /identity/v3/projects/72bca16f74744f9f9218326e5e95f9e5/users/0b34de1d4aa342f4a328d3d6610eab48/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:09.252720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c30a-4735-4769-9bfa-eee561f4d38a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:09.253275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c30a-4735-4769-9bfa-eee561f4d38a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:09.253814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c30a-4735-4769-9bfa-eee561f4d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:09.336240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7f68c30a-4735-4769-9bfa-eee561f4d38a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:09.340150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7f68c30a-4735-4769-9bfa-eee561f4d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:09.624001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2512/4962] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:09.663349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:09.665309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:09.854177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11208fba-abbf-48ec-9f90-04a12b3894a1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:09.859088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:09.859878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:09.860265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:09.860655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:09.871604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:09.874438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:09.889059 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2451/4963] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:10.023737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92b8e-c9a4-42ba-8e4f-3e379bbd4379 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:10.024033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92b8e-c9a4-42ba-8e4f-3e379bbd4379 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:10.024302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e92b8e-c9a4-42ba-8e4f-3e379bbd4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:10.049062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10e92b8e-c9a4-42ba-8e4f-3e379bbd4379 None None] MFA Rules not processed for user `b0f04ff3b36d4b0686c9a68ff55ee99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:10.050334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10e92b8e-c9a4-42ba-8e4f-3e379bbd4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:10.125665 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:10.161770 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2513/4964] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:10.695069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:10.696875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:10.912726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15cd9f-33e7-4587-8a42-1592805d7c1b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:10.923943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:10.924636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:10.924986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:10.925317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:10.930395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:10.970978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:10.972640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:10.991583 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2452/4965] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:19.022776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f75-5843-4920-85b0-5cef3944a90b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:19.024179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f75-5843-4920-85b0-5cef3944a90b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:19.024730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131f75-5843-4920-85b0-5cef3944a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:19.057519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ed131f75-5843-4920-85b0-5cef3944a90b None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:19.059352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ed131f75-5843-4920-85b0-5cef3944a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:19.190902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2514/4966] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:19.204015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:19.206259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:19.300183 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:19.362945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87253-3c53-496c-8a8e-5fdbe7f60753 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:19.375114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:19.375935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:19.376217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:19.376498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:19.423131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:19.434758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:19.456560 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2453/4967] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:20.537719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:20.538605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:20.539042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:20.573149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:20.576352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:20.605968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2515/4968] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:20.612674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:20.635879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2c1da-e516-426b-85f3-459216ad48ba service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:20.661958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:20.662359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:20.666827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:20.667332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:20.705571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:20.716794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:20.757080 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2454/4969] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:25.757298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:25.760327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:25.785743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a476-173c-4b25-b642-77d1a2dd9fbd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:25.792009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:25.793082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:25.793587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:25.794299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:25.796762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:25.822666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:25.826298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf89c-fee9-42e9-8fc3-d861dab2e24b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:25.893832 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2516/4970] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:25.894345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:25.895748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:25.921657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a59c0-7beb-483a-b49b-4bc665560a17 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:25.926567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:25.936908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:25.937257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:25.937643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] PATH_INFO: `/v3/users/8803f22e6162413886b72622dfdfb9ed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:25.939223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8803f22e6162413886b72622dfdfb9ed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:25.941252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:26.046329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8803f22e6162413886b72622dfdfb9ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:26.072998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8803f22e6162413886b72622dfdfb9ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:26.102352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8803f22e6162413886b72622dfdfb9ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:26.154525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8803f22e6162413886b72622dfdfb9ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:26.155752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8803f22e6162413886b72622dfdfb9ed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:26.172093 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2455/4971] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:25 2022] DELETE /identity/v3/users/8803f22e6162413886b72622dfdfb9ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:31:26.177368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:26.177975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:26.178985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:26.214313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:26.217185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:26.373568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2517/4972] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:26.418102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:26.420983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:26.640023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dc8a8-6c33-4435-a60f-2d27e02554bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:26.651484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:26.652172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:26.652465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:26.652744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:26.682586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:26.696261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:26.720584 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2456/4973] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:27.564666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:27.569755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:27.612021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27fc4d-d8e3-4431-a563-d66f2aa9192e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:27.636129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:27.637547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:27.652035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:27.663354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:27.666764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:27.667375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] PATH_INFO: `/v3/projects/4c478d6d10d9445ca50340bbad595174` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:27.671339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c478d6d10d9445ca50340bbad595174)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:27.678632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:27.799281 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:27.890390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c480d8a-0b94-4c85-a72d-6114a7d7baf2 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:27.893096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c478d6d10d9445ca50340bbad595174', 'request_id': 'req-087b3e98-d9e6-4bc3-b565-459b345cf5f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:27.900090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c478d6d10d9445ca50340bbad595174', 'request_id': 'req-087b3e98-d9e6-4bc3-b565-459b345cf5f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:27.915721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c478d6d10d9445ca50340bbad595174', 'request_id': 'req-087b3e98-d9e6-4bc3-b565-459b345cf5f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:27.938540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] The token cache is being invalidate because project 4c478d6d10d9445ca50340bbad595174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:27.938837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:27.941370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-087b3e98-d9e6-4bc3-b565-459b345cf5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:27.946663 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2518/4974] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:27 2022] DELETE /identity/v3/projects/4c478d6d10d9445ca50340bbad595174 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:27.946663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4544fd-f8c0-47cc-bad5-3e51ee7bc133 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:27.946663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4544fd-f8c0-47cc-bad5-3e51ee7bc133 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:27.946663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4544fd-f8c0-47cc-bad5-3e51ee7bc133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:27.991627 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:28.009540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1f4544fd-f8c0-47cc-bad5-3e51ee7bc133 None None] MFA Rules not processed for user `0b34de1d4aa342f4a328d3d6610eab48`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.010820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1f4544fd-f8c0-47cc-bad5-3e51ee7bc133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.037906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:28.038587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.038873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.039151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.043660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.072769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:28.074444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde5a2c-6bd8-46b9-99d6-43674dfd764a service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:28.123310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2457/4975] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:28.124689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4266b-d207-4610-8a88-6c86c75cf71a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.124981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4266b-d207-4610-8a88-6c86c75cf71a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.125263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4266b-d207-4610-8a88-6c86c75cf71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.202868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1fa4266b-d207-4610-8a88-6c86c75cf71a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.204608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1fa4266b-d207-4610-8a88-6c86c75cf71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.219586 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2519/4976] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.366185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6735-cb5c-4649-9acf-02818dbe0809 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.366568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6735-cb5c-4649-9acf-02818dbe0809 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.366748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a6735-cb5c-4649-9acf-02818dbe0809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.377746 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2458/4977] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.385325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.387109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.387403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.412511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-127a6735-cb5c-4649-9acf-02818dbe0809 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.414669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-127a6735-cb5c-4649-9acf-02818dbe0809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.480798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.484213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2520/4978] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:28.487263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.521197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc525-0dab-4e5e-8be6-6c1905dcb899 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.521606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc525-0dab-4e5e-8be6-6c1905dcb899 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.521942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dc525-0dab-4e5e-8be6-6c1905dcb899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.532422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2459/4979] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.536518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:28.562512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6adda-574c-402f-88c9-d9f1f587a31d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:28.581861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:28.583618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.583922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.585867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.587334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:28.587878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:28.589762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed3db-8d29-4bd5-a3a2-cae42b696684 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:28.600310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8e3dc525-0dab-4e5e-8be6-6c1905dcb899 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.610491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e3dc525-0dab-4e5e-8be6-6c1905dcb899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.619022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2460/4980] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:28.623825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.624584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.625705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.671015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.675219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.696101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2461/4981] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.697259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:28.746967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5805d9-ff91-4c0b-8e93-6ec4465efbb6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:28.756288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:28.756970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.757324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.757632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.758334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:28.760276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:28.774240 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2521/4982] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.775758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:28.776876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:28.777166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:28.817700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:28.819471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:28.819675 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2462/4983] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:28.822695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:28.880391 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:28.909419 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:28.926075 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2522/4984] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:28.927005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:28.928308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:29.007169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d8b8-7008-4293-a87a-dbc99ab03297 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:29.022196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:29.022906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.023193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.023496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.024195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:29.026171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e7859-acdf-4704-9384-2fd9cdf1b807 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:29.074541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70423f-e5c5-409f-a7d8-604cb03c5592 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:29.078333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2463/4985] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:28 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:29.079943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.082442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.082733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.085477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:29.087092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.087769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.088838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.122321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:29.123688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:29.155115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2464/4986] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:29.156162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:29.167098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:29.176552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00aae0-1e3c-4398-b0cb-e381817801b0 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:29.181879 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2523/4987] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:29.183305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.183591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.183868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.191055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86597-7040-40a7-871c-7711dcd00c93 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:29.206573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:29.209490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.209809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.210093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.210859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:29.212504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:29.220015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] MFA Rules not processed for user `1ffc6952f95b4fbc9281bb3557fb5842`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:29.221248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:29.244858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2524/4988] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:29.244858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:29.257601 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2465/4989] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:29.269256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227488-3d76-4f1a-b194-53a8a1be9c8f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:29.276257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:29.282196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.282505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.283161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.284527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:29.286305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc032b-64d8-4173-8b4f-3ab41ccbf523 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:29.309875 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2525/4990] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:29.310027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:29.323398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11666f-85fb-4d70-88f1-2596a4ca4344 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:29.358271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:29.359223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.359512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.359796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] PATH_INFO: `/v3/projects/67fce14609e74e21a6777c237b663af7/users/6eada8629aa34f3d858064b25d4d68c8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.426557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fce14609e74e21a6777c237b663af7, user_id=6eada8629aa34f3d858064b25d4d68c8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:29.434480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:29.508380 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2466/4991] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:29 2022] PUT /identity/v3/projects/67fce14609e74e21a6777c237b663af7/users/6eada8629aa34f3d858064b25d4d68c8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:29.621558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:29.622166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:29.622166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:29.692060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] MFA Rules not processed for user `6eada8629aa34f3d858064b25d4d68c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:29.694626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:29.938801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:29.940698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:29.951757 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2526/4992] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:30.024126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecb690-2270-4ec1-a528-b652f0f85e7b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:30.030767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:30.031451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:30.031734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:30.032010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:30.042484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:30.044924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d1fe-b35a-4dac-beb5-05e958fc2ad3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:30.085053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:30.104176 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2467/4993] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:31:30.104422 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:30.350503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acff207-4dd1-4bd0-a4ff-0d9bc931063c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:30.361570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:30.362501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:30.362848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:30.363122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] PATH_INFO: `/v3/users/6eada8629aa34f3d858064b25d4d68c8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:30.367693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eada8629aa34f3d858064b25d4d68c8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:30.378066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:30.475125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eada8629aa34f3d858064b25d4d68c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:30.476199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eada8629aa34f3d858064b25d4d68c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:30.492832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eada8629aa34f3d858064b25d4d68c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:30.506442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eada8629aa34f3d858064b25d4d68c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:30.543189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eada8629aa34f3d858064b25d4d68c8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:30.567690 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2527/4994] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:30 2022] DELETE /identity/v3/users/6eada8629aa34f3d858064b25d4d68c8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:30.572387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:30.572704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:30.573725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:30.613487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:30.616974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:30.833136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2468/4995] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:30.844262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:30.846158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:31.057405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc207ac-d45f-4129-adc0-9e971d1fd4a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:31.064172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:31.069012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:31.069967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:31.070496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:31.104039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:31.105914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eec20-af8f-4745-aa18-c1e6d9b5bb2a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:31.244191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2528/4996] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:35.232256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:35.233979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:35.259524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0c76-5689-43e1-97a5-b34571ed53da None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:35.281191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:35.285252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:35.286176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:35.286801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] PATH_INFO: `/v3/projects/67fce14609e74e21a6777c237b663af7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:35.289201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fce14609e74e21a6777c237b663af7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:35.297247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:35.303250 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:35.434557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fce14609e74e21a6777c237b663af7', 'request_id': 'req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:35.477387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fce14609e74e21a6777c237b663af7', 'request_id': 'req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:35.490445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fce14609e74e21a6777c237b663af7', 'request_id': 'req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:35.538599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] The token cache is being invalidate because project 67fce14609e74e21a6777c237b663af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:35.539219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:35.543692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77dc2cf2-bede-4b73-aeed-c23f7a1ade94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:35.547478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2469/4997] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:35 2022] DELETE /identity/v3/projects/67fce14609e74e21a6777c237b663af7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:35.552506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:35.553443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:35.554056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:35.608703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:35.610209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:35.711973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:35.810683 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2529/4998] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:35.818729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781462-1285-4481-8556-2bef350534a3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:35.819017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781462-1285-4481-8556-2bef350534a3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:35.819702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781462-1285-4481-8556-2bef350534a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:35.859674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-39781462-1285-4481-8556-2bef350534a3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:35.860988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-39781462-1285-4481-8556-2bef350534a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:35.896029 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2470/4999] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:35.899858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:35.936613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1ffce-f8b3-4a0a-8df7-c43b1eb3548e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:35.960127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:35.961110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:35.961569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:35.962097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:35.963015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:35.963503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:35.965302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.004676 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2530/5000] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:36.008695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781462-1285-4481-8556-2bef350534a3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:36.030427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781462-1285-4481-8556-2bef350534a3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:36.043305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:36.043885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.044724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.045003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.045802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:36.047746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.110082 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2471/5001] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:36 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:36.111863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:36.155547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2498c7-2dc5-4b6f-8f2d-ad58d626c296 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:36.344400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:36.345321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.345836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.346281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.347143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:36.350360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.417976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:36.420863 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2531/5002] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:36 2022] POST /identity/v3/users => generated 281 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:36.444250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4ba26-e9a2-4a6f-95d4-76f39eb3d8aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:36.471870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:36.472748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.473151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.473544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.474446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:36.476202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.531807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2472/5003] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:31:36.537822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:36.574845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b402-809f-4207-82e0-e62911be2581 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:36.606138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:36.607994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.608287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.608556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.609531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:36.611497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccad90-9fd1-4814-b7f8-1dd986e9091f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.642743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:36.642967 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2532/5004] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:36.664605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdaf02-1f40-4d90-b505-c88912350fe9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:36.688303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:36.689704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.689704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.690161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] PATH_INFO: `/v3/projects/3a11c22dc19a4db393f72e0c3979579e/users/def326a0b6794db78d5b2f167375ed86/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.800223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a11c22dc19a4db393f72e0c3979579e, user_id=def326a0b6794db78d5b2f167375ed86, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:36.805211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:36.845204 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2473/5005] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:36 2022] PUT /identity/v3/projects/3a11c22dc19a4db393f72e0c3979579e/users/def326a0b6794db78d5b2f167375ed86/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:36.858732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:36.859117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:36.859397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:36.959203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] MFA Rules not processed for user `def326a0b6794db78d5b2f167375ed86`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:36.964003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:37.212359 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2533/5006] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:37.274503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:37.276887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:37.439148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae13d3-ded1-4e32-aa89-d46fd224d5c6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:37.455726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:37.457292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:37.457773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:37.458260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:37.491819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:37.493290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:37.548765 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2474/5007] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:41.739020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:41.743397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:41.864998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:41.975064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19925428-5d72-4e88-b887-44dc36a465dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:41.984398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:41.985367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:41.985844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:41.986225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] PATH_INFO: `/v3/users/0b34de1d4aa342f4a328d3d6610eab48` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:41.991012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b34de1d4aa342f4a328d3d6610eab48)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:41.995580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:42.105616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b34de1d4aa342f4a328d3d6610eab48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.106799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b34de1d4aa342f4a328d3d6610eab48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.125914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b34de1d4aa342f4a328d3d6610eab48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.140332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b34de1d4aa342f4a328d3d6610eab48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.168705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0241af69-7894-49f9-8a1c-717a823a8cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b34de1d4aa342f4a328d3d6610eab48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.188170 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2534/5008] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:41 2022] DELETE /identity/v3/users/0b34de1d4aa342f4a328d3d6610eab48 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:42.455228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:42.477159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9ed2-346b-4087-874d-a25d01c35d41 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:42.551417 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:42.598995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:42.600413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:42.601019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:42.601372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] PATH_INFO: `/v3/projects/72bca16f74744f9f9218326e5e95f9e5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:42.602870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bca16f74744f9f9218326e5e95f9e5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:42.605373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:42.740937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bca16f74744f9f9218326e5e95f9e5', 'request_id': 'req-4e310529-4728-42e1-b2b5-349fa92a541b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.756039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bca16f74744f9f9218326e5e95f9e5', 'request_id': 'req-4e310529-4728-42e1-b2b5-349fa92a541b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.769117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bca16f74744f9f9218326e5e95f9e5', 'request_id': 'req-4e310529-4728-42e1-b2b5-349fa92a541b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.802125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] The token cache is being invalidate because project 72bca16f74744f9f9218326e5e95f9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:42.802424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.804013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4e310529-4728-42e1-b2b5-349fa92a541b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:42.807300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2475/5009] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:42 2022] DELETE /identity/v3/projects/72bca16f74744f9f9218326e5e95f9e5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:42.813124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:42.813632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:42.813773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:42.849521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:42.850695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:43.025587 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2535/5010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:43.035199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.035489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.035776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.089906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:43.091430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:43.130385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.138218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2476/5011] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:43.146447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e4694-1a41-4b6f-96aa-d120bd0421d8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.159032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.159809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.160097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.160383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.162989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:43.163480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.168448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.199197 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2536/5012] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:43.201264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.218583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183a145-5b8d-413e-9514-583cee8ecc0f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.227353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.228365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.229100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.229384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.230769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.233376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.291438 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2477/5013] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:43 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:43.292904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.315160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1626ff-94a7-466c-a6ca-d3e83f470161 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.436448 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:43.555782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.556471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.556754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.557033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.561875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.565027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.633027 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2537/5014] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:43 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:43.636124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.664396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641743-9450-4dad-b485-0ee171b7ac6c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.688104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.689363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.689363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.689363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.690126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.691773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.764591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.770476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2478/5015] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:43.779062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3047d08-5fac-4122-9a73-29c09c9f7e1e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.792199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.793531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.800753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.800753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.801558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.803357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53a5d7-94c5-451d-8129-3c416e0b0277 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.825934 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2538/5016] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:31:43.829696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:43.857332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4fb5-b4e9-4e11-b601-901edfc00f60 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:43.872872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:43.873826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.874110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.874386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] PATH_INFO: `/v3/projects/eaae260f909c45f3a04e415f5cbaf051/users/15010e45f00444a4a53de55b947b9572/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:43.933015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaae260f909c45f3a04e415f5cbaf051, user_id=15010e45f00444a4a53de55b947b9572, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:43.935825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:43.983749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2479/5017] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:43 2022] PUT /identity/v3/projects/eaae260f909c45f3a04e415f5cbaf051/users/15010e45f00444a4a53de55b947b9572/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:43.995192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:43.995555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:43.995766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:44.111795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] MFA Rules not processed for user `15010e45f00444a4a53de55b947b9572`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:44.132855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:44.376952 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2539/5018] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:44.388753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:44.399959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:44.495602 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:44.543597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39093-b1c7-46d6-9243-b9f319fa66d1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:44.568016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:44.575018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:44.575563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:44.576214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:44.619333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:44.621185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646ab2-97c9-4b49-ab24-8858ba91cb5f service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:44.642283 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2480/5019] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:45.387364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:45.509770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e9d26-da24-43df-8d07-277347b93fb2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:45.534514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:45.535439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:45.535721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:45.536015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] PATH_INFO: `/v3/users/15010e45f00444a4a53de55b947b9572` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:45.537280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=15010e45f00444a4a53de55b947b9572)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:45.539475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:45.663320 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:45.677554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15010e45f00444a4a53de55b947b9572'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:45.678603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15010e45f00444a4a53de55b947b9572'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:45.698026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15010e45f00444a4a53de55b947b9572'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:45.721658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15010e45f00444a4a53de55b947b9572'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:45.739679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15010e45f00444a4a53de55b947b9572'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:45.752733 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2540/5020] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:45 2022] DELETE /identity/v3/users/15010e45f00444a4a53de55b947b9572 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:45.757411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66c80-4d88-4160-a864-884da880d755 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:45.758002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66c80-4d88-4160-a864-884da880d755 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:45.758002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66c80-4d88-4160-a864-884da880d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:45.790213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aad66c80-4d88-4160-a864-884da880d755 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:45.798783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aad66c80-4d88-4160-a864-884da880d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:45.935161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2481/5021] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:45.959729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:45.961386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:46.120594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2980-e09a-4561-9e44-55217f8ccdee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:46.120594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:46.120594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:46.120594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:46.121062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:46.136198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:46.138446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6119c7d-bdf8-436b-a9b3-0b3386426880 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:46.160352 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2541/5022] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:47.146695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66c80-4d88-4160-a864-884da880d755 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:47.149726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aad66c80-4d88-4160-a864-884da880d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:47.175243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66c80-4d88-4160-a864-884da880d755 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:47.214484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:47.217404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:47.220428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:47.221157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] PATH_INFO: `/v3/projects/eaae260f909c45f3a04e415f5cbaf051` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:47.223865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaae260f909c45f3a04e415f5cbaf051)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:47.226505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:47.319547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaae260f909c45f3a04e415f5cbaf051', 'request_id': 'req-f43fc7d7-6b4a-419a-989d-36da1cd88679'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:47.341088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaae260f909c45f3a04e415f5cbaf051', 'request_id': 'req-f43fc7d7-6b4a-419a-989d-36da1cd88679'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:47.349179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaae260f909c45f3a04e415f5cbaf051', 'request_id': 'req-f43fc7d7-6b4a-419a-989d-36da1cd88679'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:47.379317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] The token cache is being invalidate because project eaae260f909c45f3a04e415f5cbaf051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:47.380122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:47.381496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f43fc7d7-6b4a-419a-989d-36da1cd88679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:47.384500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2482/5023] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:47 2022] DELETE /identity/v3/projects/eaae260f909c45f3a04e415f5cbaf051 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:47.391969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:47.393286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:47.393657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:47.425232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:47.426704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:47.554902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2542/5024] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:47.564244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:47.564782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:47.565169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:47.602207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:47.605358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:47.626431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2483/5025] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:47.630941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:47.649542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b4144-9f0f-4e4b-ab5e-a541979ce49d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:47.658985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:47.660062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:47.660575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:47.661095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:47.663130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:47.663686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:47.665526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:47.706436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2543/5026] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:31:47.711001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:47.726989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aa242-60ba-45d4-b749-0441d6d4a536 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:47.745194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:47.745924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:47.746213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:47.746492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:47.749979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:47.752009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:47.845653 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2484/5027] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:47 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:47.850239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:47.893732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1b867-54f3-4d64-a8ff-e15762af70d5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:48.034824 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:48.060082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:48.061118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:48.061757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:48.062021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:48.063551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:48.066272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:48.107177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2544/5028] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:47 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:48.110957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:48.129165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9d34a-7479-4885-8eb1-69024bed88fa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:48.142162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:48.142867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:48.143158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:48.143448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:48.150695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:48.155012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:48.186278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2485/5029] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:48.191301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:48.210917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be292d1-0c55-4323-9a0d-aa5c931791b5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:48.224257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:48.225291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:48.225891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:48.226277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:48.228148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:48.229942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a0a9b-d9f9-4644-8459-024e0f715645 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:48.255808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2545/5030] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:48.336990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:48.354338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0251-6e7a-4bb9-8986-1286e3781c08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:48.370976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:48.372090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:48.373274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:48.375288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] PATH_INFO: `/v3/projects/5ec9bb7927dd4c1081e5e3a2119ce68d/users/6d39d1fa8fd940ef925ffe0cf61e32d6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:48.427826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec9bb7927dd4c1081e5e3a2119ce68d, user_id=6d39d1fa8fd940ef925ffe0cf61e32d6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:48.444841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:48.500122 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2486/5031] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:48 2022] PUT /identity/v3/projects/5ec9bb7927dd4c1081e5e3a2119ce68d/users/6d39d1fa8fd940ef925ffe0cf61e32d6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:48.510841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:48.511569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:48.511569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:48.585094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] MFA Rules not processed for user `6d39d1fa8fd940ef925ffe0cf61e32d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:48.592659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:48.774391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:48.778891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:48.786973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2546/5032] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:48.791247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:48.795420 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:48.999490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae790b-1b64-404b-9a93-594b08a3499a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.010871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.010871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.010871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.010871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.011393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.011961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.040843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030875c-6cd3-4a19-8cba-6131398ccdb3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.053275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.054718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.054718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.054718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] PATH_INFO: `/v3/users/1ffc6952f95b4fbc9281bb3557fb5842` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.055959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffc6952f95b4fbc9281bb3557fb5842)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.063604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.157243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2547/5033] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:48 2022] POST /identity/v3/projects => generated 367 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:49.163137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.164004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffc6952f95b4fbc9281bb3557fb5842'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:49.205953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffc6952f95b4fbc9281bb3557fb5842'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:49.273999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffc6952f95b4fbc9281bb3557fb5842'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:49.284312 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:49.328513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffc6952f95b4fbc9281bb3557fb5842'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:49.331455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffc6952f95b4fbc9281bb3557fb5842'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:49.335294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9e1de-d8aa-4c3e-87fe-fc6f1b71d644 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.348479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.349322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.349609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.351434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.352774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.357953 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2487/5034] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:48 2022] DELETE /identity/v3/users/1ffc6952f95b4fbc9281bb3557fb5842 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:49.361838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.432419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2548/5035] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:49 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:49.437885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.439542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:49.571194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd061b-f7cd-43fb-a2f9-940df4936e72 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.585476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.586193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.586699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.587139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.588042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.589848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.617336 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2488/5036] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:49.618265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.638725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd2ea-2ff6-48c8-abc2-01b4862ebb6e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.651072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.652356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.654916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.655420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] PATH_INFO: `/v3/projects/95a960f96af04f088cb82b6f998725d8/users/d17ee55539654601b0b37f41b92f1e96/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.696898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a960f96af04f088cb82b6f998725d8, user_id=d17ee55539654601b0b37f41b92f1e96, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.707243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.742552 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2549/5037] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:49 2022] PUT /identity/v3/projects/95a960f96af04f088cb82b6f998725d8/users/d17ee55539654601b0b37f41b92f1e96/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:49.748192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.765818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4539d1-d791-449f-b1d6-58d7f578f7c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:49.781124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.784745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:49.814152 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:49.915504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:49.916118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:49.916402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:49.916682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:49.917431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:49.921629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:49.968292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2489/5038] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:49.975212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:49.996712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af17d0-4c15-4cb6-abe3-d2b98971dd96 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.021649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.022527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.022816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.035807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] PATH_INFO: `/v3/projects/4136a7dd7cdb4d84a9ec2aae5a9601d2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.040052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7edeb-e690-43d0-82fe-b02192b358f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.040373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4136a7dd7cdb4d84a9ec2aae5a9601d2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.046998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.068995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.070299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.072746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.073044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] PATH_INFO: `/v3/projects/95a960f96af04f088cb82b6f998725d8/users/d17ee55539654601b0b37f41b92f1e96/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.081570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a960f96af04f088cb82b6f998725d8, user_id=d17ee55539654601b0b37f41b92f1e96, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.099728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d99f09-dc43-4e2f-a77e-33777c94fc0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.139249 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2490/5039] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:49 2022] PUT /identity/v3/projects/95a960f96af04f088cb82b6f998725d8/users/d17ee55539654601b0b37f41b92f1e96/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:31:50.150182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.151231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.151231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.174017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'request_id': 'req-11d34801-e5f3-41bf-abc9-017b6f5abca6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:50.186954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'request_id': 'req-11d34801-e5f3-41bf-abc9-017b6f5abca6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:50.197213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4136a7dd7cdb4d84a9ec2aae5a9601d2', 'request_id': 'req-11d34801-e5f3-41bf-abc9-017b6f5abca6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:50.222384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] MFA Rules not processed for user `d17ee55539654601b0b37f41b92f1e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:50.223627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:50.233382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] The token cache is being invalidate because project 4136a7dd7cdb4d84a9ec2aae5a9601d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:50.234204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:50.235685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11d34801-e5f3-41bf-abc9-017b6f5abca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:50.243478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2550/5040] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:49 2022] DELETE /identity/v3/projects/4136a7dd7cdb4d84a9ec2aae5a9601d2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:50.249952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17e46-9c42-4c06-9b91-ce1ba713f66f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.250397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17e46-9c42-4c06-9b91-ce1ba713f66f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.250808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17e46-9c42-4c06-9b91-ce1ba713f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.289007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16a17e46-9c42-4c06-9b91-ce1ba713f66f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:50.292521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16a17e46-9c42-4c06-9b91-ce1ba713f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:50.385131 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:50.389501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2491/5041] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:50.397219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.417525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04651e4-1f09-489b-8867-8522c2004ccf None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.424067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.425205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.425500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.425915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.426756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.428121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2551/5042] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:50.428284 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:31:50.428284 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:31:50.428284 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:31:50.429767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.436970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.437808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.438486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.475428 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2492/5043] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/domains => generated 276 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:50.475765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:50.476132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.477037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:50.480035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:50.583849 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2552/5044] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:50.584873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.597372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a419ed-1ad5-4639-89c2-1ff917072fac tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.607010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.607010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.607010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.607010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.608095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:50.645508 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:50.777585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.779121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.803451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8996461-bc1d-4c9a-ad96-e323d012e9ab None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.815217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.816758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.817189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.817324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.818137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.822920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2493/5045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:50.823861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.824394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.853592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953175-2f5a-4711-81c3-1bced4d5cfbb service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:50.870434 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2553/5046] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/domains => generated 275 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:50.870434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.874297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:50.874979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:50.875257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:50.875527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:50.876283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:50.877824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:50.883722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:50.928218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2494/5047] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:50.930934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:50.953293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710d51-b691-48b7-b5b1-416435fd998b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.038044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598818e-b34b-4e55-a2f5-fd0eb8063b90 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.053113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.053811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.054089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.054368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.055118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.056737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.089555 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2554/5048] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/domains => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:51.095596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.096545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.097347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.098688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.099077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.101210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.101335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.108077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.117626 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:51.185957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2495/5049] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:50 2022] POST /identity/v3/projects => generated 403 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:51.185957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.247705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a782ea-4fdc-4fa2-9d5b-5aaae0419f96 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.286500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8da9-b101-4561-accc-f269bf994ad4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.297379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.298117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.298401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.298677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.299430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.301226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.315691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.316357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.316647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.316913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.319038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.329921 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2496/5050] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:31:51 2022] POST /identity/v3/domains => generated 279 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:51.329921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.337959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.337959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.353397 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2555/5051] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:51.354617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.368730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01088-ae37-4ef5-ba42-31fad27fdace service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.369397 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:51.489147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.489322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41184-b141-42f3-bc91-aa229fa78475 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.490465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.490979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.491418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/c291bb91969f4fae9aee9aaf1101d22d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.500660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.503383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.503383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.503383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.503676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.506198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.509618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c291bb91969f4fae9aee9aaf1101d22d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.511827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.529951 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2497/5052] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:51 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:51.530921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.533424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.542577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.556504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.615915 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:51.634451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a6853-fffe-4bae-900e-c33e2b546783 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.636966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.650061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.661497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.676575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project c291bb91969f4fae9aee9aaf1101d22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:51.676924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.677619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.686634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.687647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.688351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c291bb91969f4fae9aee9aaf1101d22d', 'request_id': 'req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:51.698648 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2556/5053] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:51 2022] DELETE /identity/v3/domains/c291bb91969f4fae9aee9aaf1101d22d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:51.700302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.702093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.754185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.754890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.755177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.755601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.759736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.782283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e7ebb-0b8e-40dc-90f9-b59e57f49d2c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.793021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.794756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.795189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.795609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.796573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.811007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.833744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2557/5054] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:51.838598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.854466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:51.891949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.893936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.915781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2498/5055] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:51.916916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.934085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e588e-0233-466a-9c1a-b131f7175375 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.941398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.942365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.942768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.943107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:51.943786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:51.945852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:51.947564 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:51.965928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2499/5056] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:51.970380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:51.986950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddf41f-ba04-4646-9c25-2b3937390580 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:51.994783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:51.996087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:51.996686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:51.997199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] PATH_INFO: `/v3/projects/5cf86ee28ec04601acad9d93ad460c79/users/d7e15403503b474587d7b468c35cd7fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.027394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf86ee28ec04601acad9d93ad460c79, user_id=d7e15403503b474587d7b468c35cd7fe, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:52.031322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb263e-b6e3-4bee-bf9b-01e96f85d92e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:52.055014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2500/5057] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:51 2022] PUT /identity/v3/projects/5cf86ee28ec04601acad9d93ad460c79/users/d7e15403503b474587d7b468c35cd7fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:52.077260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee75a-8f92-4d6c-8c14-353ba5c22527 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:52.078033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:52.078033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:52.078033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.161532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] MFA Rules not processed for user `d7e15403503b474587d7b468c35cd7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:52.163317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:52.225116 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:52.266935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:52.267770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:52.267915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:52.268174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.269022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:52.271951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:52.306143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2558/5058] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:31:51 2022] POST /identity/v3/domains => generated 249 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:52.307351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:52.377295 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2501/5059] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:52.456994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb645b5-f768-4c32-89e6-f66bdc3c3d6b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:52.467341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:52.469397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:52.469800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:52.471123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/51ed8b8e4dce4a629b26a8ca5a40035a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.515823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=51ed8b8e4dce4a629b26a8ca5a40035a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:52.516753 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:31:52.516753 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:31:52.516753 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:31:52.517827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:52.586746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.588963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.633647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:52.659871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.660852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.675278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2559/5060] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:52 2022] PATCH /identity/v3/domains/51ed8b8e4dce4a629b26a8ca5a40035a => generated 250 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:52.679252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:52.680667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:52.808021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92146419-b9bf-4cfb-ba35-0d4e5a9a5c19 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:52.830270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d877445-30cf-4722-88fb-7b4b3872417a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:52.843025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:52.843914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:52.844195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:52.844487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/51ed8b8e4dce4a629b26a8ca5a40035a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.876378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=51ed8b8e4dce4a629b26a8ca5a40035a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:52.881809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:52.921613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:52.922718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:52.923095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:52.923467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] PATH_INFO: `/v3/users/d7e15403503b474587d7b468c35cd7fe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:52.925111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e15403503b474587d7b468c35cd7fe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:52.927660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:52.934868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.943088 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:52.954898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:52.967531 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:53.051540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e15403503b474587d7b468c35cd7fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.062768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e15403503b474587d7b468c35cd7fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.074497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e15403503b474587d7b468c35cd7fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.082836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.096210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.101930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e15403503b474587d7b468c35cd7fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.103775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7580ce38-6953-42b9-857b-2074cafd8177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e15403503b474587d7b468c35cd7fe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.129665 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2502/5061] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:52 2022] DELETE /identity/v3/users/d7e15403503b474587d7b468c35cd7fe => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:53.133258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.138112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:53.138563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:53.138869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:53.157129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project 51ed8b8e4dce4a629b26a8ca5a40035a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:53.157427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.158130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.159449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:53.160877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:53.174332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.176495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.177150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '51ed8b8e4dce4a629b26a8ca5a40035a', 'request_id': 'req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.198625 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2560/5062] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:52 2022] DELETE /identity/v3/domains/51ed8b8e4dce4a629b26a8ca5a40035a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:31:53.204270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:53.206077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:53.268853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2503/5063] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:53.288591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:53.290939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:53.390743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1358-4ba5-49a5-9200-e8297d09d851 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:53.396243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:53.397763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:53.398330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:53.398759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:53.406094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8d3e-e7d5-44b4-89de-ec3fbc28850e tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:53.412816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:53.415415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:53.427909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2504/5064] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:31:53.500359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:53.501339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:53.501694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:53.501932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:53.502891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:53.505151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:53.536406 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2561/5065] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:31:53 2022] POST /identity/v3/domains => generated 279 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:53.536817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:53.548444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603386-81cb-4818-a526-43810bee974a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:53.605861 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:53.673879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:53.675085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:53.675378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:53.675658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/d982ef9ff58440d4ad7f70a390d042b6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:53.693254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d982ef9ff58440d4ad7f70a390d042b6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:53.695672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:53.732474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.733248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.793255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.795093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:53.803179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:53.804843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2505/5066] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Jul 24 01:31:53 2022] PATCH /identity/v3/domains/d982ef9ff58440d4ad7f70a390d042b6 => generated 277 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:53.805786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:53.858576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe46b8-bdbf-49a5-b9ce-3cc7f58e3267 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:53.875998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:53.936377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:53.939563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:53.964634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:53.967561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:53.968266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:53.968701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/d982ef9ff58440d4ad7f70a390d042b6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.010023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=d982ef9ff58440d4ad7f70a390d042b6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.015194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.020727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2562/5067] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:31:53 2022] GET /identity/v3/domains/d982ef9ff58440d4ad7f70a390d042b6 => generated 277 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:54.024068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.038110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493edb7-2540-4f45-bd22-9dd392660a44 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.046966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.048305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.048662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.049004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/d982ef9ff58440d4ad7f70a390d042b6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.050882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d982ef9ff58440d4ad7f70a390d042b6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.052876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.095060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.109441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.113684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f627c-0237-4dcd-8a0f-4009a2aad3ec tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.132422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.133603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.134071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.134509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] PATH_INFO: `/v3/projects/5cf86ee28ec04601acad9d93ad460c79` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.139330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf86ee28ec04601acad9d93ad460c79)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.142528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.257036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.268342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf86ee28ec04601acad9d93ad460c79', 'request_id': 'req-57c971bb-ed3f-4dc4-9817-08b7132e0637'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.271449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.290138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.291254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf86ee28ec04601acad9d93ad460c79', 'request_id': 'req-57c971bb-ed3f-4dc4-9817-08b7132e0637'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.302420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf86ee28ec04601acad9d93ad460c79', 'request_id': 'req-57c971bb-ed3f-4dc4-9817-08b7132e0637'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.304907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project d982ef9ff58440d4ad7f70a390d042b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:54.305211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.305972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.320707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.321463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.323416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd982ef9ff58440d4ad7f70a390d042b6', 'request_id': 'req-9f3a435e-a2ea-4c97-befd-0d75a49c834b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.326134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] The token cache is being invalidate because project 5cf86ee28ec04601acad9d93ad460c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:54.327781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.329163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-57c971bb-ed3f-4dc4-9817-08b7132e0637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:54.331101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2506/5068] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:31:53 2022] DELETE /identity/v3/projects/5cf86ee28ec04601acad9d93ad460c79 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:54.336874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dcbd-31dd-438e-ae1e-411969ff8df8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.338511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dcbd-31dd-438e-ae1e-411969ff8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.338903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1dcbd-31dd-438e-ae1e-411969ff8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.341710 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2563/5069] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:54 2022] DELETE /identity/v3/domains/d982ef9ff58440d4ad7f70a390d042b6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:54.345157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.347195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:54.377323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1cc1dcbd-31dd-438e-ae1e-411969ff8df8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:54.380593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1cc1dcbd-31dd-438e-ae1e-411969ff8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:54.410484 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:54.417473 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:54.445071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a435e-a2ea-4c97-befd-0d75a49c834b tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.529379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2507/5070] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:54.538327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.539743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.540198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.562776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.563686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.564233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.565631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.566803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.568810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.599405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:54.600584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:54.605489 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2564/5071] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:31:54 2022] GET /identity/v3/domains => generated 1344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:54.607636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.609719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:54.617102 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2508/5072] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:54.618033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.635238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b176588-f1fd-4b98-afb3-75e705ee2672 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.641027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.641800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.642090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.642368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.643120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:54.643511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.645145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.654938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc34d-fcf1-4330-ad72-22e065e17bda tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.666629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.670084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.671013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.671543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/d982ef9ff58440d4ad7f70a390d042b6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.678744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2509/5073] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:54.679980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.695747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21a74-ec09-427a-9658-5ad2745f9288 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.696808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:31:54.708426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.709257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.709562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.709931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.710715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b52076f3-0aae-4775-85b8-cd2d435b72e1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find domain: d982ef9ff58440d4ad7f70a390d042b6.: keystone.exception.DomainNotFound: Could not find domain: d982ef9ff58440d4ad7f70a390d042b6. Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d982ef9ff58440d4ad7f70a390d042b6. Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:54.711364 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:54.712563 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d982ef9ff58440d4ad7f70a390d042b6. Jul 24 01:31:54.713738 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:54.714996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2565/5074] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:54 2022] PATCH /identity/v3/domains/d982ef9ff58440d4ad7f70a390d042b6 => generated 112 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:54.715752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.720541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.720899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.721476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.757257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:54.759366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:54.792216 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2510/5075] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:54.792216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.921776 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2566/5076] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:54.923253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:54.951687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed33a0-e5b1-4982-bd7a-04256fd6a6f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:54.961943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:54.962510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:54.962798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:54.963077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:54.967945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:54.969780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:54.980334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239b07-c492-41e1-b2f1-b1e02c2c18c8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.005721 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2511/5077] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/domains => generated 276 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:55.006655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.010455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:55.154523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.155837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.155837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.155837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.159586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.166789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.194110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d0d-3973-46cc-9c64-6d3db4bbab10 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.212338 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2567/5078] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:54 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:55.213163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.214446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.216441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.218057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.218416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.239134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2cc5b-7063-4624-ab59-688ca85a0693 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.263425 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:55.265293 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:55.382711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.384077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.384434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.384777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.393596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.407408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.416268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.418320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.432047 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2512/5079] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:31:55.432970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.491778 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2568/5080] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:31:55 2022] POST /identity/v3/users => generated 348 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:55.496738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.509169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04817-8b5b-40d9-98df-4e7fba076025 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.517391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.518164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.518452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.518730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.519560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.521738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.582533 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2569/5081] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:31:55 2022] POST /identity/v3/groups => generated 322 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:31:55.583752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.610504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a095a6-19b6-40ee-98b9-428094934dac service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.635851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.636653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.637001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.637946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.645912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997d7c-d777-4fc5-9a2d-bdd7a79e12b3 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.646471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.648255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.661169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.662226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.662513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.662789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/4e39969386f24ca38b7fafa98b220252` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.665706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e39969386f24ca38b7fafa98b220252)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.667324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.685440 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2513/5082] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:55.686244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.741252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f7c30-49f2-406a-a229-ba1859dcab91 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.741522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:55.742741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:55.756441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.759351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.761481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.764889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.768643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.778807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:55.808755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:55.813149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:55.817998 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2570/5083] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:55 2022] PATCH /identity/v3/domains/4e39969386f24ca38b7fafa98b220252 => generated 277 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:55.821719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.823359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:55.827811 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2514/5084] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:55.830352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:55.833234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:55.875269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749d499-f8b0-491b-a503-a3da2867f062 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.958190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1107-3e05-490e-bc87-171f35aca6db tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:55.964943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:55.966570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:55.967075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:55.967729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/4e39969386f24ca38b7fafa98b220252` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:55.991217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e39969386f24ca38b7fafa98b220252)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:55.993396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:56.033004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:56.036628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:56.037302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:56.037725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] PATH_INFO: `/v3/projects/120095705322475aa1989386bf8e4324/users/f42d8fb0167f496881c31b0b5b9201a0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:56.051414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.079700 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:56.080210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=120095705322475aa1989386bf8e4324, user_id=f42d8fb0167f496881c31b0b5b9201a0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:56.085252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023c514-39b6-4e2c-ae20-2872e9260afd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:56.136717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2515/5085] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:31:55 2022] PUT /identity/v3/projects/120095705322475aa1989386bf8e4324/users/f42d8fb0167f496881c31b0b5b9201a0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:56.143298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:56.143761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:56.144150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:56.191461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:56.193143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:56.243853 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:56.401064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2516/5086] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:31:56.416483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:56.419090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:56.426755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87aac07992144609952ea86f6caafb1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.427741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87aac07992144609952ea86f6caafb1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.442739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87aac07992144609952ea86f6caafb1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.462361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87aac07992144609952ea86f6caafb1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.491021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87aac07992144609952ea86f6caafb1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.504080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e39969386f24ca38b7fafa98b220252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.615425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172b76-1797-452d-9f0e-595181ff4ee1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:56.622493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.643351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.668367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.729054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project 4e39969386f24ca38b7fafa98b220252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:56.729054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.734155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.762515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:56.767472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:56.767994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:56.768487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:56.773165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.774944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:56.775552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.788014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e39969386f24ca38b7fafa98b220252', 'request_id': 'req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:56.799875 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=73,keystone:DELETE=25,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:56.816444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2571/5087] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:55 2022] DELETE /identity/v3/domains/4e39969386f24ca38b7fafa98b220252 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:56.822653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:56.827263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:56.991009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:56.994742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.019983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2517/5088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:31:57.024549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fdd7d-5137-4dc2-a872-b1920179cb1a tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.049286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.050843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.051239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.051622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/4e39969386f24ca38b7fafa98b220252` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.084359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=4e39969386f24ca38b7fafa98b220252)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:57.086444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find domain: 4e39969386f24ca38b7fafa98b220252.: keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.159566 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.160915 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.162178 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:57.167028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2572/5089] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:31:56 2022] GET /identity/v3/domains/4e39969386f24ca38b7fafa98b220252 => generated 112 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:57.177585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.180221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:57.252746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dec63-4f53-474f-a324-29a83578cf65 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.266318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.267530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.267983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.268435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/users/87aac07992144609952ea86f6caafb1c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.286476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:get_user(user_id=87aac07992144609952ea86f6caafb1c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:57.296264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find user: 87aac07992144609952ea86f6caafb1c.: keystone.exception.UserNotFound: Could not find user: 87aac07992144609952ea86f6caafb1c. Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:31:57.340261 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.341408 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 87aac07992144609952ea86f6caafb1c. Jul 24 01:31:57.342839 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:57.345171 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2518/5090] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:31:57 2022] GET /identity/v3/users/87aac07992144609952ea86f6caafb1c => generated 110 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:57.346132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.383188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee44698-2059-456b-95de-3d423324dd40 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.394037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.394915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.395199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.395474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/groups/e04f039d03174c0f93a1af1382039b90` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.419522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:get_group(group_id=e04f039d03174c0f93a1af1382039b90)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:57.420310 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:31:57.420310 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:31:57.420310 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:31:57.421473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find group: e04f039d03174c0f93a1af1382039b90.: keystone.exception.GroupNotFound: Could not find group: e04f039d03174c0f93a1af1382039b90. Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 24 01:31:57.491256 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.492273 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e04f039d03174c0f93a1af1382039b90. Jul 24 01:31:57.493277 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:57.499211 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2573/5091] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:57 2022] GET /identity/v3/groups/e04f039d03174c0f93a1af1382039b90 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:57.503279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.522962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2d65-c652-4ddd-9500-9b8fcd5abe31 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.531050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.533503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.534010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.534534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/groups/e04f039d03174c0f93a1af1382039b90` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.604943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find group: e04f039d03174c0f93a1af1382039b90.: keystone.exception.GroupNotFound: Could not find group: e04f039d03174c0f93a1af1382039b90. Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 24 01:31:57.645041 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.646042 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e04f039d03174c0f93a1af1382039b90. Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:57.647103 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2519/5092] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:31:57 2022] DELETE /identity/v3/groups/e04f039d03174c0f93a1af1382039b90 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:57.650710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.671103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b436a-a42b-4002-89f5-1464ccc5e826 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.689681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.690588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.690870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.691145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/users/87aac07992144609952ea86f6caafb1c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.714473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_user(user_id=87aac07992144609952ea86f6caafb1c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:57.714473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find user: 87aac07992144609952ea86f6caafb1c.: keystone.exception.UserNotFound: Could not find user: 87aac07992144609952ea86f6caafb1c. Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 24 01:31:57.768530 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.770056 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 87aac07992144609952ea86f6caafb1c. Jul 24 01:31:57.771769 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:31:57.779709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.782661 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:57.787270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2574/5093] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:31:57 2022] DELETE /identity/v3/users/87aac07992144609952ea86f6caafb1c => generated 110 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:57.789174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f417f-a9f5-46c9-884e-0596c412c52c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.816137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.817936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.818579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.818977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/4e39969386f24ca38b7fafa98b220252` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.842800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find domain: 4e39969386f24ca38b7fafa98b220252.: keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:57.875783 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:57.877199 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:57.879432 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:57.886011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2520/5094] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:57 2022] PATCH /identity/v3/domains/4e39969386f24ca38b7fafa98b220252 => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:31:57.891228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:57.903819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8243921-04b5-4066-ae64-e932cd1b22ee tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:57.935207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:57.936152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:57.936443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:57.936859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:57.938606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:57.940578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:57.996330 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2575/5095] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:31:57 2022] GET /identity/v3/domains => generated 1344 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:58.002019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:58.051225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd192f-e04e-4c90-a0c0-9180d960f221 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:58.077761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:58.078472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.078762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.079097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.079876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:58.080180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:58.091705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:58.198561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:58.200203 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2521/5096] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:31:58 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:31:58.215150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85289c66-7e88-4275-99d2-55ee85b92b95 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:58.228749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:58.229626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.230176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.231757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.244327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1425926761) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:31:58.245028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:58.247679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:58.294017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:58.295055 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2576/5097] 10.222.0.27 () {58 vars in 1198 bytes} [Sun Jul 24 01:31:58 2022] GET /identity/v3/domains?name=tempest-test_domain-1425926761 => generated 408 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:58.320384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8c104-5cd7-4614-ad41-4e472bc184f1 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:58.340256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:58.341586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.341910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.342198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/4e39969386f24ca38b7fafa98b220252` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.358834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Could not find domain: 4e39969386f24ca38b7fafa98b220252.: keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:31:58.375056 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:31:58.376198 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e39969386f24ca38b7fafa98b220252. Jul 24 01:31:58.377335 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:31:58.381756 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2522/5098] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:58 2022] PATCH /identity/v3/domains/4e39969386f24ca38b7fafa98b220252 => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:31:58.385860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:58.406493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394562e1-8ea8-4932-83df-78f543946e8c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:58.427971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:58.430957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.432773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.433064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/ef0889074be244f5ad72291ea4c22796` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.484742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ef0889074be244f5ad72291ea4c22796)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:58.487288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182aacf-e9dd-4a57-b37d-d2b66e875e17 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:58.612392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2577/5099] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:58 2022] PATCH /identity/v3/domains/ef0889074be244f5ad72291ea4c22796 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:58.617567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:58.646712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1cee-3873-4e28-9b55-5b4a3629285c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:58.654846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:58.657790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.658436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.658910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/ef0889074be244f5ad72291ea4c22796` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.682300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ef0889074be244f5ad72291ea4c22796)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:58.683913 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:31:58.683913 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:31:58.683913 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:31:58.687916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:58.753660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ef0889074be244f5ad72291ea4c22796'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:58.825949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ef0889074be244f5ad72291ea4c22796'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:58.911800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1714-4dd1-483d-9eff-dca5920ee227 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:58.912212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1714-4dd1-483d-9eff-dca5920ee227 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:58.913452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1714-4dd1-483d-9eff-dca5920ee227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:58.970414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:58.996947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.000786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0ffa1714-4dd1-483d-9eff-dca5920ee227 None None] MFA Rules not processed for user `f42d8fb0167f496881c31b0b5b9201a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:59.003540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ffa1714-4dd1-483d-9eff-dca5920ee227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.025108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.063055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project ef0889074be244f5ad72291ea4c22796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:59.063360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.068147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.099346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.100079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.109328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ef0889074be244f5ad72291ea4c22796', 'request_id': 'req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.130012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2523/5100] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:58 2022] DELETE /identity/v3/domains/ef0889074be244f5ad72291ea4c22796 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:31:59.134756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:59.139265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.150866 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:59.256711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2578/5101] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:59.260341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df649-fb56-4d37-900e-0087ea683aac None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:59.260710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df649-fb56-4d37-900e-0087ea683aac None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:59.261062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df649-fb56-4d37-900e-0087ea683aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:59.328894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb2873-a256-45fc-a0f2-3f88c3ab0e0c tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:59.339692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-168df649-fb56-4d37-900e-0087ea683aac None None] MFA Rules not processed for user `f42d8fb0167f496881c31b0b5b9201a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:31:59.341549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-168df649-fb56-4d37-900e-0087ea683aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.343672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:59.347148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:59.347454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:59.347736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/340e83404328408892cacf2a46f3b8fd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:59.363197 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:31:59.367925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2579/5102] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:31:59.369071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=340e83404328408892cacf2a46f3b8fd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:59.370965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:59.386140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168df649-fb56-4d37-900e-0087ea683aac None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:59.388487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-168df649-fb56-4d37-900e-0087ea683aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.404789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.405553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.443853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.444539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.451098 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2524/5103] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:31:59 2022] PATCH /identity/v3/domains/340e83404328408892cacf2a46f3b8fd => generated 276 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:31:59.452043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:31:59.454122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.654773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3869c-7309-428c-840e-b0a6074eef1f tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:59.661286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:59.662236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:59.662526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:59.662812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/340e83404328408892cacf2a46f3b8fd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:59.670257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168df649-fb56-4d37-900e-0087ea683aac None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:31:59.677930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=340e83404328408892cacf2a46f3b8fd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:31:59.679993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:31:59.711766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.725487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '340e83404328408892cacf2a46f3b8fd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.823376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.853312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.883489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.916731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:31:59.918179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:31:59.921193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:31:59.926062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:31:59.935644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:31:59.944102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project 340e83404328408892cacf2a46f3b8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:31:59.944559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.948401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.981935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:31:59.986238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.004610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '340e83404328408892cacf2a46f3b8fd', 'request_id': 'req-25abb34e-e51a-41b2-b472-3423c38d3bdf'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.011273 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:00.032648 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2525/5104] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:31:59 2022] DELETE /identity/v3/domains/340e83404328408892cacf2a46f3b8fd => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:00.038789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:00.041625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:00.151027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:00.155818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:00.190909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2580/5105] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:00.285229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abb34e-e51a-41b2-b472-3423c38d3bdf tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:00.313663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:00.316049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:00.316612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:00.316960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/e7073fc35b654ab8a556168e446fac85` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:00.374703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e7073fc35b654ab8a556168e446fac85)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:00.384010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:00.462292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.466169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.530549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.531886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.542538 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2526/5106] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:32:00 2022] PATCH /identity/v3/domains/e7073fc35b654ab8a556168e446fac85 => generated 277 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:00.544310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:00.562590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7f97f-b35a-4c5f-abb0-70c7802d8d4d service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:00.589870 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:00.812058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17ee55539654601b0b37f41b92f1e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a960f96af04f088cb82b6f998725d8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:00.813633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:00.813966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:00.814268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] PATH_INFO: `/v3/domains/e7073fc35b654ab8a556168e446fac85` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:00.838759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e7073fc35b654ab8a556168e446fac85)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:00.841615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:00.898858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:00.927498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e7073fc35b654ab8a556168e446fac85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.026334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.044502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.057924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.146692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] The token cache is being invalidate because project e7073fc35b654ab8a556168e446fac85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:01.147032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.154277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.189886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.193134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.198145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e48260f7-c96a-4576-8215-7a2e0a69f7f6 tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e7073fc35b654ab8a556168e446fac85', 'request_id': 'req-e48260f7-c96a-4576-8215-7a2e0a69f7f6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.229081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2581/5107] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:32:00 2022] DELETE /identity/v3/domains/e7073fc35b654ab8a556168e446fac85 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:01.233604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:01.235231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:01.438924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941207-cbad-4398-8f37-cde930c02efe tempest-DomainsTestJSON-1560939367 tempest-DomainsTestJSON-1560939367-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:01.609442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:01.613985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:01.613985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:01.613985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] PATH_INFO: `/v3/users/6d39d1fa8fd940ef925ffe0cf61e32d6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:01.617639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d39d1fa8fd940ef925ffe0cf61e32d6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:01.627585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:01.634112 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:01.752717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d39d1fa8fd940ef925ffe0cf61e32d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.769364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d39d1fa8fd940ef925ffe0cf61e32d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.780798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d39d1fa8fd940ef925ffe0cf61e32d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.812080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d39d1fa8fd940ef925ffe0cf61e32d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.818218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d39d1fa8fd940ef925ffe0cf61e32d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:01.827697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2527/5108] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:01 2022] DELETE /identity/v3/users/6d39d1fa8fd940ef925ffe0cf61e32d6 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:01.832129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4927-0828-440c-bede-5df308d56bb2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:01.832753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4927-0828-440c-bede-5df308d56bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:01.832753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4927-0828-440c-bede-5df308d56bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:01.867462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-568f4927-0828-440c-bede-5df308d56bb2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:01.869349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-568f4927-0828-440c-bede-5df308d56bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:01.990287 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:02.037523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2582/5109] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:02.161879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:02.163322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:02.391024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:02.391781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:02.392276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:02.402644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae26521-605d-4fbe-b5a9-ac83e1155060 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:02.414032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:02.414717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:02.414999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:02.415285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:02.438794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:02.440568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:02.453284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:02.454962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:02.498446 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2528/5110] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:02.592651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2583/5111] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:02.645320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:02.648875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:02.871522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34917a-9999-48a9-9c4b-29045a1acc5f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:02.888293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:02.890506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:02.891228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:02.893010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:02.919777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:02.928511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:02.982138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2529/5112] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:03.580779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:03.582804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:03.610545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b41e3-fa58-47e6-bdd5-c7344b751b6e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:03.625165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:03.626394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:03.626855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:03.627295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] PATH_INFO: `/v3/projects/5ec9bb7927dd4c1081e5e3a2119ce68d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:03.629905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec9bb7927dd4c1081e5e3a2119ce68d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:03.634623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:03.774971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec9bb7927dd4c1081e5e3a2119ce68d', 'request_id': 'req-1374d848-d34c-4419-acc8-cf62af3288b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:03.811545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec9bb7927dd4c1081e5e3a2119ce68d', 'request_id': 'req-1374d848-d34c-4419-acc8-cf62af3288b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:03.835998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec9bb7927dd4c1081e5e3a2119ce68d', 'request_id': 'req-1374d848-d34c-4419-acc8-cf62af3288b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:03.868855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] The token cache is being invalidate because project 5ec9bb7927dd4c1081e5e3a2119ce68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:03.869630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:03.870815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:03.876307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2584/5113] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:03 2022] DELETE /identity/v3/projects/5ec9bb7927dd4c1081e5e3a2119ce68d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:03.880147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:03.901296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992f36b-daf5-44e4-b615-d7f38e04178d service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:03.927209 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:04.038928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:04.040042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:04.040690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:04.041144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] PATH_INFO: `/v3/users/d17ee55539654601b0b37f41b92f1e96` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:04.042658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17ee55539654601b0b37f41b92f1e96)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:04.045775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:04.171147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17ee55539654601b0b37f41b92f1e96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:04.193981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17ee55539654601b0b37f41b92f1e96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:04.204621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17ee55539654601b0b37f41b92f1e96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:04.232614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17ee55539654601b0b37f41b92f1e96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:04.234686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17ee55539654601b0b37f41b92f1e96'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:04.261460 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2530/5114] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:03 2022] DELETE /identity/v3/users/d17ee55539654601b0b37f41b92f1e96 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:05.140027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:05.142782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:05.186042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d848-d34c-4419-acc8-cf62af3288b4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:05.351265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:05.352380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:05.355200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:05.357697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] PATH_INFO: `/v3/users/f42d8fb0167f496881c31b0b5b9201a0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:05.365706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42d8fb0167f496881c31b0b5b9201a0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:05.369538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:05.382473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:05.384610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:05.422047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5c1be-bf45-462d-8f6e-714fa5e2d464 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:05.437417 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:05.440485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:05.441936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:05.442152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:05.442432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] PATH_INFO: `/v3/users/def326a0b6794db78d5b2f167375ed86` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:05.454504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=def326a0b6794db78d5b2f167375ed86)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:05.456772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:05.556195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42d8fb0167f496881c31b0b5b9201a0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.557653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42d8fb0167f496881c31b0b5b9201a0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.576114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42d8fb0167f496881c31b0b5b9201a0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.593348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def326a0b6794db78d5b2f167375ed86'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.594495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42d8fb0167f496881c31b0b5b9201a0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.614052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def326a0b6794db78d5b2f167375ed86'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.625039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def326a0b6794db78d5b2f167375ed86'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.638717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-44bd200d-e27a-4f51-b87c-1016a55f05b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42d8fb0167f496881c31b0b5b9201a0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.648560 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2585/5115] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:05 2022] DELETE /identity/v3/users/f42d8fb0167f496881c31b0b5b9201a0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:05.649928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def326a0b6794db78d5b2f167375ed86'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.654192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def326a0b6794db78d5b2f167375ed86'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:05.680613 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2531/5116] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:05 2022] DELETE /identity/v3/users/def326a0b6794db78d5b2f167375ed86 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:05.686193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:05.686819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:05.688210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:05.747795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:05.749771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:05.872490 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2586/5117] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:05.916513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:05.918220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:05.926090 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:06.109825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82422b5-5601-4b5c-bc81-1e8c49901a1e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:06.146492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:06.147543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:06.148002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:06.148481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:06.162899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:06.164660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2c0c6-aebc-442f-a0ea-6cb677ec5572 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:06.196181 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2532/5118] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:06.427214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:06.430633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:06.466770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816f68-9ad6-462a-b4ab-820ac01be451 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:06.491578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:06.492770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:06.493236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:06.493780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] PATH_INFO: `/v3/projects/120095705322475aa1989386bf8e4324` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:06.495364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] RBAC: Authorizing `identity:delete_project(project_id=120095705322475aa1989386bf8e4324)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:06.498498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:06.732518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120095705322475aa1989386bf8e4324', 'request_id': 'req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:06.775635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120095705322475aa1989386bf8e4324', 'request_id': 'req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:06.791809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120095705322475aa1989386bf8e4324', 'request_id': 'req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:06.821991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] The token cache is being invalidate because project 120095705322475aa1989386bf8e4324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:06.822301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:06.830523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:06.839404 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2587/5119] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:06 2022] DELETE /identity/v3/projects/120095705322475aa1989386bf8e4324 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:06.845478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89ce4-9a22-4a31-aff2-c2c2b8385fa3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:06.846430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89ce4-9a22-4a31-aff2-c2c2b8385fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:06.846906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89ce4-9a22-4a31-aff2-c2c2b8385fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:06.889876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-56c89ce4-9a22-4a31-aff2-c2c2b8385fa3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:06.891478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56c89ce4-9a22-4a31-aff2-c2c2b8385fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.028099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.029772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.091731 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:07.142387 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2533/5120] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:07.153114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.153420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.159528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.244338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:07.245557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdea59-d7f4-49b6-aba7-ba42f2c8baec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:07.245709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.264336 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2534/5121] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:07.264825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:07.265752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.266050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.266319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] PATH_INFO: `/v3/projects/3a11c22dc19a4db393f72e0c3979579e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.267685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a11c22dc19a4db393f72e0c3979579e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:07.269697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:07.272499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.286483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7658-5725-4c0d-818e-8f2ec715d270 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:07.296771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:07.297997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.298610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.299420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.300688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:07.301622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:07.305098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:07.327729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2535/5122] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:07.338273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.364997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ce4e-9133-4a35-8abc-7a3ac240a7a5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:07.374199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:07.376580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.377256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.378082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.379515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:07.381794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:07.424689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a11c22dc19a4db393f72e0c3979579e', 'request_id': 'req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.440333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a11c22dc19a4db393f72e0c3979579e', 'request_id': 'req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.458443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a11c22dc19a4db393f72e0c3979579e', 'request_id': 'req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.478809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] The token cache is being invalidate because project 3a11c22dc19a4db393f72e0c3979579e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:07.479131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.486019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ce8c4fb8-ac5f-4918-a6c3-ecf92c63bef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.491557 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2588/5123] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:07 2022] DELETE /identity/v3/projects/3a11c22dc19a4db393f72e0c3979579e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:07.492990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.493294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.493657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.519188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2536/5124] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:07.522309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:07.523273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.524867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.528321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.646536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2589/5125] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:07.654366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.656146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.670147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78461bb-5a52-4d1f-a0ba-3b6221d10f1d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:07.675221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:07.676145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.676480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.676821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] PATH_INFO: `/v3/projects/95a960f96af04f088cb82b6f998725d8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.678123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a960f96af04f088cb82b6f998725d8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:07.680145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:07.709557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744820-34e6-4918-93c4-ea8ca46738d8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:07.728994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:07.729726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.730019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.730334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.731742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:07.733730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef030-3642-40c7-99e5-fe4208dcb48e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:07.760170 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:07.771835 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:07.781368 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2537/5126] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:07.782890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ca711-855a-4fd7-b504-baf269ab8530 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.783154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ca711-855a-4fd7-b504-baf269ab8530 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.783436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ca711-855a-4fd7-b504-baf269ab8530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:07.786359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a960f96af04f088cb82b6f998725d8', 'request_id': 'req-0b53368f-8bdb-4839-859c-6009f700e703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.797740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a960f96af04f088cb82b6f998725d8', 'request_id': 'req-0b53368f-8bdb-4839-859c-6009f700e703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.816975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a960f96af04f088cb82b6f998725d8', 'request_id': 'req-0b53368f-8bdb-4839-859c-6009f700e703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.828956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-849ca711-855a-4fd7-b504-baf269ab8530 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:07.830245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-849ca711-855a-4fd7-b504-baf269ab8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.835933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] The token cache is being invalidate because project 95a960f96af04f088cb82b6f998725d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:07.836230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.839600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:07.843408 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2590/5127] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:07 2022] DELETE /identity/v3/projects/95a960f96af04f088cb82b6f998725d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:07.844395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:07.845931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:07.992669 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2538/5128] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:07.992669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102896-fd77-4955-9512-907fc6efafbd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:07.993631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102896-fd77-4955-9512-907fc6efafbd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:07.993631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51102896-fd77-4955-9512-907fc6efafbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.002847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53368f-8bdb-4839-859c-6009f700e703 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.018805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.019550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.019837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.020114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.020864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.022527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.029618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-51102896-fd77-4955-9512-907fc6efafbd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:08.030888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-51102896-fd77-4955-9512-907fc6efafbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:08.046657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2591/5129] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:08.047652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.055520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2539/5130] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:08.056544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51102896-fd77-4955-9512-907fc6efafbd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.083694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac548-a90f-4ca9-a6c4-4652bff37722 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.093651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51102896-fd77-4955-9512-907fc6efafbd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.102164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.103178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.104241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.105220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.108590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:08.109488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.110104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.111037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.132140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.132709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.133787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.134272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e34a28-c785-470f-812c-08188e35d413 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.138314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.167067 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2540/5131] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:08.168352 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2592/5132] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:08.170421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.171610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.172620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.173555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.258236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:08.261140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:08.265132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef8ab8-5acb-4e07-a916-83e9d310ec55 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.276603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.279254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.279822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.280558 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2593/5133] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:08.281134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.281590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.282577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.289767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.295321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb6a5-a98c-4f57-8cda-ea1af0185c01 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.301396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.302336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.303298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.303686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] PATH_INFO: `/v3/projects/9c2f15d0580547d2a83c6b39381873fb/users/81dad264129d487c88fb39d9356550b1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.337935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2f15d0580547d2a83c6b39381873fb, user_id=81dad264129d487c88fb39d9356550b1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.348978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.358687 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2541/5134] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:08 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:08.360348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.381726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2594/5135] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:08 2022] PUT /identity/v3/projects/9c2f15d0580547d2a83c6b39381873fb/users/81dad264129d487c88fb39d9356550b1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:08.383387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.539079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b134b3-8ed7-43cf-ae69-c5fd7a4e97e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.559666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.562618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.563582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.563582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.568280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:08.568791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.571311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30e1dc-86ad-4bd3-aad8-50b5da4a4060 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.574918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102efa0c-2820-410f-96d8-fe24ac5f9102 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.601482 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2542/5136] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:08.602926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.603334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.603729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.614731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.615441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.615722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.615996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.616711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.618670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.655901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:08.658023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:08.682000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2543/5137] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:08.684853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.704911 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2595/5138] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:08 2022] POST /identity/v3/users => generated 292 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:08.709105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.709256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36458a48-794a-49b2-bdd2-b63f376a85de None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.711706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:08.727440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:08.728831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:08.729291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:08.729760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:08.733459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:08.740105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:08.750211 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:08.811331 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2544/5139] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:08 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:08.811331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:08.815470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:08.863044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902e81d-00dd-4133-899a-b986831a53a3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:08.917432 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:09.012768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.014025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.014572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.015077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.020861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:09.046032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b18b-28a0-4a7d-99ec-01c322b9bd4e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.054669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.055342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.055680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.055957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.255953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.256988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.295892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.300924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2545/5140] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:09.301902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.313465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.352103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103167a2-773b-4145-9fe6-e0bdf31fa795 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.364531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2596/5141] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:09.366323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.370574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.371466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.371466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.372186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.372941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.380981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.391603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94ba0-3efb-4408-926c-7479a8a91d37 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.408615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.409648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.410075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.410464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.411287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.415544 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2546/5142] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:09.416506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.421281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.445854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a114b7-0c4c-4631-93f0-56f6db674880 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.463355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.464051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.464362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.464617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.471713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.473486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.476156 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2597/5143] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:09 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:09.480474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.509784 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2547/5144] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:09.510656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ca4b-f7dd-4478-bf26-b493c5e1bcae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.510832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.525221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.526359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.526756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.527278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.532585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.536784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.543203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7af8-3259-405e-ac7a-a146d2b04d68 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.564063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.565027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.565305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.565592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] PATH_INFO: `/v3/projects/00fbfce392d0436a9465be47ee3e4f8d/users/bab383497d8e44d0af5d98d83cabf9bc/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.568208 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2598/5145] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:09.572092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.598106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508692-bfb8-4067-9878-5b5868857a91 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.612670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.615622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.615999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.616511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.617487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.619268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.637595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fbfce392d0436a9465be47ee3e4f8d, user_id=bab383497d8e44d0af5d98d83cabf9bc, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.640315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378125-4dfc-43f1-b857-1ce496d1d410 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.649898 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2599/5146] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:09.651383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.669776 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2548/5147] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:09 2022] PUT /identity/v3/projects/00fbfce392d0436a9465be47ee3e4f8d/users/bab383497d8e44d0af5d98d83cabf9bc/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:09.682125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.682421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.682708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.684462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9bac-7c2d-4f8f-8d5d-2c9384e1ba8a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:09.740696 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:09.767403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] MFA Rules not processed for user `bab383497d8e44d0af5d98d83cabf9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:09.768647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:09.816977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:09.819174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.821340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.821736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] PATH_INFO: `/v3/projects/79c34f686e7143b3aee9bfdd36c070bd/users/5db4064afb7a4ae0886451580288af7f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.869095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c34f686e7143b3aee9bfdd36c070bd, user_id=5db4064afb7a4ae0886451580288af7f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:09.876806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd2050-1333-4d01-8acf-2282a34b0194 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:09.921941 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2600/5148] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:09 2022] PUT /identity/v3/projects/79c34f686e7143b3aee9bfdd36c070bd/users/5db4064afb7a4ae0886451580288af7f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:09.933047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:09.933492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:09.935810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:09.961946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2549/5149] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:09.974450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:09.975903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:10.014707 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:10.059952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] MFA Rules not processed for user `5db4064afb7a4ae0886451580288af7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:10.062042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:10.142850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faece510-4f10-4be0-8feb-5ab0eb24be12 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:10.312518 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2601/5150] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:10.316834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:10.368969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:10.370206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:10.370750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:10.376573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:10.474086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c2e41-c9b7-418a-9067-a9b11ee87561 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:10.491063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:10.491753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:10.492585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:10.492900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:10.493615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:10.528444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:10.595711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:10.597468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:10.598413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2602/5151] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:10.603116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:10.641218 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2550/5152] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:10.727142 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:10.774659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23190c-7109-4378-ad4f-0ff5ffa60e36 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:10.786356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:10.787285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:10.787734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:10.788158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:10.789291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:10.795917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:10.865463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2603/5153] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:10 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:10.869297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:10.894558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c15b-5ed8-4273-8cf1-233ae4a1d47e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:10.917081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:10.924098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:10.926003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:10.927335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:10.930685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:10.938577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:11.008794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2551/5154] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:11.012847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:11.045833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a78fb5-5be4-4153-bef3-ad8de0446b3e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:11.068116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:11.071361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:11.071652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:11.071936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] PATH_INFO: `/v3/projects/bddcff401c7947f8bc5302e6041c4a06/users/f1c03b0096e64d36b8d4762142a731d9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:11.133114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcff401c7947f8bc5302e6041c4a06, user_id=f1c03b0096e64d36b8d4762142a731d9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:11.142786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:11.210246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2604/5155] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:11 2022] PUT /identity/v3/projects/bddcff401c7947f8bc5302e6041c4a06/users/f1c03b0096e64d36b8d4762142a731d9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:11.214499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:11.229396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a78d7-84cf-4a7a-906c-08e747ce4eb8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:11.434404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:11.435489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:11.436030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:11.436533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:11.437519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:11.439420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042414-30f7-4c9a-9246-d18f8cae1a3f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:11.478287 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2552/5156] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:11.482892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:11.508977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225263-3010-4009-bc63-1d3fd8dadfb4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:11.525201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:11.526566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:11.528601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:11.530026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] PATH_INFO: `/v3/projects/bddcff401c7947f8bc5302e6041c4a06/users/f1c03b0096e64d36b8d4762142a731d9/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:11.543215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bddcff401c7947f8bc5302e6041c4a06, user_id=f1c03b0096e64d36b8d4762142a731d9, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:11.550036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:11.608846 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2605/5157] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:11 2022] PUT /identity/v3/projects/bddcff401c7947f8bc5302e6041c4a06/users/f1c03b0096e64d36b8d4762142a731d9/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:11.615870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:11.616513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:11.617056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:11.672497 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:11.701183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] MFA Rules not processed for user `f1c03b0096e64d36b8d4762142a731d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:11.702454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:11.977933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2553/5158] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:11.978670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.002371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d986-0ad5-4f81-892d-91ba902a0a20 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.034022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.035854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.037981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.038292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.039077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.050140 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:12.050140 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:32:12.050140 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:12.051088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.115671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.134987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2606/5159] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:11 2022] POST /identity/v3/services => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:12.139905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f377-7bbe-47b9-b3f2-ddfa4310bec5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.163252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.163834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.164277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.164651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.165720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.167541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.188800 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1786874726. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:12.188800 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:12.188800 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:12.275851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.283608 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2554/5160] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:32:12 2022] POST /identity/v3/endpoints => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:12.295186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747abd58-03db-4d7f-b03d-d6a1a8ca6dd4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.338134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.339257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.339588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.339914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-1786874726` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.340663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1786874726)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.341961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.359887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.373924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2607/5161] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:32:12 2022] GET /identity/v3/regions/tempest-region-1786874726 => generated 180 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:12.383646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a009394-5d19-4de2-8715-923371d3b38e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.391343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.392274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.392571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.392907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.393818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.400155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.424672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.432013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2555/5162] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:12 2022] POST /identity/v3/services => generated 287 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:12.439967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd5c9-dde0-4bb6-807e-26ed69430597 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.475776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.476363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.476654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.477336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.478286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.479322 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:12.479322 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:32:12.479322 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:12.482438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.542759 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-612609858. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:12.542759 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:12.542759 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:12.602784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2608/5163] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:32:12 2022] POST /identity/v3/endpoints => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:12.607005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.626890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710510-f5a2-4063-b395-6805453309d4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.687375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.688467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.688878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.689275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-612609858` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.690200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-612609858)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.692868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.707781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2556/5164] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:32:12 2022] GET /identity/v3/regions/tempest-region-612609858 => generated 178 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:12.709041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.732216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a061e3-3cf0-497f-966c-1e7d61f2bbc8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.748990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.749698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.761117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.761305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.762851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.773253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:12.837248 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-548914372. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:12.837248 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:12.837248 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:12.913901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2609/5165] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:32:12 2022] POST /identity/v3/endpoints => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:12.918363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:12.936367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727297-0dfd-4529-b0fd-a3c51661701f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:12.991746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:12.994094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:12.994420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:12.994710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-548914372` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:12.997784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-548914372)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:12.998926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.007156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.018965 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2557/5166] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:32:12 2022] GET /identity/v3/regions/tempest-region-548914372 => generated 178 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:13.022364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879ed68-2476-4029-8e66-1505ee8faf69 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.029250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.030310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.030775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.031245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.032531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.033872 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:13.033872 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:32:13.033872 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:13.036388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.057468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.071734 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2610/5167] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:32:13 2022] GET /identity/v3/endpoints => generated 4385 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:13.075181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d654-fa36-4980-b73f-389b505dd70e tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.086008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.087613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.088123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.088590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/c328737258ad4f17845d1416d130f935` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.097495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=c328737258ad4f17845d1416d130f935)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.098817 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:13.098817 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:13.098817 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:13.100079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.108797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.117859 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2558/5168] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:13 2022] GET /identity/v3/endpoints/c328737258ad4f17845d1416d130f935 => generated 359 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:13.181099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb538-a329-4f0c-be9c-7a1290481a6b tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.192357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.193385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.193692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.193982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/c328737258ad4f17845d1416d130f935` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.210063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c328737258ad4f17845d1416d130f935)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.213586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.225332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c328737258ad4f17845d1416d130f935', 'request_id': 'req-7d20f49e-13f3-47c8-a013-9a8f38348d35'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:13.250401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.250813 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2611/5169] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:13 2022] DELETE /identity/v3/endpoints/c328737258ad4f17845d1416d130f935 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:13.271802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a2a-047c-4311-8341-57527cfbc818 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.352451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.353117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.353117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.353535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.354166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.355729 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:13.355729 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:13.355729 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:13.356996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.397576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2559/5170] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:32:13 2022] GET /identity/v3/endpoints => generated 4039 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:13.399650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.437780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20f49e-13f3-47c8-a013-9a8f38348d35 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.463614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.468091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.477998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.477998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/c328737258ad4f17845d1416d130f935` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.521555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Could not find endpoint: c328737258ad4f17845d1416d130f935.: keystone.exception.EndpointNotFound: Could not find endpoint: c328737258ad4f17845d1416d130f935. Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._iter().one() Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._only_one_row( Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:13.610577 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: c328737258ad4f17845d1416d130f935. Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:32:13.611880 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:32:13.613293 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: c328737258ad4f17845d1416d130f935. Jul 24 01:32:13.614477 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:32:13.628736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.629365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2612/5171] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:13 2022] DELETE /identity/v3/endpoints/c328737258ad4f17845d1416d130f935 => generated 114 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:32:13.641512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.642855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2e898-602d-4ca5-a9cb-fddcf1fab767 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.644602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:13.653590 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:INSERT=10,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:13.678664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.679317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.679612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.679906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-548914372` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.680580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-548914372)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.700173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.762825 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-548914372. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:13.762825 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:13.762825 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:13.794417 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2560/5172] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:32:13 2022] DELETE /identity/v3/regions/tempest-region-548914372 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:13.795760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:13.912499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d445c-1cf3-4e9c-8503-7b2d3ac100b7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:13.939674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:13.940247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:13.948747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:13.949105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:13.952239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:13.963473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:13.998585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc708afd-fd7f-47dd-8507-67e7d19f75c7 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.010730 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2561/5173] 10.222.0.27 () {58 vars in 1133 bytes} [Sun Jul 24 01:32:13 2022] GET /identity/v3/endpoints => generated 4039 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:14.012245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.039722 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:14.055721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fe613-2999-41c6-9020-f5cf810e38bf tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.060180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.060842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.061142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.066994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.070225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.071621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.071621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.071621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.072576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Adding query filter params (service_id=a5c8483b6ee8460d907af8f93e8eb5e9) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:14.072899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.075330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.083171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:14.097599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2562/5174] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:32:14 2022] GET /identity/v3/endpoints?service_id=a5c8483b6ee8460d907af8f93e8eb5e9 => generated 503 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:14.099321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.124193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6ec4-b639-47d4-bd2a-abc579fe04c4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.141702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.142588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.142886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.143168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.146512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Adding query filter params (service_id=0d419cee695646289633a05ba0a1e9ec) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:14.147010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.153149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.171406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2563/5175] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:32:14 2022] GET /identity/v3/endpoints?service_id=0d419cee695646289633a05ba0a1e9ec => generated 503 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:14.172962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.187478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7a672-c912-450c-95a5-1f5fda535557 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.197754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.199312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.199797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.200479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.201431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:14.201943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.204708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.238682 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2564/5176] 10.222.0.27 () {58 vars in 1166 bytes} [Sun Jul 24 01:32:14 2022] GET /identity/v3/endpoints?interface=public => generated 3396 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:14.240066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.314070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e58b-330e-41fd-8b24-128e2cadb77a tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.334926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.336079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.336434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.336653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.337508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:14.337756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.339957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.367696 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2565/5177] 10.222.0.27 () {58 vars in 1170 bytes} [Sun Jul 24 01:32:14 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:14.370125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.407695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bab-3c53-41ec-b449-139152d32bb4 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.427184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.427880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.428396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.428694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.429437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.431109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.466670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.468153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.475763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2566/5178] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:14 2022] POST /identity/v3/services => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:14.478180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.550238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab0b0-4f3e-4783-8ab8-221959407a81 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.568173 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2613/5179] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:13 2022] GET /identity/v3/auth/tokens => generated 4082 bytes in 927 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:14.569304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.570023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.574453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.574880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.575692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.583795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.636587 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1324178148. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:14.636587 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:14.636587 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:14.784023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.785607 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2567/5180] 10.222.0.27 () {60 vars in 1155 bytes} [Sun Jul 24 01:32:14 2022] POST /identity/v3/endpoints => generated 361 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:14.812141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337d40-d438-4bf7-9863-9c94542556b4 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.894723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.896001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.898416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.903101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-1324178148` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:14.904806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1324178148)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:14.914008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:14.930386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:14.941447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2614/5181] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:32:14 2022] GET /identity/v3/regions/tempest-region-1324178148 => generated 180 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:32:14.953586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b52d6-2ecc-477f-af5e-f9ffb7a1e5f8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:14.974916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:14.978509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:14.982209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:14.983038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/da938d08fcd34b2cb0357911083a331b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.014176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=da938d08fcd34b2cb0357911083a331b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.018681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.079376 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-863922277. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:15.079376 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:15.079376 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:15.201884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.210961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2568/5182] 10.222.0.27 () {60 vars in 1255 bytes} [Sun Jul 24 01:32:14 2022] PATCH /identity/v3/endpoints/da938d08fcd34b2cb0357911083a331b => generated 362 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:15.219965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d514-c62f-4a62-8daf-4113ca4238a3 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:15.295228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:15.310838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:15.311799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:15.316991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-863922277` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.318122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-863922277)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.322498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.345646 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2615/5183] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:32:15 2022] GET /identity/v3/regions/tempest-region-863922277 => generated 178 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:15.351422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.401700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc342cc-d733-4163-bd8c-2c8177792f88 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:15.408010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:15.409172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:15.409778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:15.410306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/da938d08fcd34b2cb0357911083a331b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.436476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=da938d08fcd34b2cb0357911083a331b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.438033 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:15.438033 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:15.438033 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:15.439701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.517847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'da938d08fcd34b2cb0357911083a331b', 'request_id': 'req-b24a58d6-e094-497b-b302-c76354e833b2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:15.534717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2569/5184] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:15 2022] DELETE /identity/v3/endpoints/da938d08fcd34b2cb0357911083a331b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:15.539126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.565734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3f53-0236-4d4b-bc75-389c098bc3a8 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:15.607232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:15.607232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:15.607232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:15.607611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-863922277` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.607611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-863922277)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.607611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.634953 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-863922277. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:32:15.634953 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:32:15.634953 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:15.655449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2616/5185] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:32:15 2022] DELETE /identity/v3/regions/tempest-region-863922277 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:15.659295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.675508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a58d6-e094-497b-b302-c76354e833b2 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:15.708460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:15.709323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:15.709606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:15.709931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-1324178148` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.710604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1324178148)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.712241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.750604 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2570/5186] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:32:15 2022] DELETE /identity/v3/regions/tempest-region-1324178148 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:15.751823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.774867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdfc9-0ef9-4c39-8699-82d00e759b94 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:15.818800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:15.819699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:15.819989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:15.820283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services/688f9aa2a5af47cc9076c2842e3af52b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:15.820960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_service(service_id=688f9aa2a5af47cc9076c2842e3af52b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:15.822639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:15.859921 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:15.877599 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2617/5187] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:15 2022] DELETE /identity/v3/services/688f9aa2a5af47cc9076c2842e3af52b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:15.887206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:15.927907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c11d-ac0b-4ea1-9df4-289cbca3d62f tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.022491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.025260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.025260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.025260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/5e1f11a4d39a4a729345adb03489fdf8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.059112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5e1f11a4d39a4a729345adb03489fdf8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.061066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.103509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5e1f11a4d39a4a729345adb03489fdf8', 'request_id': 'req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:16.115948 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:16.157095 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2571/5188] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:15 2022] DELETE /identity/v3/endpoints/5e1f11a4d39a4a729345adb03489fdf8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:16.161126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:16.183361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5d5f-8e1a-47ac-95e7-5935283121f0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.219845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.220902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.221273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.222556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-612609858` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.223594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-612609858)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.227654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.280917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2618/5189] 10.222.0.27 () {58 vars in 1205 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/regions/tempest-region-612609858 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:16.282328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:16.309142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5a6e-1ae1-4e39-b3a6-901daf7ae5bb tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.372406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.373207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.373575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.373813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services/0d419cee695646289633a05ba0a1e9ec` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.374459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0d419cee695646289633a05ba0a1e9ec)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.375493 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:16.375493 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:16.375493 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:16.376390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.452516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2572/5190] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/services/0d419cee695646289633a05ba0a1e9ec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:16.456370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:16.476439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51cc3-ec87-45f8-a67b-552e82659d13 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.544832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.545737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.546035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.551128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/endpoints/eaac792268204935a3b35843d45c0546` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.575796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=eaac792268204935a3b35843d45c0546)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.594171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.644511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'eaac792268204935a3b35843d45c0546', 'request_id': 'req-70bfcea2-8a22-463f-9a3a-68ee06212a24'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:16.681983 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2619/5191] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/endpoints/eaac792268204935a3b35843d45c0546 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:16.686917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:16.708062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac9c9c-212c-4155-869a-6e123585f2b0 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.772299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.773180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.773473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.773790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/regions/tempest-region-1786874726` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.774700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1786874726)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.776303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.841467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2573/5192] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/regions/tempest-region-1786874726 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:16.849222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:16.884360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfcea2-8a22-463f-9a3a-68ee06212a24 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:16.928731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1c03b0096e64d36b8d4762142a731d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bddcff401c7947f8bc5302e6041c4a06', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:16.930242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:16.930784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:16.931296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] PATH_INFO: `/v3/services/a5c8483b6ee8460d907af8f93e8eb5e9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:16.932175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a5c8483b6ee8460d907af8f93e8eb5e9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:16.934923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e79faa-56f3-4c5e-ac2c-57e64f2f90db tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:16.985335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2620/5193] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/services/a5c8483b6ee8460d907af8f93e8eb5e9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:16.989190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:17.211538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207118ea-2f29-4f56-9695-777313244a84 tempest-EndPointsTestJSON-1575031047 tempest-EndPointsTestJSON-1575031047-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:17.285234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:17.286630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:17.287085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:17.287527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] PATH_INFO: `/v3/users/5db4064afb7a4ae0886451580288af7f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:17.293741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db4064afb7a4ae0886451580288af7f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:17.296206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:17.471295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db4064afb7a4ae0886451580288af7f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:17.488888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db4064afb7a4ae0886451580288af7f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:17.518378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db4064afb7a4ae0886451580288af7f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:17.549070 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:17.553759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db4064afb7a4ae0886451580288af7f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:17.554541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db4064afb7a4ae0886451580288af7f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:17.576634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2574/5194] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:16 2022] DELETE /identity/v3/users/5db4064afb7a4ae0886451580288af7f => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:17.578838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:17.580344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:17.580970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:17.619235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:17.622481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:17.843759 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2621/5195] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:17.895181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:17.896839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:18.020239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666829-efa2-42c4-84fa-82ef41725ef0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:18.026550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:18.028208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:18.028865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:18.029359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:18.042754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:18.044712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:18.061867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2575/5196] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:18.431813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:18.433727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:18.456597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c38b90-9fc1-47a5-81ea-5fb2f26e04af None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:18.470612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:18.471863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:18.474019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:18.474548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] PATH_INFO: `/v3/users/b0f04ff3b36d4b0686c9a68ff55ee99d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:18.476658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f04ff3b36d4b0686c9a68ff55ee99d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:18.479703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:18.617863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f04ff3b36d4b0686c9a68ff55ee99d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:18.619769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f04ff3b36d4b0686c9a68ff55ee99d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:18.644406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f04ff3b36d4b0686c9a68ff55ee99d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:18.646058 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:18.669899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f04ff3b36d4b0686c9a68ff55ee99d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:18.734434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f04ff3b36d4b0686c9a68ff55ee99d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:18.748065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2622/5197] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:18 2022] DELETE /identity/v3/users/b0f04ff3b36d4b0686c9a68ff55ee99d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:18.949867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:18.951352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:18.984521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93dda4-80fa-4ed7-b2c1-3bb49698ad57 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:19.218326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:19.219662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:19.220365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:19.220861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] PATH_INFO: `/v3/projects/79c34f686e7143b3aee9bfdd36c070bd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:19.225107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c34f686e7143b3aee9bfdd36c070bd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:19.227438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:19.428937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c34f686e7143b3aee9bfdd36c070bd', 'request_id': 'req-14a3692b-b3aa-44b6-9f90-254f2f203055'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.457009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c34f686e7143b3aee9bfdd36c070bd', 'request_id': 'req-14a3692b-b3aa-44b6-9f90-254f2f203055'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.492765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c34f686e7143b3aee9bfdd36c070bd', 'request_id': 'req-14a3692b-b3aa-44b6-9f90-254f2f203055'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.519147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] The token cache is being invalidate because project 79c34f686e7143b3aee9bfdd36c070bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:19.519637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.522918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.531574 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2576/5198] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:18 2022] DELETE /identity/v3/projects/79c34f686e7143b3aee9bfdd36c070bd => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:19.532870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:19.534405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:19.556421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea0dd5-7fbd-48c5-8687-18b4316051fd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:19.709015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:19.711640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:19.712390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:19.713021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] PATH_INFO: `/v3/users/f1c03b0096e64d36b8d4762142a731d9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:19.714799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c03b0096e64d36b8d4762142a731d9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:19.717939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:19.824457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c03b0096e64d36b8d4762142a731d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.825139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c03b0096e64d36b8d4762142a731d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.837036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c03b0096e64d36b8d4762142a731d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.850802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c03b0096e64d36b8d4762142a731d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.872594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-65f0152c-3463-4b53-a8a3-b5440fd1bafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c03b0096e64d36b8d4762142a731d9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:19.889427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2623/5199] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:19 2022] DELETE /identity/v3/users/f1c03b0096e64d36b8d4762142a731d9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:20.628413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:20.630101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:20.660178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3692b-b3aa-44b6-9f90-254f2f203055 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:20.722450 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:20.962905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:20.964372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:20.965445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:20.966160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] PATH_INFO: `/v3/projects/e39cbca23eba4208a1c160cfb5aef490` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:20.970415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39cbca23eba4208a1c160cfb5aef490)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:20.972921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:21.069506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39cbca23eba4208a1c160cfb5aef490', 'request_id': 'req-d55d1427-6f6a-4f2a-98f8-189aab2305c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.095078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39cbca23eba4208a1c160cfb5aef490', 'request_id': 'req-d55d1427-6f6a-4f2a-98f8-189aab2305c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.133505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39cbca23eba4208a1c160cfb5aef490', 'request_id': 'req-d55d1427-6f6a-4f2a-98f8-189aab2305c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.172349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] The token cache is being invalidate because project e39cbca23eba4208a1c160cfb5aef490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:21.172719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.180028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d55d1427-6f6a-4f2a-98f8-189aab2305c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.190688 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2577/5200] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:20 2022] DELETE /identity/v3/projects/e39cbca23eba4208a1c160cfb5aef490 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:21.197408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.198331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.198331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:21.252551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:21.260252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:21.424739 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:21.458418 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2624/5201] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:21.466618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.466815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.467123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:21.521631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:21.524140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:21.544095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:21.545565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:21.563756 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2578/5202] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:21.567058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeec200-6008-4b71-be18-1b538a06f823 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:21.568771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:21.591201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:21.592048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.592330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.595006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf059c53-6117-4928-a03b-614ea9def253 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:21.595850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] PATH_INFO: `/v3/projects/bddcff401c7947f8bc5302e6041c4a06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:21.600776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bddcff401c7947f8bc5302e6041c4a06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:21.602779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:21.616479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:21.617162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.617445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.617743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:21.618501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:21.618865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:21.620633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:21.663711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2579/5203] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:21.667603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:21.700138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09ede-5a20-46d4-9895-3b8a24c7f270 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:21.738572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:21.739257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.739537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.739812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:21.740520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:21.742477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:21.820737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bddcff401c7947f8bc5302e6041c4a06', 'request_id': 'req-b0478671-8401-4a06-8ea5-9f89c186f9c0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.852020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bddcff401c7947f8bc5302e6041c4a06', 'request_id': 'req-b0478671-8401-4a06-8ea5-9f89c186f9c0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.891505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bddcff401c7947f8bc5302e6041c4a06', 'request_id': 'req-b0478671-8401-4a06-8ea5-9f89c186f9c0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.925726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2580/5204] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:21 2022] POST /identity/v3/projects => generated 359 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:21.927083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:21.952156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] The token cache is being invalidate because project bddcff401c7947f8bc5302e6041c4a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:21.956318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.961928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0478671-8401-4a06-8ea5-9f89c186f9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:21.971226 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2625/5205] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:21 2022] DELETE /identity/v3/projects/bddcff401c7947f8bc5302e6041c4a06 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:21.975036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:21.976634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:21.977441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.045705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:22.047440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.135721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f584e2c-fe50-4243-bc84-4bca2740e647 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.144532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.146585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.146985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.147418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.148245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.153070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.174622 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:22.203699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2581/5206] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:21 2022] POST /identity/v3/users => generated 280 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:22.203699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.208132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.233935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2626/5207] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:22.236154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.239106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.273264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9643d-1a1d-4da9-bf20-562345122c9e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.287504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.288576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.288708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.289213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.290110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.292952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456813d-3d5a-4eee-bd4c-575c5e2bd5f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.322772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2627/5208] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:22.324939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.327330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.329065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.358821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d00db-b761-48b9-99c7-dd843d387879 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.366061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:22.367853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.369727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.371098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.371508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.372102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.376625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.388529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2628/5209] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:22.396901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.406074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.409465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.416187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f5ce-8122-4b66-afb6-235108a112f9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.429975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.430891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.431547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.431952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.432831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.434760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.435474 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2582/5210] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:22.436605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.459155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c17ad-b1d1-4f4c-a948-f6b71df811b8 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.469219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2629/5211] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:22.470963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.480751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.481968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.482372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.482756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.483703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:22.486137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.487922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.493820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b5efa-647f-4542-b8a3-b405d4e747eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.521176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.523871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.525307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.525745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] PATH_INFO: `/v3/projects/a7fb6ce52d504e9081d77bba9382cbac/users/44b41999aa2a4d2d865f7da19edbe49a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.547360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2583/5212] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:22.551409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.604118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1dafd-31b6-46bb-974f-9270e88001d1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.622775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fb6ce52d504e9081d77bba9382cbac, user_id=44b41999aa2a4d2d865f7da19edbe49a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.642939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5ade5-10c9-44f2-b274-0d23faf90299 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.643839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.658545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.659236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.660204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.666401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.676673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:22.702205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2630/5213] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:22 2022] PUT /identity/v3/projects/a7fb6ce52d504e9081d77bba9382cbac/users/44b41999aa2a4d2d865f7da19edbe49a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:22.727471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.733188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.737722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.808250 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2584/5214] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:22 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:22.812238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:22.829138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] MFA Rules not processed for user `44b41999aa2a4d2d865f7da19edbe49a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:22.830442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:22.857839 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:22.978417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4571b1-0e3d-4024-bab1-ba2384557218 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:22.989412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:22.990685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:22.991208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:22.991718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:22.993395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:22.996348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:23.025518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2585/5215] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:22 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:23.030163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:23.044522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f636d26-6f2f-483d-8873-a47e7c477767 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:23.056006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2631/5216] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:23.064767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:23.066539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:23.067145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:23.071803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:23.085061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:23.087986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:23.090653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:23.097065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:23.126714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2586/5217] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:23.130505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:23.146523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5822d-f8b2-4b7d-9505-87207a2eff41 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:23.158091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:23.159097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:23.159603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:23.160311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:23.161418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:23.164181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:23.183722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2587/5218] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:32:23.187689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:23.238720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685b4a9-1069-40ec-88d0-06a600ff37fd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:23.278325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:23.279250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:23.279529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:23.279800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] PATH_INFO: `/v3/projects/d2640cc8e64a4e7c83fff75ac3f9cc87/users/c4496c40fb604af29857fcf566f25e38/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:23.350324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2640cc8e64a4e7c83fff75ac3f9cc87, user_id=c4496c40fb604af29857fcf566f25e38, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:23.364521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72d35-5080-4497-a5fd-f46fde43890e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:23.406679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d4775-98d5-4540-8e66-171e934046db None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:23.444044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2588/5219] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:23 2022] PUT /identity/v3/projects/d2640cc8e64a4e7c83fff75ac3f9cc87/users/c4496c40fb604af29857fcf566f25e38/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:23.462511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:23.462832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:23.463124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:23.537096 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:23.584534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] MFA Rules not processed for user `c4496c40fb604af29857fcf566f25e38`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:23.586856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:23.595421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:23.596104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:23.596389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:23.596671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:23.644675 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:23.725965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:23.725965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:23.778514 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2632/5220] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:23.912451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.016913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351db63-ac7c-4aa9-ad49-080a5eb99bc4 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.023079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.025094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.026099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.027477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] PATH_INFO: `/v3/users/44b41999aa2a4d2d865f7da19edbe49a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.036628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b41999aa2a4d2d865f7da19edbe49a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.052093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.120766 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2589/5221] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 667 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:24.137551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.170913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92e493-949b-4657-a488-30d7d6ca8c30 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.186264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.188846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b41999aa2a4d2d865f7da19edbe49a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:24.188991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.189171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.189468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.190085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b41999aa2a4d2d865f7da19edbe49a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:24.190221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.199598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b41999aa2a4d2d865f7da19edbe49a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:24.200448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.217415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b41999aa2a4d2d865f7da19edbe49a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:24.244416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-37b6ea7e-8e09-40c8-8bb4-eb7016fdf566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b41999aa2a4d2d865f7da19edbe49a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:24.265318 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2633/5222] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:23 2022] DELETE /identity/v3/users/44b41999aa2a4d2d865f7da19edbe49a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:24.274089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2590/5223] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:24 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:24.275893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.276290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.278786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.279363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.282890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:24.341730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:24.343187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:24.460171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50746745-e21e-473b-9f00-035f93dc7bee admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.471842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.473752 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:24.474588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.475059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.475470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.477377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.482120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.500585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2634/5224] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:24.525638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.535064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2591/5225] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:24 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:24.537931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510241bf-4ca5-4986-b43d-f0fe60b7576a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.545139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.546130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.546526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.546914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.547775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.549660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.567684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.580383 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2635/5226] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:24.583730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f27e6f-5ed3-4b90-9670-a74e03c68d13 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.589023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.591177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.591874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.592085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] PATH_INFO: `/v3/projects/7b10f05e5c134348804122ef8c15020d/users/34f8625091be446ba05a3c35ff814892/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.611442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b10f05e5c134348804122ef8c15020d, user_id=34f8625091be446ba05a3c35ff814892, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.614624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.646670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.656296 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2592/5227] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:24 2022] PUT /identity/v3/projects/7b10f05e5c134348804122ef8c15020d/users/34f8625091be446ba05a3c35ff814892/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:24.669725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba0415-fbca-474d-96f2-9299a5c95feb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.671692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.674127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:24.848470 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:24.893641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db465b9-f847-43f5-8af0-0de45aecfaef admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.895133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.896559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.897852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.898590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.899948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.904284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.905210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.905985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.906509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.907201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.932330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.938753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2636/5228] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:24.940287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:24.944847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e25859-ab70-48ce-9d2c-07e4b40b6bb8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.953746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f496-b248-4ded-af79-363ca5be7fa9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:24.961549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:24.965383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:24.966038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:24.967172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] PATH_INFO: `/v3/projects/7b10f05e5c134348804122ef8c15020d/users/34f8625091be446ba05a3c35ff814892/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:24.974346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b10f05e5c134348804122ef8c15020d, user_id=34f8625091be446ba05a3c35ff814892, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:24.983967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:24.993888 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2593/5229] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:25.019439 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2637/5230] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:24 2022] PUT /identity/v3/projects/7b10f05e5c134348804122ef8c15020d/users/34f8625091be446ba05a3c35ff814892/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:25.021338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:25.021638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:25.021968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:25.084763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] MFA Rules not processed for user `34f8625091be446ba05a3c35ff814892`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:25.086040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:25.314374 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2594/5231] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:25.318486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:25.344106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e43305-e5ac-4794-bc07-a6b0ab4e82f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:25.349979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f8625091be446ba05a3c35ff814892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b10f05e5c134348804122ef8c15020d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:25.350654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:25.350941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:25.351223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:25.354136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:25.355787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:25.408773 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2638/5232] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:25 2022] POST /identity/v3/projects => generated 359 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:25.409346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:25.411111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:25.565213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42350f-a57e-4055-a9ea-2a9195c3fe6b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:25.680929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4496c40fb604af29857fcf566f25e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2640cc8e64a4e7c83fff75ac3f9cc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:25.681791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:25.682080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:25.682360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] PATH_INFO: `/v3/projects/e485324866e846adb4682659fb233dc0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:25.685553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] RBAC: Authorizing `identity:delete_project(project_id=e485324866e846adb4682659fb233dc0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 24 01:32:25.705647 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 24 01:32:25.706681 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:32:25.708065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2595/5233] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:25 2022] DELETE /identity/v3/projects/e485324866e846adb4682659fb233dc0 => generated 136 bytes in 299 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:32:25.712168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:25.972931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e2081-c2b1-4098-8241-f3842fa8875c tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:25.986395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34f8625091be446ba05a3c35ff814892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b10f05e5c134348804122ef8c15020d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:25.987331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:25.987624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:25.987905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] PATH_INFO: `/v3/projects/e485324866e846adb4682659fb233dc0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:25.998505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e485324866e846adb4682659fb233dc0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:26.000828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:26.224948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e485324866e846adb4682659fb233dc0', 'request_id': 'req-955e867c-e85e-47e7-8302-e125eee0dbc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.226718 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:26.243510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e485324866e846adb4682659fb233dc0', 'request_id': 'req-955e867c-e85e-47e7-8302-e125eee0dbc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.256937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e485324866e846adb4682659fb233dc0', 'request_id': 'req-955e867c-e85e-47e7-8302-e125eee0dbc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.283376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] The token cache is being invalidate because project e485324866e846adb4682659fb233dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:26.283832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.284720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-955e867c-e85e-47e7-8302-e125eee0dbc2 tempest-ProjectsNegativeTestJSON-585204492 tempest-ProjectsNegativeTestJSON-585204492-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.295392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2639/5234] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:25 2022] DELETE /identity/v3/projects/e485324866e846adb4682659fb233dc0 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:26.296778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:26.299583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:26.401212 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:26.484780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7402-23f6-4009-98f3-335ff367e4ab tempest-ProjectsNegativeTestJSON-16516501 tempest-ProjectsNegativeTestJSON-16516501-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:26.663839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:26.666522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:26.668141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:26.668611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] PATH_INFO: `/v3/users/c4496c40fb604af29857fcf566f25e38` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:26.675191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4496c40fb604af29857fcf566f25e38)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:26.682350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:26.832113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4496c40fb604af29857fcf566f25e38'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.853494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4496c40fb604af29857fcf566f25e38'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.881043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4496c40fb604af29857fcf566f25e38'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.918763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4496c40fb604af29857fcf566f25e38'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.920474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-928f2b80-6eb8-4376-95c7-039be6447bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4496c40fb604af29857fcf566f25e38'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:26.938004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2596/5235] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:26 2022] DELETE /identity/v3/users/c4496c40fb604af29857fcf566f25e38 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:26.943553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:26.944043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:26.944320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:26.945334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:26.945626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:26.945928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:26.978946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:26.986561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.046662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] MFA Rules not processed for user `81dad264129d487c88fb39d9356550b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:27.047901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.170906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2640/5236] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:27.180504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:27.184071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.224472 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:27.253836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bf75f-c995-485b-a03e-6df09f167b7d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:27.289794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:27.290895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.291994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.295504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] PATH_INFO: `/v3/projects/a7fb6ce52d504e9081d77bba9382cbac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.302719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fb6ce52d504e9081d77bba9382cbac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:27.303845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2597/5237] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:27.304849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:27.314259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.316219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:27.456775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fb6ce52d504e9081d77bba9382cbac', 'request_id': 'req-05e398f3-357e-4722-a4be-12e60d3040ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:27.471796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fb6ce52d504e9081d77bba9382cbac', 'request_id': 'req-05e398f3-357e-4722-a4be-12e60d3040ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:27.480466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec231344-2802-447b-a746-f8ec48fc94f3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:27.488127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fb6ce52d504e9081d77bba9382cbac', 'request_id': 'req-05e398f3-357e-4722-a4be-12e60d3040ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:27.511500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] The token cache is being invalidate because project a7fb6ce52d504e9081d77bba9382cbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:27.511713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:27.518295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:27.528612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2641/5238] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:27 2022] DELETE /identity/v3/projects/a7fb6ce52d504e9081d77bba9382cbac => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:27.536831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:27.539794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.616900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:27.617574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.617878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.618195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.621293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.683311 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:27.731039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:27.733042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e398f3-357e-4722-a4be-12e60d3040ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:27.736258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b58a-b0c5-429d-8201-e58605c07a97 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:27.746519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:27.748527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.749183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.752249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.755019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.759120 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2598/5239] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:27.763042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb885-6902-4fe4-8823-5c274ceb8413 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.763874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb885-6902-4fe4-8823-5c274ceb8413 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.765898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb885-6902-4fe4-8823-5c274ceb8413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.806603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-334cb885-6902-4fe4-8823-5c274ceb8413 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:27.808570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-334cb885-6902-4fe4-8823-5c274ceb8413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.829322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2599/5240] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:27.841884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.842456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.843205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.887219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:27.888924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:27.895172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:27.899286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:27.908492 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2600/5241] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:27.916473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:27.959689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2642/5242] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:27.960554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b919-1fdf-477e-b8bd-8f0d5441064c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:27.966453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:27.967366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:27.967826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:27.968283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:27.969207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:27.969742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:27.971719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:27.992605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:27.993198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2601/5243] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:28.014405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d013e1e-0bfb-477c-a449-43d8d6c837c1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.029220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:28.030513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.030962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.031791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.033400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:28.038039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:28.114054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:28.115883 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2643/5244] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:27 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:28.127904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47154815-46e7-48fc-ae7b-b1855a0dec0d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.204788 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:28.315774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:28.316474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.316779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.317037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.317962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:28.322628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd222-e5ab-470c-a9f3-b0903df6f55d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:28.379103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:28.385406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2602/5245] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:28 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:28.391815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.392119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.392577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.397643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9494b7-4195-4ad8-a018-1cf8024a1db7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.425523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:28.426678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.426678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.426878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.427492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:28.429108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:28.451793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:28.456078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:28.485093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2644/5246] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:28.489891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:28.517019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb4be-796e-407c-acb8-0debf7213985 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.541750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:28.549889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.550407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.550927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.551822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:28.553735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:28.596250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2645/5247] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:32:28.600918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:28.660714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34dd8-caad-4434-91de-674ac2113bd8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.674247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:28.677076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.678204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.679395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] PATH_INFO: `/v3/projects/0d638e520c9c4152afb6125e91dcb399/users/e0b873c4cd7b4558ab357acff39f0253/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.689186 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2603/5248] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:28.690818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:28.695595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:28.723116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d638e520c9c4152afb6125e91dcb399, user_id=e0b873c4cd7b4558ab357acff39f0253, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:28.726903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7567-9950-4cb7-9184-adeba5f09a93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:28.754289 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2646/5249] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:28 2022] PUT /identity/v3/projects/0d638e520c9c4152afb6125e91dcb399/users/e0b873c4cd7b4558ab357acff39f0253/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:28.755872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:28.756344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:28.756790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:28.791160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:28.792888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:28.935867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc64e2-635e-4acb-8929-80835715de28 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:28.960339 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2647/5250] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:28.999975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:29.001663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:29.062918 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:29.084234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:29.106686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9613a0-c221-4c02-a8d2-fc6dfac33004 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:29.121348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:29.121348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:29.121701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:29.121940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:29.127455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:29.128249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:29.130601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:29.130921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:29.146196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:29.150241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:29.193342 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2648/5251] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:29.267762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:29.270034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:29.291745 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2604/5252] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:29.393827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:29.395430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:29.421896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ee85-2547-45e0-926b-73681abdca4b service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:29.441994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:29.442895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:29.443242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:29.443453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] PATH_INFO: `/v3/projects/d2640cc8e64a4e7c83fff75ac3f9cc87` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:29.452371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2640cc8e64a4e7c83fff75ac3f9cc87)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:29.461304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:29.704768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2640cc8e64a4e7c83fff75ac3f9cc87', 'request_id': 'req-a824235b-d265-4795-a93f-6fae13881a19'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:29.732273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2640cc8e64a4e7c83fff75ac3f9cc87', 'request_id': 'req-a824235b-d265-4795-a93f-6fae13881a19'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:29.755017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2640cc8e64a4e7c83fff75ac3f9cc87', 'request_id': 'req-a824235b-d265-4795-a93f-6fae13881a19'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:29.783952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] The token cache is being invalidate because project d2640cc8e64a4e7c83fff75ac3f9cc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:29.787946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:29.788854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:29.796417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:29.797020 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2649/5253] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:29 2022] DELETE /identity/v3/projects/d2640cc8e64a4e7c83fff75ac3f9cc87 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:29.813641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c4fb-eb24-416d-9d72-cb46cff16bec service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:29.947703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:29.948928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:29.949550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:29.949910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] PATH_INFO: `/v3/users/34f8625091be446ba05a3c35ff814892` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:29.953915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f8625091be446ba05a3c35ff814892)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:29.962017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:30.103120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f8625091be446ba05a3c35ff814892'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:30.116793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f8625091be446ba05a3c35ff814892'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:30.136148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f8625091be446ba05a3c35ff814892'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:30.182514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f8625091be446ba05a3c35ff814892'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:30.185570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-28513097-0fc4-48d4-9f7d-073e2f6a5618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f8625091be446ba05a3c35ff814892'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:30.205359 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2605/5254] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:29 2022] DELETE /identity/v3/users/34f8625091be446ba05a3c35ff814892 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:31.981201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:31.985453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:32.015438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824235b-d265-4795-a93f-6fae13881a19 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:32.187937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:32.188846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:32.189285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:32.189972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] PATH_INFO: `/v3/projects/7b10f05e5c134348804122ef8c15020d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:32.191457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b10f05e5c134348804122ef8c15020d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:32.193890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:32.338051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b10f05e5c134348804122ef8c15020d', 'request_id': 'req-36d0ebef-5881-4b3a-8fdb-456898950842'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:32.359322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b10f05e5c134348804122ef8c15020d', 'request_id': 'req-36d0ebef-5881-4b3a-8fdb-456898950842'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:32.361700 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:32.379672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b10f05e5c134348804122ef8c15020d', 'request_id': 'req-36d0ebef-5881-4b3a-8fdb-456898950842'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:32.404504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] The token cache is being invalidate because project 7b10f05e5c134348804122ef8c15020d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:32.404788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:32.406417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-36d0ebef-5881-4b3a-8fdb-456898950842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:32.412125 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2650/5255] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:31 2022] DELETE /identity/v3/projects/7b10f05e5c134348804122ef8c15020d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:32.416228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:32.416750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:32.416898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:32.425839 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:32.447233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:32.450410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:32.608726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2606/5256] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:32.616652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:32.616920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:32.617210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:32.670475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:32.671753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:32.705865 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2651/5257] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:32.710116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:32.724219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd62b7c-9615-4a46-8141-68d00312918b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:32.742469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:32.750546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:32.751075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:32.751506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:32.752420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:32.752919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:32.754845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:32.780043 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2607/5258] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:32.780554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:32.801769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e76d8-ee39-413a-9a23-478135a8a30a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:32.819013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:32.819347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:32.819639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:32.819919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:32.820647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:32.823402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:32.904846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:32.915735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2652/5259] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:32 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:32.922696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba27c3-f242-49a3-afd1-a6628805f187 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:33.071338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:33.071959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.072249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.072530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.073823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:33.078334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:33.122890 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2608/5260] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:32 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:33.127976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:33.149929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb504d1-b79e-4770-9945-b41c91c3312b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:33.165536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:33.166954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.168222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.168624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.170576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:33.175665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:33.218411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2653/5261] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:33.221853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:33.240323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf422-2119-406b-810d-45db1006f867 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:33.251592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:33.252662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.253211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.253804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.258147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:33.265502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0211-f230-4d02-9eae-914026a2866d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:33.290852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:33.291159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2609/5262] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:33.309895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42621b3a-cdfe-42cd-a7ae-f3d2de86b27d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:33.324110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:33.325691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.326440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.327439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] PATH_INFO: `/v3/projects/f12015d6be744c688584035e63f36fca/users/b8342c4a8ca04d1eac58d3a11b4b5c55/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.360859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12015d6be744c688584035e63f36fca, user_id=b8342c4a8ca04d1eac58d3a11b4b5c55, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:33.372778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:33.405296 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2654/5263] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:33 2022] PUT /identity/v3/projects/f12015d6be744c688584035e63f36fca/users/b8342c4a8ca04d1eac58d3a11b4b5c55/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:33.418824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.419289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.419752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.489426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] MFA Rules not processed for user `b8342c4a8ca04d1eac58d3a11b4b5c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:33.491649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:33.727872 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:33.756082 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2610/5264] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:33.776883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:33.981165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3286-d338-4a3a-bca6-a3c892e523a4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:33.991692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:33.993441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:33.994008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:33.994507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:33.995515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:33.998571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.039172 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2655/5265] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:33 2022] POST /identity/v3/projects => generated 367 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:34.043537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.061243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8777866-4010-4366-997c-4aae2f7af560 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.187141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.187891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.188182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.188597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.189298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.191456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.220327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2611/5266] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:34 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:34.220919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.242601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff24258-e128-40e1-9ddd-348c051f8dd1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.248754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.249438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.249752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.250112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.250774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.252412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.285137 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2656/5267] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:32:34.285398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.300727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26eb5d-4611-4d8c-a403-60c1b3a8d133 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.309464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.312021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.312382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.312803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] PATH_INFO: `/v3/projects/be0bd84c1f2642078a5267ff294f73f8/users/71dbd0a6611147dca2e5e01feec5b8cb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.338399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0bd84c1f2642078a5267ff294f73f8, user_id=71dbd0a6611147dca2e5e01feec5b8cb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.341593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.388240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.388735 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2612/5268] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:34 2022] PUT /identity/v3/projects/be0bd84c1f2642078a5267ff294f73f8/users/71dbd0a6611147dca2e5e01feec5b8cb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:34.405357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7933b6-dd35-4a62-9deb-6863878fd9fb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.489535 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:34.506893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.507626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.507960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.508288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.509172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.511356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c02f-d470-4735-9958-c7d8c8ec2ec1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.528533 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2657/5269] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:34.533012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.558463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe62f-1d27-48db-ad2c-009030207ea3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.566481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.567402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.567683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.568018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] PATH_INFO: `/v3/projects/be0bd84c1f2642078a5267ff294f73f8/users/71dbd0a6611147dca2e5e01feec5b8cb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.574581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0bd84c1f2642078a5267ff294f73f8, user_id=71dbd0a6611147dca2e5e01feec5b8cb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.578275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.598872 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2613/5270] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:34 2022] PUT /identity/v3/projects/be0bd84c1f2642078a5267ff294f73f8/users/71dbd0a6611147dca2e5e01feec5b8cb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:34.611529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.611827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.612117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.655522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] MFA Rules not processed for user `71dbd0a6611147dca2e5e01feec5b8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:34.657295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:34.936046 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2658/5271] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:34.941607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.960701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794342b-0f03-4373-88c3-7f423f76fd37 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:34.974050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:34.974878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:34.975573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:34.976075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:34.978189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:34.981810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:34.983683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:34.984029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:35.014274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2614/5272] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:32:34 2022] POST /identity/v3/services => generated 239 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:35.015588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.060934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256513-5b37-495f-bdd1-15a87ac46e88 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.071402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.072570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.073573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.074142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/1a510180735843c4ba9b6ac197b47d8c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.074973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1a510180735843c4ba9b6ac197b47d8c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.078890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.133662 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2615/5273] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:35 2022] DELETE /identity/v3/services/1a510180735843c4ba9b6ac197b47d8c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:35.140553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.147354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227530e-b337-44ae-855b-7a8deff9d41a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.184524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.185472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.185780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.188360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] PATH_INFO: `/v3/users/472ff2bf65fb473ba60274de014b08a9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.190526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472ff2bf65fb473ba60274de014b08a9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.204245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb020-6705-4813-ac32-e9bc7503b4b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.207229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.216119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.217188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.217699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.218189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.219190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.227189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09ec94-700d-4342-b195-4a97bca67d8c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.312287 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2616/5274] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:35 2022] POST /identity/v3/services => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:35.319138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.319535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.319915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.352224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472ff2bf65fb473ba60274de014b08a9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:35.352915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472ff2bf65fb473ba60274de014b08a9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:35.378684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] MFA Rules not processed for user `81dad264129d487c88fb39d9356550b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:35.380294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:35.392152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472ff2bf65fb473ba60274de014b08a9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:35.407681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472ff2bf65fb473ba60274de014b08a9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:35.422987 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:35.438084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472ff2bf65fb473ba60274de014b08a9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:35.447650 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2659/5275] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:34 2022] DELETE /identity/v3/users/472ff2bf65fb473ba60274de014b08a9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:35.448580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.450700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:35.466698 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:35.502381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2617/5276] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3377 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:35.650031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2963d7-b588-4357-b632-a7678ae61280 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.668622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.669646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.670720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.671375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/751d9c42e23c49b6b0236e1cb1f9362a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.671762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:update_service(service_id=751d9c42e23c49b6b0236e1cb1f9362a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.672801 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:35.672801 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:32:35.672801 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:35.673723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.711102 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2660/5277] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:32:35 2022] PATCH /identity/v3/services/751d9c42e23c49b6b0236e1cb1f9362a => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:35.715562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.739293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2529b-0c0a-443d-8a2e-af692000cff7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.832124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.832124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.832124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/751d9c42e23c49b6b0236e1cb1f9362a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:get_service(service_id=751d9c42e23c49b6b0236e1cb1f9362a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:35.903375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.905389 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2618/5278] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:32:35 2022] GET /identity/v3/services/751d9c42e23c49b6b0236e1cb1f9362a => generated 283 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:35.905602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.905602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521d305-a744-4575-a4d9-fe2a8494170f tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.905602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.908982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.908982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.908982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/751d9c42e23c49b6b0236e1cb1f9362a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.908982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:delete_service(service_id=751d9c42e23c49b6b0236e1cb1f9362a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.908982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:35.922585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2661/5279] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:35 2022] DELETE /identity/v3/services/751d9c42e23c49b6b0236e1cb1f9362a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:35.923508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:35.956582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff400-444b-4df2-a78c-35592363f07b tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:35.991280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:35.993386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:35.993825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:35.994215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/751d9c42e23c49b6b0236e1cb1f9362a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:35.995894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:get_service(service_id=751d9c42e23c49b6b0236e1cb1f9362a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:35.997987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Could not find service: 751d9c42e23c49b6b0236e1cb1f9362a.: keystone.exception.ServiceNotFound: Could not find service: 751d9c42e23c49b6b0236e1cb1f9362a. Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 751d9c42e23c49b6b0236e1cb1f9362a. Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:32:36.019270 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:32:36.020611 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 751d9c42e23c49b6b0236e1cb1f9362a. Jul 24 01:32:36.021814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:32:36.025966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.033184 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2619/5280] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:32:35 2022] GET /identity/v3/services/751d9c42e23c49b6b0236e1cb1f9362a => generated 113 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:32:36.041316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39792735-7c87-4070-8f91-ce07aa810dfb tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.050749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.051494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.051777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.052053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.053556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.055436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.078263 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2662/5281] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:36 2022] POST /identity/v3/services => generated 275 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:36.081918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.094307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9269ac-0bca-4154-bf48-52fe0857693a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.157392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.162886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.163393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.163865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.164779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.167898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.198001 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2620/5282] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:36 2022] POST /identity/v3/services => generated 274 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:36.202780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.222867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c987bd-d8a6-417d-ad28-681bd0ee32b1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.297264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.301619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.302090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.302547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.303440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.305208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.344864 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2663/5283] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:36 2022] POST /identity/v3/services => generated 275 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:36.348660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.369907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad09293-1973-4411-bf04-d7fffba55f41 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.442546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.443247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.443540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.443822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.444552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.446026 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:36.446026 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:32:36.446026 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:32:36.446512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.460405 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2621/5284] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:32:36 2022] GET /identity/v3/services => generated 2979 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:36.467116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.478442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.485322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:36.488174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e7cb-3eee-4419-ab22-504466730df1 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.501748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.502707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.504137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.504432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.505413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1917266627) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:36.507749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.508822 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:32:36.508822 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:32:36.508822 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:32:36.510046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.529297 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2664/5285] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Jul 24 01:32:36 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1917266627 => generated 418 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:32:36.530575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.550917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5123e0-0bfd-4992-80dd-6ea453ec94c6 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.564489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.565539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.565935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.567110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.568085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-305210364) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:36.569956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.573188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.590694 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2665/5286] 10.222.0.27 () {58 vars in 1219 bytes} [Sun Jul 24 01:32:36 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-305210364 => generated 416 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:32:36.593293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.616833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c9747-d4e9-4e21-a451-d062f04fa593 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.641963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.642674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.643061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.643605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.644377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1952171793) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:36.645246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.648537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.664582 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2666/5287] 10.222.0.27 () {58 vars in 1221 bytes} [Sun Jul 24 01:32:36 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1952171793 => generated 418 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:36.670395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.690877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40af1-8be4-47cf-a248-2ad36de7da0c tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.693825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5812-a196-4dc2-8cf2-2eda3819224a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.702357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.703343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.704789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:36.705150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.705502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] PATH_INFO: `/v3/projects/b8eb99dbda38447a8ff7721744633469` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.708127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.708127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.709047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eb99dbda38447a8ff7721744633469)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.709176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/a57ad838f67d4c0393c6b89fc513d7a4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:36.711155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a57ad838f67d4c0393c6b89fc513d7a4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:36.715673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.716995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:36.768755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2667/5288] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:36 2022] DELETE /identity/v3/services/a57ad838f67d4c0393c6b89fc513d7a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:36.772999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:36.852039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a686ed-a6fa-4a36-b00c-a13ab65c8b22 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:36.867973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eb99dbda38447a8ff7721744633469', 'request_id': 'req-169eb605-e844-4cfb-81b4-80c2846ce344'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:36.882038 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:36.888065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eb99dbda38447a8ff7721744633469', 'request_id': 'req-169eb605-e844-4cfb-81b4-80c2846ce344'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:36.893440 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:36.926477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eb99dbda38447a8ff7721744633469', 'request_id': 'req-169eb605-e844-4cfb-81b4-80c2846ce344'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:36.951056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] The token cache is being invalidate because project b8eb99dbda38447a8ff7721744633469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:36.951442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:36.953136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-169eb605-e844-4cfb-81b4-80c2846ce344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:36.955599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2622/5289] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:36 2022] DELETE /identity/v3/projects/b8eb99dbda38447a8ff7721744633469 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:36.969892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186c70-a633-4e4d-9303-4baa6769b3d4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:36.971909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186c70-a633-4e4d-9303-4baa6769b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:36.973290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186c70-a633-4e4d-9303-4baa6769b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.025048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e186c70-a633-4e4d-9303-4baa6769b3d4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:37.027778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e186c70-a633-4e4d-9303-4baa6769b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.067953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.071931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.072273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.072562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/a5b39aea322c4bb183d72539f593e0ac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.076550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a5b39aea322c4bb183d72539f593e0ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.102866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.166843 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2668/5290] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:36 2022] DELETE /identity/v3/services/a5b39aea322c4bb183d72539f593e0ac => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:37.173512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.182001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.230137 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2623/5291] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:37.233106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00c9ba-09be-42b5-8015-04acadab823a tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:37.236724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.237901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.238974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.251668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dbd0a6611147dca2e5e01feec5b8cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0bd84c1f2642078a5267ff294f73f8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.252616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.256120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.257148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] PATH_INFO: `/v3/services/120d1a1595cd46f3be9b22630aa86647` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.258445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorizing `identity:delete_service(service_id=120d1a1595cd46f3be9b22630aa86647)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.262109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.303628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:37.304862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.336301 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2624/5292] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:37.343163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.344552 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2669/5293] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:37 2022] DELETE /identity/v3/services/120d1a1595cd46f3be9b22630aa86647 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:37.345494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.355555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.404066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f747b-d19a-4e33-bb15-e0036d45739e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:37.416643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00eced-0e00-45be-a82b-c9a288e134b8 tempest-ServicesTestJSON-656318885 tempest-ServicesTestJSON-656318885-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:37.436573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.439012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.439305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.439463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.439592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] PATH_INFO: `/v3/users/b8342c4a8ca04d1eac58d3a11b4b5c55` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.441970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.442933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.443447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.445532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8342c4a8ca04d1eac58d3a11b4b5c55)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.447123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:37.447584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.448732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.478134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.567491 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2625/5294] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:37.569470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.570262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8342c4a8ca04d1eac58d3a11b4b5c55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:37.574200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8342c4a8ca04d1eac58d3a11b4b5c55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:37.577212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.586880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8342c4a8ca04d1eac58d3a11b4b5c55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:37.605493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8342c4a8ca04d1eac58d3a11b4b5c55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:37.611534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381dfb9-298c-4001-a0cf-d0dfeb37ddb3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:37.625063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1cdeaf1c-637a-4d6e-96c1-e1deb161ab80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8342c4a8ca04d1eac58d3a11b4b5c55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:37.625529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.626580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.626580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.626829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.627487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.633005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.634078 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2670/5295] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:37 2022] DELETE /identity/v3/users/b8342c4a8ca04d1eac58d3a11b4b5c55 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:37.640269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.640782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.641323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.691087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:37.692632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.716278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2626/5296] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:37 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:37.721058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.733046 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:37.828033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44ceca-bb8c-4b3f-a4f2-4175b4ad22b2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:37.842013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:37.842712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:37.843000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:37.843279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:37.843986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:37.849084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2671/5297] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:37.849289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:37.859762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.861505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:37.920166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2627/5298] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:37 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:37.921594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:37.946416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ad23-2a37-4719-a0e3-70e4920a7d8a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:38.052564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:38.053869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.059145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.059719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:38.060712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:38.064978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:38.119562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cac43-f84e-4aca-a2b5-dc336ae32922 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:38.157105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2628/5299] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:38.158767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:38.174478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437c3f-05c8-4207-a954-72d0ee829873 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:38.189216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:38.189699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.189995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.190331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:38.192402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:38.197043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:38.225089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2629/5300] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:38.226711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:38.254777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:38.290743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8563a-211d-4b7f-855d-d6d363e03117 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:38.303086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:38.303925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.304277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.304645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:38.312230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:38.313381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.313662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.313958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] PATH_INFO: `/v3/projects/36a8a8aec8f94f20930d073277b5c516/users/a175648d864b49f3bae2d022c1b303dc/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:38.318386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:38.320178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cd27f-e9b8-48fb-b64e-e54ac2a54b2c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:38.338465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2672/5301] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:38.353327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a8a8aec8f94f20930d073277b5c516, user_id=a175648d864b49f3bae2d022c1b303dc, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:38.357294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:38.418494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2630/5302] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:38 2022] PUT /identity/v3/projects/36a8a8aec8f94f20930d073277b5c516/users/a175648d864b49f3bae2d022c1b303dc/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:38.430593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.430906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.431248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:38.484548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] MFA Rules not processed for user `a175648d864b49f3bae2d022c1b303dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:38.491498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:38.683957 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2673/5303] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:38.693033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:38.695991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:38.948106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cc2c-35f6-4d4e-8e1b-6d132a9e3459 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:38.960671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:38.962753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:38.963105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:38.963554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:39.006565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:39.011303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:39.018628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:39.020504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:39.033007 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2631/5304] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:39.055536 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:39.336431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bffce5-a19f-4000-a575-4af4396ff633 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:39.345333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:39.347702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:39.348297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:39.348806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] PATH_INFO: `/v3/projects/f12015d6be744c688584035e63f36fca` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:39.350561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12015d6be744c688584035e63f36fca)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:39.359311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:39.521613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12015d6be744c688584035e63f36fca', 'request_id': 'req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:39.542973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12015d6be744c688584035e63f36fca', 'request_id': 'req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:39.574813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12015d6be744c688584035e63f36fca', 'request_id': 'req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:39.600133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] The token cache is being invalidate because project f12015d6be744c688584035e63f36fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:39.600701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:39.601780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-98e9a49c-012c-4c7b-b08d-c2f078fc2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:39.613389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2674/5305] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:39 2022] DELETE /identity/v3/projects/f12015d6be744c688584035e63f36fca => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:39.616770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:39.641331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac25b5-9b9b-410b-acba-b2a08ddc939d service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:39.834209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:39.836242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:39.836737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:39.837245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] PATH_INFO: `/v3/users/71dbd0a6611147dca2e5e01feec5b8cb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:39.839316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71dbd0a6611147dca2e5e01feec5b8cb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:39.842234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:40.008596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71dbd0a6611147dca2e5e01feec5b8cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:40.039251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71dbd0a6611147dca2e5e01feec5b8cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:40.048770 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:40.101438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71dbd0a6611147dca2e5e01feec5b8cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:40.208011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71dbd0a6611147dca2e5e01feec5b8cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:40.224106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71dbd0a6611147dca2e5e01feec5b8cb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:40.249125 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2632/5306] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:39 2022] DELETE /identity/v3/users/71dbd0a6611147dca2e5e01feec5b8cb => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:40.614927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:40.615690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:40.616001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:40.712748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:40.727241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:40.922836 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2675/5307] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:40.953424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:40.955086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:41.181994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97164f-e8ba-4ad4-968a-3cdeb0b30514 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:41.196737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:41.197414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:41.198951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:41.199232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:41.235693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:41.238558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7067c2-51b6-44d6-919e-b60855b3bf5a service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:41.271790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2633/5308] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:32:42.502793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:42.504306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:42.657464 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:42.763417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61750a1-5735-4de3-8dba-9ac10cb02129 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:42.778438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:42.780191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:42.780712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:42.781188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] PATH_INFO: `/v3/projects/be0bd84c1f2642078a5267ff294f73f8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:42.784603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0bd84c1f2642078a5267ff294f73f8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:42.789599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:42.929195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0bd84c1f2642078a5267ff294f73f8', 'request_id': 'req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:42.939241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0bd84c1f2642078a5267ff294f73f8', 'request_id': 'req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:42.955685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0bd84c1f2642078a5267ff294f73f8', 'request_id': 'req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:42.978009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] The token cache is being invalidate because project be0bd84c1f2642078a5267ff294f73f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:42.982649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:42.983962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-87ae213a-ea9d-4a0b-8ea9-9ef3375a7d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:42.995931 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2676/5309] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:42 2022] DELETE /identity/v3/projects/be0bd84c1f2642078a5267ff294f73f8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:43.001827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:43.002342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:43.002435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:43.074048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:43.075485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:43.317034 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2634/5310] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:43.325400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:43.325709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:43.326008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:43.357196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:43.359297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:43.383887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2677/5311] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:43.389152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:43.414161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3011-74f9-416d-b27e-6106a083f969 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:43.428807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:43.429859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:43.430010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:43.430398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:43.435563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:43.435929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:43.437819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:43.481798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:43.487933 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2635/5312] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:43.493281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3c7b-cc42-4607-8034-fe2721929464 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:43.502137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:43.514345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:43.514889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:43.514973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:43.515753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:43.534973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:43.687614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:43.695432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2678/5313] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:43 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:43.701171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3ae5-f37d-43be-889c-755b3ba4cdc1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:43.904043 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:43.938828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:43.939613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:43.939906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:43.940196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:43.941568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:43.953840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:44.048382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2636/5314] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:43 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:44.049101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:44.088682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419605a5-d3b6-4334-a898-c9e8c9aebd9c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:44.096004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:44.096823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:44.107930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:44.108833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:44.119056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:44.122150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:44.190232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:44.191538 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2679/5315] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:32:44.207204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e7ff-fa38-46cd-b254-b09ea5e280ca admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:44.248674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:44.251892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:44.252355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:44.256104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:44.256909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:44.258659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81135d58-0ade-4944-be25-bbdc9901970b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:44.336009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2637/5316] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:44.337264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:44.360725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7825b4-fef9-4f7f-b080-d1ac969b946f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:44.370195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:44.372553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:44.374141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:44.375135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] PATH_INFO: `/v3/projects/f752c75b17804cf6a3f50ae24f9595ba/users/22905793be774fe09c90351588bce147/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:44.440320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f752c75b17804cf6a3f50ae24f9595ba, user_id=22905793be774fe09c90351588bce147, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:44.444229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:44.478741 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2680/5317] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:44 2022] PUT /identity/v3/projects/f752c75b17804cf6a3f50ae24f9595ba/users/22905793be774fe09c90351588bce147/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:44.547969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:44.547969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:44.547969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:44.627712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] MFA Rules not processed for user `22905793be774fe09c90351588bce147`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:44.635750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:44.847482 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2638/5318] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:44.848668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.088000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c306-1597-459a-8e9a-a5b30e75a9f1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.099856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.100875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.101386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.102757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.108518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.110968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.131835 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:45.194171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2681/5319] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:44 2022] POST /identity/v3/projects => generated 379 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:45.199519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.219591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b23126-cb1e-43b0-8562-f7101c760372 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.399570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.400266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.400548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.401384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.413391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.415589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.505644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.506022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2639/5320] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:45 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:45.521754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.524016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:45.528117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6feb8-6288-408f-9386-2f10da6d426f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.541193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.542895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.543363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.544401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.545311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.546925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.553713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03f3c-bd70-4d9e-9071-8395f7aa5612 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.579938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.599960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.601569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.604580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] PATH_INFO: `/v3/users/bab383497d8e44d0af5d98d83cabf9bc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.615210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab383497d8e44d0af5d98d83cabf9bc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.615844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2682/5321] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:32:45.616947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.620724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.660590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412b7c-0916-4fd7-b88e-2173ce3a34a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.669290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.670007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.670287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.670565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.671307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.672969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.700264 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2683/5322] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:45.702083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:45.735966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48bf81-5842-4d92-a2aa-bcfe95120cfb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:45.743794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:45.745716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.746195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.746627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] PATH_INFO: `/v3/projects/e5546f3c35f74f00ae5bde992cfc03bd/users/7b1ea99e51f6466c80bba882ffe00d48/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.758955 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:45.793037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab383497d8e44d0af5d98d83cabf9bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:45.808878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5546f3c35f74f00ae5bde992cfc03bd, user_id=7b1ea99e51f6466c80bba882ffe00d48, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:45.815113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab383497d8e44d0af5d98d83cabf9bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:45.819674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6371d3-c88c-49fc-8d57-3f45e21b15fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:45.826365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab383497d8e44d0af5d98d83cabf9bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:45.860519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2684/5323] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:45 2022] PUT /identity/v3/projects/e5546f3c35f74f00ae5bde992cfc03bd/users/7b1ea99e51f6466c80bba882ffe00d48/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:45.872708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f716-341f-43f2-b554-e400caccefea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.873249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f716-341f-43f2-b554-e400caccefea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.873724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f716-341f-43f2-b554-e400caccefea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.877879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab383497d8e44d0af5d98d83cabf9bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:45.879130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-127ba584-8304-440a-a13a-13af8f8ebf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab383497d8e44d0af5d98d83cabf9bc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:45.893222 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2640/5324] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:45 2022] DELETE /identity/v3/users/bab383497d8e44d0af5d98d83cabf9bc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:45.895237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:45.895237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:45.895710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:45.918277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:45.919498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:45.964293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10e8f716-341f-43f2-b554-e400caccefea None None] MFA Rules not processed for user `7b1ea99e51f6466c80bba882ffe00d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:45.966052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10e8f716-341f-43f2-b554-e400caccefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.028381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2641/5325] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:46.101834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:46.103961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.127586 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2685/5326] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:46.132009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8f716-341f-43f2-b554-e400caccefea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:46.134819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10e8f716-341f-43f2-b554-e400caccefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.259966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8f716-341f-43f2-b554-e400caccefea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:46.267019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22905793be774fe09c90351588bce147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f752c75b17804cf6a3f50ae24f9595ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:46.268859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:46.269393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:46.270152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] PATH_INFO: `/v3/users/22905793be774fe09c90351588bce147/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:46.273010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] RBAC: Authorizing `identity:list_user_projects(user_id=22905793be774fe09c90351588bce147)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:46.275502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfbfbc-556c-42fc-b305-ee81342d268a tempest-IdentityV3ProjectsTest-960491753 tempest-IdentityV3ProjectsTest-960491753-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:46.329447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a62d-301d-4b31-a51d-25703d12f221 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:46.339717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:46.340397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:46.345405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:46.345405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:46.387627 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:46.389510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:46.397208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8cabb-af0b-4b48-a089-3cc63370ca8b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:46.424085 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2686/5327] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:32:46 2022] GET /identity/v3/users/22905793be774fe09c90351588bce147/projects => generated 515 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:46.426613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:46.426906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:46.429580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:46.436023 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2642/5328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:46.517647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] MFA Rules not processed for user `22905793be774fe09c90351588bce147`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:46.518980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.544509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2687/5329] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:46.546246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:46.546539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:46.546821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:46.583040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] MFA Rules not processed for user `22905793be774fe09c90351588bce147`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:46.591676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.731119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.models.token_model [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] User 22905793be774fe09c90351588bce147 has no access to project e5546f3c35f74f00ae5bde992cfc03bd {{(pid=80591) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 24 01:32:46.741269 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.server.flask.application [None req-d028b0bc-5172-4583-a1d3-07d9d4ed49e0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:32:46.752786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2643/5330] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 207 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 24 01:32:46.754683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:46.756247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:46.801096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b864f-3901-4ecc-9229-2988bba5f790 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:46.829499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:46.830758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:46.831044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:46.831317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] PATH_INFO: `/v3/users/22905793be774fe09c90351588bce147` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:46.835979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22905793be774fe09c90351588bce147)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:46.837983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:46.982212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22905793be774fe09c90351588bce147'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:46.983125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22905793be774fe09c90351588bce147'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.015220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22905793be774fe09c90351588bce147'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.050090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22905793be774fe09c90351588bce147'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.108255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22905793be774fe09c90351588bce147'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.133987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2688/5331] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:46 2022] DELETE /identity/v3/users/22905793be774fe09c90351588bce147 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:47.138905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:47.139398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:47.139832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:47.173925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:47.190873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:47.205559 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:47.453946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2644/5332] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:47.524510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:47.526971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:47.708938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d202-5765-49d9-ae21-00ca21ca5d4b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:47.714935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:47.715722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:47.716110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:47.716456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:47.732631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:47.734378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:47.758416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c744b36-979b-421e-b912-dc82fa7210be None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:47.771217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:47.772683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:47.773139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:47.773604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] PATH_INFO: `/v3/projects/00fbfce392d0436a9465be47ee3e4f8d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:47.777198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fbfce392d0436a9465be47ee3e4f8d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:47.782357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:47.793410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:47.806483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1b04e-1920-46e6-b4a6-c48707acfc6b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:47.858495 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2689/5333] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:47.895730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fbfce392d0436a9465be47ee3e4f8d', 'request_id': 'req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.920676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fbfce392d0436a9465be47ee3e4f8d', 'request_id': 'req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.960609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fbfce392d0436a9465be47ee3e4f8d', 'request_id': 'req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.981122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] The token cache is being invalidate because project 00fbfce392d0436a9465be47ee3e4f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:47.981700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.982416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e137abb7-b9a8-4a23-8815-cfbdcf6f7839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:47.987163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2645/5334] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:47 2022] DELETE /identity/v3/projects/00fbfce392d0436a9465be47ee3e4f8d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:47.990806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:47.991776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:47.994128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.057452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:48.059553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:48.215998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:48.247365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2690/5335] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:48.254816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.255131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.255436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.301225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:48.302505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:48.336785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2646/5336] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:48.345971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:48.378881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178947-4dba-445a-8398-4ab9c398c03a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:48.388310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:48.389002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.389886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.389886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.390390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:48.391346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:48.393129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:48.422878 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2691/5337] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:48.423608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:48.442115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3f36-98ea-4898-b349-9299c9f602f1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:48.454221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:48.454908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.455398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.455843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.461127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:48.472740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9bf8-0d54-45a4-9fab-14fb4127fa6c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:48.544457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2647/5338] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:48 2022] POST /identity/v3/projects => generated 353 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:48.548341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:48.568298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1cb90-a5df-449d-84a4-da325a77cf9e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:48.810119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.810517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.810686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.840000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:48.840703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.840976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.841259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.842004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:48.859410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:48.897449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] MFA Rules not processed for user `e0b873c4cd7b4558ab357acff39f0253`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:48.898712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:48.932952 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2692/5339] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:48 2022] POST /identity/v3/users => generated 277 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:48.938603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:48.963938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1edcbe-6254-451a-8ec3-3be8e2abdc9a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:48.976308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:48.977006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:48.977296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:48.977577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:48.978539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:48.980484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:49.019679 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2693/5340] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:49.023368 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:49.024122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:49.055863 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2648/5341] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:49.058131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2ec9-10af-4434-9c17-14aa6540da83 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:49.074553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:49.075504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:49.075968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:49.076400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:49.077317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:49.079359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7383b-d39a-47c2-b4f6-f1e4bc745613 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:49.144388 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2694/5342] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:49.145468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:49.170968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc3ff2-4929-44b7-b1dc-3c89a4d7908a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:49.184556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:49.185634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:49.186808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:49.187110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] PATH_INFO: `/v3/projects/ffa9d7efa56b45a2b4ba9d1646eddc35/users/0aa53fdb16d0459681219d82ee9da823/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:49.284932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa9d7efa56b45a2b4ba9d1646eddc35, user_id=0aa53fdb16d0459681219d82ee9da823, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:49.299378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:49.336698 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2649/5343] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:49 2022] PUT /identity/v3/projects/ffa9d7efa56b45a2b4ba9d1646eddc35/users/0aa53fdb16d0459681219d82ee9da823/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:49.346745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611521f9-1cb5-497e-8c71-af445936248a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:49.347303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611521f9-1cb5-497e-8c71-af445936248a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:49.347740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611521f9-1cb5-497e-8c71-af445936248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:49.436192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-611521f9-1cb5-497e-8c71-af445936248a None None] MFA Rules not processed for user `0aa53fdb16d0459681219d82ee9da823`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:49.438495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-611521f9-1cb5-497e-8c71-af445936248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:49.776398 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2695/5344] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:49.800427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:49.802458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:49.838000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611521f9-1cb5-497e-8c71-af445936248a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:49.839536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-611521f9-1cb5-497e-8c71-af445936248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:49.984256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e8d57-ccd6-4d46-a534-52a43c1a4bad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:49.992236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:49.993405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:49.993618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:49.993866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] PATH_INFO: `/v3/projects/f752c75b17804cf6a3f50ae24f9595ba` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:49.995720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f752c75b17804cf6a3f50ae24f9595ba)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:49.997844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:50.054151 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:50.087979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611521f9-1cb5-497e-8c71-af445936248a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:50.092640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f752c75b17804cf6a3f50ae24f9595ba', 'request_id': 'req-4032f1a3-b9cb-4720-9f7a-b239086fac3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.112955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f752c75b17804cf6a3f50ae24f9595ba', 'request_id': 'req-4032f1a3-b9cb-4720-9f7a-b239086fac3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.159972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f752c75b17804cf6a3f50ae24f9595ba', 'request_id': 'req-4032f1a3-b9cb-4720-9f7a-b239086fac3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.195943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] The token cache is being invalidate because project f752c75b17804cf6a3f50ae24f9595ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:50.196899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.199381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.204237 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2650/5345] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:49 2022] DELETE /identity/v3/projects/f752c75b17804cf6a3f50ae24f9595ba => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:50.204237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:50.209644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:50.259064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:50.260845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:50.261378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:50.264134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:50.266832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:50.417242 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:50.419709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:50.421943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:50.455579 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2696/5346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:50.456765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:50.460870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:50.466961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032f1a3-b9cb-4720-9f7a-b239086fac3f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:50.485830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:50.486515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:50.486807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:50.487086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:50.492246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:50.629992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:50.631634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:50.660621 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2651/5347] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:50.661514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:50.670892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:50.731712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871cab0-5486-4d9b-97a2-a4c5236419d3 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:50.748583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:50.750010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:50.750509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:50.751000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] PATH_INFO: `/v3/users/7b1ea99e51f6466c80bba882ffe00d48` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:50.755764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1ea99e51f6466c80bba882ffe00d48)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:50.760826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:50.825980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e58e0-828a-46e6-b983-f04eda32dccf service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:50.833633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:50.834559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:50.834846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:50.835119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] PATH_INFO: `/v3/users/a175648d864b49f3bae2d022c1b303dc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:50.838997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a175648d864b49f3bae2d022c1b303dc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:50.841325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:50.917661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1ea99e51f6466c80bba882ffe00d48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.920236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1ea99e51f6466c80bba882ffe00d48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.938003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1ea99e51f6466c80bba882ffe00d48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:50.941796 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:50.978834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1ea99e51f6466c80bba882ffe00d48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.018565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a175648d864b49f3bae2d022c1b303dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.025495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e583f40a-80cd-482b-ab87-d0e31814ae57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1ea99e51f6466c80bba882ffe00d48'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.036244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a175648d864b49f3bae2d022c1b303dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.046116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a175648d864b49f3bae2d022c1b303dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.064353 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2697/5348] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:50 2022] DELETE /identity/v3/users/7b1ea99e51f6466c80bba882ffe00d48 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:51.086226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a175648d864b49f3bae2d022c1b303dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.088709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a175648d864b49f3bae2d022c1b303dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:51.105588 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2652/5349] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:50 2022] DELETE /identity/v3/users/a175648d864b49f3bae2d022c1b303dc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:51.110509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:51.110802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:51.111079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:51.154717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:51.156102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:51.331638 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2698/5350] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:51.413805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:51.415780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:51.496407 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:51.654560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe186a-c603-457f-9cbd-0151a09624fc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:51.667023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:51.669801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:51.671049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:51.672630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:51.698869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:51.703158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:51.732820 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2653/5351] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:53.422828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:53.427917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:53.470396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7879d3-f533-4181-b918-ddd2a0fc4c5d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:53.485248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:53.485513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:53.485871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:53.486277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] PATH_INFO: `/v3/projects/36a8a8aec8f94f20930d073277b5c516` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:53.487388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a8a8aec8f94f20930d073277b5c516)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:53.492478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:53.498990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:53.501080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:53.527317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914110-c26c-4d29-b046-03a1e0a586a1 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:53.562014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:53.562906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:53.563187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:53.563470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] PATH_INFO: `/v3/projects/e5546f3c35f74f00ae5bde992cfc03bd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:53.565023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5546f3c35f74f00ae5bde992cfc03bd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:53.567949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:53.653812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a8a8aec8f94f20930d073277b5c516', 'request_id': 'req-e27c28da-8b89-483c-9155-a1d125ba2ba5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.709042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a8a8aec8f94f20930d073277b5c516', 'request_id': 'req-e27c28da-8b89-483c-9155-a1d125ba2ba5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.735412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5546f3c35f74f00ae5bde992cfc03bd', 'request_id': 'req-5058de9b-fd83-45c7-a8e7-1954d6d2770e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.747549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a8a8aec8f94f20930d073277b5c516', 'request_id': 'req-e27c28da-8b89-483c-9155-a1d125ba2ba5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.776541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5546f3c35f74f00ae5bde992cfc03bd', 'request_id': 'req-5058de9b-fd83-45c7-a8e7-1954d6d2770e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.782258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] The token cache is being invalidate because project 36a8a8aec8f94f20930d073277b5c516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:53.783329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.784979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e27c28da-8b89-483c-9155-a1d125ba2ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.788754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2699/5352] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:53 2022] DELETE /identity/v3/projects/36a8a8aec8f94f20930d073277b5c516 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:53.798321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033fb9-0e65-483f-8886-1f074511fab6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:53.799528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033fb9-0e65-483f-8886-1f074511fab6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:53.800044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033fb9-0e65-483f-8886-1f074511fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:53.804708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5546f3c35f74f00ae5bde992cfc03bd', 'request_id': 'req-5058de9b-fd83-45c7-a8e7-1954d6d2770e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.855160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] The token cache is being invalidate because project e5546f3c35f74f00ae5bde992cfc03bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:53.856788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.857862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5058de9b-fd83-45c7-a8e7-1954d6d2770e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:53.877116 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2654/5353] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:53 2022] DELETE /identity/v3/projects/e5546f3c35f74f00ae5bde992cfc03bd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:53.889873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3d033fb9-0e65-483f-8886-1f074511fab6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:53.892814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3d033fb9-0e65-483f-8886-1f074511fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:53.896650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8216-3d7d-4611-968c-12dd0964a825 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:53.926456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8216-3d7d-4611-968c-12dd0964a825 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:53.929370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8216-3d7d-4611-968c-12dd0964a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.014115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4f1e8216-3d7d-4611-968c-12dd0964a825 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:54.024191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f1e8216-3d7d-4611-968c-12dd0964a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:54.229497 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:54.284696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2700/5354] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:54.286329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.286626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.289581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.323723 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2655/5355] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:54.330098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.330408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.330693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.374867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:54.376143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:54.397795 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2701/5356] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:54.403144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:54.406254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:54.407507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.425215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6a1ea-bbe0-43d1-8f16-287d23179b63 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.437431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.437929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2656/5357] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:54.438534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.438908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.439195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.439960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:54.440270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.448700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.459549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:54.485256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7aa9-9d5d-4dbc-868d-070db77704b2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.502790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.504804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.505094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.505373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.506198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:32:54.506508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.508405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:54.527546 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2702/5358] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:54.529305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.554403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60b3b2-b59e-4557-a609-e9797ba80a25 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.570736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.573376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.576359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.576769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2657/5359] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:32:54.577149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.577885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.578611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.588652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:54.612618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20037c-d57f-4d4f-80ae-f1ae1e7193f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.628508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.629742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.630260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.630737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.632150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.637132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:54.648740 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2703/5360] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:54.650302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.702311 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:54.726856 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2658/5361] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:54.727820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:54.836887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78256e74-e4db-4512-93f4-0b327f7b2c02 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.942900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98952fb-c5dc-48db-98bc-de198ab76448 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:54.957256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.957888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.962576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.963694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.964625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.973042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:54.976206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:54.976919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:54.977207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:54.977488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:54.982261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:54.984506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.036559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2704/5362] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/users => generated 288 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:55.037551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.070836 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2659/5363] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:54 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:55.071317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000623-c937-42bf-9971-e1166e494c58 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.075044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.084066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.084774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.085065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.085345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.086127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.087804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.124145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da332-1fa8-4cab-93b1-a4ffd8c76b83 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.133659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.134442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.134739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.135642 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2705/5364] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:55.136576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.137357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.143063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.146896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.175724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6f15a-7e25-4772-a4a1-0594d9a7c402 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.176392 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2660/5365] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:55.180877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.192612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.208268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.208524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.208899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695185f-829f-4dee-870d-11bacc73cf1b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.214730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.218568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.234951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.241562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.242296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.242584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.242861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.243642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.254236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2706/5366] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:55.255178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.256190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.269410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950131f5-3af9-416d-a7e4-2d242844bb08 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.277493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.278437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.278726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.279563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] PATH_INFO: `/v3/projects/d9027fbfdedd4443a1c9d97ddc41da6a/users/e8222461cfb748a4bc232bc2077e6629/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.305026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2661/5367] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:55.311340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.312064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9027fbfdedd4443a1c9d97ddc41da6a, user_id=e8222461cfb748a4bc232bc2077e6629, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.315534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020b1bf-a0b9-497a-9f10-afccf77426dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.352066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7320c9-8fb1-4235-a6bf-c9d23a6cb407 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.376579 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2707/5368] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:55 2022] PUT /identity/v3/projects/d9027fbfdedd4443a1c9d97ddc41da6a/users/e8222461cfb748a4bc232bc2077e6629/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:55.381420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.381743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.382037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.413954 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:55.448776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] MFA Rules not processed for user `e8222461cfb748a4bc232bc2077e6629`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:55.467334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:55.543557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:55.544923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.545271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.545612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] PATH_INFO: `/v3/projects/df1ac3b8a412437cb066846a0edc2cc5/users/0c19cadfd922406197ea2977432c3e5e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.589643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1ac3b8a412437cb066846a0edc2cc5, user_id=0c19cadfd922406197ea2977432c3e5e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:55.614434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa9c27-26b7-468d-be17-d6185d4638c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:55.666706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2662/5369] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:55 2022] PUT /identity/v3/projects/df1ac3b8a412437cb066846a0edc2cc5/users/0c19cadfd922406197ea2977432c3e5e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:55.693242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:55.694036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:55.695651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:55.715515 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2708/5370] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:55.735251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:55.773589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752f0be-a003-4d1f-bd76-1dc904d59f84 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:55.832123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] MFA Rules not processed for user `0c19cadfd922406197ea2977432c3e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:55.847840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:55.997782 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:56.008403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.011063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.012222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.012503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.013289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.017038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.060049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2663/5371] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:56.066722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.082724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2709/5372] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:55 2022] POST /identity/v3/projects => generated 373 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:56.082724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.095458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432b3d-57f8-41cc-a01f-1274b914c278 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.287385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609242d-dc57-4f68-80a9-4e61b20d7f69 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.294926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.295620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.295906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.296189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.296910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.305543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.306281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.307289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.309012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.313644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.316951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.323784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.388201 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2710/5373] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:56 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:56.396542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.401070 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2664/5374] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:56 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:56.413293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.435080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081710c7-540d-4f6e-a832-308033ae2500 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.452680 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:56.542407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acb82-4b79-4f5e-a778-6bfa84ed0b0b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.558263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.558978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.559263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.559534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.560247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.566245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.566951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.567237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.567550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.568274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.569932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.576536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.635815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2711/5375] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:56.650279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.672106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2665/5376] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:32:56 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:56.676700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.684850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee7f6-d8ac-4bfe-9ef4-152a3d51a1ff admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.718228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.721762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.732611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.732611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] PATH_INFO: `/v3/projects/766b8ae58fd6498095013cdbd57e3c44/users/c6ecec1619bf4fb7af5ff7eec348b651/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.740441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e330-3067-43d5-afd9-5efa1109b821 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.747954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.749082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.749526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.750050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.750952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.752737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.769262 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2666/5377] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:56.772810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.799346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af3e50-44b4-4e1b-980f-1449a59c44c0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:56.813895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766b8ae58fd6498095013cdbd57e3c44, user_id=c6ecec1619bf4fb7af5ff7eec348b651, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.817123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:56.819905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:56.820415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:56.823818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] PATH_INFO: `/v3/projects/fad8a68afdcb4f82a9f13d7883e26281/users/5b6e1fe780dd48059853d5f5689251a8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:56.827425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.863951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8a68afdcb4f82a9f13d7883e26281, user_id=5b6e1fe780dd48059853d5f5689251a8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:56.870567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:56.880810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2712/5378] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:56 2022] PUT /identity/v3/projects/766b8ae58fd6498095013cdbd57e3c44/users/c6ecec1619bf4fb7af5ff7eec348b651/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:56.883066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.909099 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2667/5379] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:56 2022] PUT /identity/v3/projects/fad8a68afdcb4f82a9f13d7883e26281/users/5b6e1fe780dd48059853d5f5689251a8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:56.912724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:56.982269 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:57.053948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bc67-0b1a-4fde-8800-537805dd45d7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.086700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04793489-9f0b-4343-aba4-45a112097e31 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.101273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.101896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.102190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.102471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.103357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.105268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.130397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2668/5380] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:57.131305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:57.169799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657abf4-4c94-494b-9758-8a03e4ba2069 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.172866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.173985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.174269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.174555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] PATH_INFO: `/v3/projects/fad8a68afdcb4f82a9f13d7883e26281/users/5b6e1fe780dd48059853d5f5689251a8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.176835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8a68afdcb4f82a9f13d7883e26281, user_id=5b6e1fe780dd48059853d5f5689251a8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.179537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fdfa5e-11a0-4f53-9eb0-66d558d25e7b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.216763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.226765 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2669/5381] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:57 2022] PUT /identity/v3/projects/fad8a68afdcb4f82a9f13d7883e26281/users/5b6e1fe780dd48059853d5f5689251a8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:57.227278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.227278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.227278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.228011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.228518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.228809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.229096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.230174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.260831 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2713/5382] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:32:57.262069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:57.274583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b8b0-a813-43ce-8c74-efa933ca78ba admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.305631 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:57.332665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] MFA Rules not processed for user `5b6e1fe780dd48059853d5f5689251a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:57.334122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:57.349904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.390189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.390189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.390189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] PATH_INFO: `/v3/projects/766b8ae58fd6498095013cdbd57e3c44/users/c6ecec1619bf4fb7af5ff7eec348b651/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.390189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766b8ae58fd6498095013cdbd57e3c44, user_id=c6ecec1619bf4fb7af5ff7eec348b651, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.390189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db7e63-edb2-4fd0-86ac-0138377768c1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.459623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2714/5383] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:32:57 2022] PUT /identity/v3/projects/766b8ae58fd6498095013cdbd57e3c44/users/c6ecec1619bf4fb7af5ff7eec348b651/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:57.468496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.468789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.471975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.537369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2670/5384] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:57.572705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] MFA Rules not processed for user `c6ecec1619bf4fb7af5ff7eec348b651`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:57.574695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:57.623948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:57.627695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:57.697800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb093d-1447-4913-bae6-3ba630d11518 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.754819 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:57.775284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.776031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.776224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.776759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.779765 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2715/5385] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:32:57.783911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:57.805798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc8e0-ec01-4ffe-b1f4-633d6535264f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:57.821197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:57.822341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:57.822820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:57.823299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:57.824218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.826123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.877367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:57.880684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811edad0-8732-4367-9e0a-23d747b0c92a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:57.884741 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2716/5386] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:32:57 2022] POST /identity/v3/projects => generated 351 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:57.898950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:57.909411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2671/5387] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:58.104790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a35fb2-6466-47e7-a161-20e875521a30 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.113533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.114185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.114708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.124965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.126869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.131313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.131757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.133149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.138776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.182571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] MFA Rules not processed for user `e0b873c4cd7b4558ab357acff39f0253`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:58.182571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:58.241559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2717/5388] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:32:57 2022] POST /identity/v3/projects => generated 349 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:58.242887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.267167 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:58.331110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2672/5389] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:58.432470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc54cf6-640f-4603-b07d-1c19b5e8a1b4 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.442339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.443517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.445198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.445933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/users/e8222461cfb748a4bc232bc2077e6629` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.447465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:get_user(user_id=e8222461cfb748a4bc232bc2077e6629)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.449996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.455718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2718/5390] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:32:58 2022] GET /identity/v3/users/e8222461cfb748a4bc232bc2077e6629 => generated 288 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:32:58.457617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.485482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42565d-5d38-424b-a4ed-7ded05b50c29 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.501334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.502382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.502859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.503384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.504970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.510749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.548980 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2673/5391] 10.222.0.27 () {60 vars in 1161 bytes} [Sun Jul 24 01:32:58 2022] POST /identity/v3/credentials => generated 431 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:32:58.553324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.581373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b784b-f9ca-4ed4-ae8a-3b51a0d08560 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.598472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.599580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.599869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.600152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.604667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.606939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.610192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.612627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.654265 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2719/5392] 10.222.0.27 () {60 vars in 1357 bytes} [Sun Jul 24 01:32:58 2022] PATCH /identity/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3 => generated 434 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:58.656103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.674292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2cec8-f3be-473a-bd77-c3aa2c2e9085 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.679918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.681068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.682546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.683016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.685982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.702624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.730674 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2674/5393] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Jul 24 01:32:58 2022] GET /identity/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3 => generated 434 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:58.734152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.751730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85879b03-cee7-4e5d-8b13-9c0fbeab9182 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.769917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.771381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.772059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.773524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.780198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.780779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.783038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:58.783229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:58.825861 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2720/5394] 10.222.0.27 () {58 vars in 1337 bytes} [Sun Jul 24 01:32:58 2022] DELETE /identity/v3/credentials/501126c38556cb73327d905061d369be191e3943483973463d48d8449c6e98b3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:58.827046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:58.842124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8eb4-5f72-40d7-a4b9-2c07ba01b1e9 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:58.877808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:58.878838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:58.879545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:58.882502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:58.883672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:58.897783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.006899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2721/5395] 10.222.0.27 () {60 vars in 1161 bytes} [Sun Jul 24 01:32:58 2022] POST /identity/v3/credentials => generated 430 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:59.008672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.055573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ab40-c67f-4601-a73a-15b5a5f7c389 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.061786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858cf6d-6e00-4740-a608-2c356dedaa44 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.066162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.067070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.067359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.067638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] PATH_INFO: `/v3/users/0aa53fdb16d0459681219d82ee9da823` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.067971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.069118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.069653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.070054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.070399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa53fdb16d0459681219d82ee9da823)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.070893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.072763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.072989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.100978 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2722/5396] 10.222.0.27 () {60 vars in 1161 bytes} [Sun Jul 24 01:32:59 2022] POST /identity/v3/credentials => generated 431 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:32:59.107234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.125790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b4243-d0a6-4104-a349-57f8517a58cf tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.126503 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:59.142695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.143919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.144387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.145181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.146228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.150089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.162324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.166489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.171280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.175126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.183809 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2723/5397] 10.222.0.27 () {58 vars in 1139 bytes} [Sun Jul 24 01:32:59 2022] GET /identity/v3/credentials => generated 946 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:32:59.188335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa53fdb16d0459681219d82ee9da823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.190519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.205436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa53fdb16d0459681219d82ee9da823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.215946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa53fdb16d0459681219d82ee9da823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.225079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ae97-e894-40af-a638-d6f1afc45938 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.245225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa53fdb16d0459681219d82ee9da823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.245903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-90ccf8d1-3766-426e-a8ea-3c78b548edbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa53fdb16d0459681219d82ee9da823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.248722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.251176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.251635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.252694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials/5c9534e656ed9b169ba7a3df419f6578b0c1cbe182bc1a8def66093acb0bba75` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.260511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5c9534e656ed9b169ba7a3df419f6578b0c1cbe182bc1a8def66093acb0bba75)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.263373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.274327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2675/5398] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:32:58 2022] DELETE /identity/v3/users/0aa53fdb16d0459681219d82ee9da823 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:59.285058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.285351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.285638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.324781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:32:59.326650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.333972 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2724/5399] 10.222.0.27 () {58 vars in 1337 bytes} [Sun Jul 24 01:32:59 2022] DELETE /identity/v3/credentials/5c9534e656ed9b169ba7a3df419f6578b0c1cbe182bc1a8def66093acb0bba75 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:59.339246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.343538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.383671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220e0f-7a29-4360-94a3-11133e417dec tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.495150 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2676/5400] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:32:59.505513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.507998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.517294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.518269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.518554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.518836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/credentials/f4911aa9f8e39a266619a7436d24913448e16bbdf3e681a018c7c3c9f76c8602` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.522795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f4911aa9f8e39a266619a7436d24913448e16bbdf3e681a018c7c3c9f76c8602)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.526599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.567520 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2725/5401] 10.222.0.27 () {58 vars in 1337 bytes} [Sun Jul 24 01:32:59 2022] DELETE /identity/v3/credentials/f4911aa9f8e39a266619a7436d24913448e16bbdf3e681a018c7c3c9f76c8602 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:32:59.568644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.583712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156c1c7-0941-4676-b12f-4a880a9a6573 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.607688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5cc52-01a0-43b3-b875-29fc40c26fa9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.608744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.618215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.618417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.618511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.618511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.618511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.620086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.620086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/projects/f1166f1c5d7f4023b536319dc16d8675` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.620086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1166f1c5d7f4023b536319dc16d8675)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.621885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.635811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.638345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.653429 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2677/5402] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:32:59.675087 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:59.725994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.727967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1166f1c5d7f4023b536319dc16d8675', 'request_id': 'req-4295ea96-786a-4190-baeb-5fae8332e2b8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.729099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.744871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1166f1c5d7f4023b536319dc16d8675', 'request_id': 'req-4295ea96-786a-4190-baeb-5fae8332e2b8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.764275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42310308-4d09-462e-a2e6-d16318948379 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.769517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1166f1c5d7f4023b536319dc16d8675', 'request_id': 'req-4295ea96-786a-4190-baeb-5fae8332e2b8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.799088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] The token cache is being invalidate because project f1166f1c5d7f4023b536319dc16d8675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:32:59.799392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.800295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:32:59.808089 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2726/5403] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:59 2022] DELETE /identity/v3/projects/f1166f1c5d7f4023b536319dc16d8675 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:32:59.809081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:32:59.815806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.886405 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:32:59.898527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.901822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.902374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:32:59.903747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:32:59.911415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:32:59.942675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:32:59.947851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:32:59.965463 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2678/5404] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:32:59.987907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295ea96-786a-4190-baeb-5fae8332e2b8 tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:32:59.998060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ecec1619bf4fb7af5ff7eec348b651', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '766b8ae58fd6498095013cdbd57e3c44', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:32:59.999417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:32:59.999937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:00.000323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] PATH_INFO: `/v3/projects/9c1a6036812f4d3ea8eaf4778f3fc1f7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:00.001872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c1a6036812f4d3ea8eaf4778f3fc1f7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:00.003936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:00.088666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1a6036812f4d3ea8eaf4778f3fc1f7', 'request_id': 'req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.098219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1a6036812f4d3ea8eaf4778f3fc1f7', 'request_id': 'req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.109781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1a6036812f4d3ea8eaf4778f3fc1f7', 'request_id': 'req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.125565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] The token cache is being invalidate because project 9c1a6036812f4d3ea8eaf4778f3fc1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:00.126014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.126821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4154ec15-6ea7-4d7f-990a-e240ace8fd4a tempest-CredentialsTestJSON-282013276 tempest-CredentialsTestJSON-282013276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.131602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2727/5405] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:32:59 2022] DELETE /identity/v3/projects/9c1a6036812f4d3ea8eaf4778f3fc1f7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:00.132920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:00.134432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:00.211359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39990-2dc9-4cea-ab24-6ba7a88c8816 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:00.295874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:00.299345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:00.299812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:00.300201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] PATH_INFO: `/v3/users/e8222461cfb748a4bc232bc2077e6629` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:00.301835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8222461cfb748a4bc232bc2077e6629)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:00.303955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:00.376249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8222461cfb748a4bc232bc2077e6629'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.390569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8222461cfb748a4bc232bc2077e6629'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.404024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8222461cfb748a4bc232bc2077e6629'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.422915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8222461cfb748a4bc232bc2077e6629'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.423662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8222461cfb748a4bc232bc2077e6629'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:00.433822 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2679/5406] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:00 2022] DELETE /identity/v3/users/e8222461cfb748a4bc232bc2077e6629 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:00.435758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:00.436126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:00.436488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:00.456858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:00.458292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:00.506652 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:00.551893 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2728/5407] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:00.557761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:00.559680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:00.579959 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:00.643012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35be7-1c32-41e0-a3a6-16968aec5d88 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:00.647342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:00.648570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:00.649018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:00.649467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:00.662808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:00.664597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:00.679057 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2680/5408] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:01.066185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:01.066185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:01.081502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b70794-e8c4-4093-a437-976163e04a18 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:01.095237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:01.096128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:01.096409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:01.096730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] PATH_INFO: `/v3/projects/ffa9d7efa56b45a2b4ba9d1646eddc35` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:01.098478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa9d7efa56b45a2b4ba9d1646eddc35)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:01.101615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:01.208691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:01.215865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:01.217176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa9d7efa56b45a2b4ba9d1646eddc35', 'request_id': 'req-0235f5ea-817c-4553-923e-0b9b74aaa181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.237271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa9d7efa56b45a2b4ba9d1646eddc35', 'request_id': 'req-0235f5ea-817c-4553-923e-0b9b74aaa181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.256318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa9d7efa56b45a2b4ba9d1646eddc35', 'request_id': 'req-0235f5ea-817c-4553-923e-0b9b74aaa181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.262569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f8373-399b-44de-818a-d39e125e5976 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:01.278585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] The token cache is being invalidate because project ffa9d7efa56b45a2b4ba9d1646eddc35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:01.278938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.280610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0235f5ea-817c-4553-923e-0b9b74aaa181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.286902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2729/5409] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:01 2022] DELETE /identity/v3/projects/ffa9d7efa56b45a2b4ba9d1646eddc35 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:01.292840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c511c5-c236-47dc-845e-af6e28e27fff None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:01.295310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c511c5-c236-47dc-845e-af6e28e27fff None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:01.295704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c511c5-c236-47dc-845e-af6e28e27fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:01.351548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d5c511c5-c236-47dc-845e-af6e28e27fff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:01.357417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d5c511c5-c236-47dc-845e-af6e28e27fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:01.447818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:01.449541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:01.450366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:01.450652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] PATH_INFO: `/v3/projects/d9027fbfdedd4443a1c9d97ddc41da6a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:01.453262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9027fbfdedd4443a1c9d97ddc41da6a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:01.457702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:01.532449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2730/5410] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:01.541632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:01.542328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:01.542831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:01.596630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9027fbfdedd4443a1c9d97ddc41da6a', 'request_id': 'req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.599373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:01.603381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:01.609424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9027fbfdedd4443a1c9d97ddc41da6a', 'request_id': 'req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.648659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9027fbfdedd4443a1c9d97ddc41da6a', 'request_id': 'req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.701459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] The token cache is being invalidate because project d9027fbfdedd4443a1c9d97ddc41da6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:01.701665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.706572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:01.711899 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2681/5411] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:01 2022] DELETE /identity/v3/projects/d9027fbfdedd4443a1c9d97ddc41da6a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:01.717257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:01.726707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:01.844498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2731/5412] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:01.849918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:01.882778 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:01.915213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d53b-a016-4605-b433-5f38abf8ae5f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:01.944964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:01.944964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:01.944964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:01.946375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:01.954603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:01.956490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:01.960773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.005818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2732/5413] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:02.009886 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:02.011373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:02.035963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427ed25-fd0f-456b-bcd8-b6df7672b0ae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.054766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.055619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.056018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.056497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.058647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.060715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.093701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb87cb-1c4c-4f02-bbec-7693fa4c90a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.112993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.116470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.120307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.124023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] PATH_INFO: `/v3/users/c6ecec1619bf4fb7af5ff7eec348b651` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.126514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ecec1619bf4fb7af5ff7eec348b651)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.136696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.164419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2733/5414] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:02 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:02.168875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:02.367012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890cced-9eed-49d2-b6b6-fa5a197c9e97 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.367625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ecec1619bf4fb7af5ff7eec348b651'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:02.380885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.381774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.383607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.384030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.384928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.397277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.398004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ecec1619bf4fb7af5ff7eec348b651'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:02.435744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ecec1619bf4fb7af5ff7eec348b651'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:02.440086 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2734/5415] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:02 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:02.448539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:02.466933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f55634-58e7-488e-9c4d-6f1a808a4d87 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.475194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.476894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.477572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.478161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.480157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.483018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.499405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ecec1619bf4fb7af5ff7eec348b651'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:02.501607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ecec1619bf4fb7af5ff7eec348b651'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:02.506540 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2735/5416] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:02.511523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:02.515275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:02.537500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f6c7e-a916-433f-8b39-7b755b7ee2bc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.542656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.544197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.544197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.544591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.545638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.547615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541408a-2d65-42ca-be89-b0d2d7278dd2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.561038 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2682/5417] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:01 2022] DELETE /identity/v3/users/c6ecec1619bf4fb7af5ff7eec348b651 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:02.571889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2736/5418] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:02.576408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:02.722600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722118a7-3389-4db8-8675-b9298ba7d556 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:02.730676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:02.732904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.733939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.734507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] PATH_INFO: `/v3/projects/9701771015da4becb66a8a5f94122d2c/users/524fbca79dd74fe59142f4526546bf37/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.755907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9701771015da4becb66a8a5f94122d2c, user_id=524fbca79dd74fe59142f4526546bf37, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:02.759129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:02.777748 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2683/5419] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:02 2022] PUT /identity/v3/projects/9701771015da4becb66a8a5f94122d2c/users/524fbca79dd74fe59142f4526546bf37/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:02.788337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:02.789150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:02.789661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:02.849642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] MFA Rules not processed for user `524fbca79dd74fe59142f4526546bf37`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:02.854453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:03.046797 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2737/5420] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:03.051335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.190473 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:03.225797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7b0f-13a6-4804-bede-873d69a9259a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:03.237015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:03.238861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.239828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.240363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:03.242279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:03.244900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:03.286927 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2684/5421] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:03 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:03.291614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.342323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e606fc4-a6f4-4718-b7ec-5e75694a229e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:03.386094 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:03.518701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:03.520767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.523156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.524054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:03.528037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:03.534753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:03.582954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2738/5422] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:03 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:03.588906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.608611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5da20-2c59-470e-90a1-047c56f0a9c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:03.621100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:03.623595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.625130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.625663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:03.626904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:03.628937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:03.681443 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2685/5423] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:03.686730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.702241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.706862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:03.708491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8297ff-a40b-4915-8418-2c43d2b2f449 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:03.730934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:03.732524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.732857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.733136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] PATH_INFO: `/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5/users/bbbf53792834446a8ac3d587f94794a1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:03.734207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f6e5-c50c-4664-9d8f-9e2f01273633 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:03.747781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:03.749087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.749603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.750906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] PATH_INFO: `/v3/projects/766b8ae58fd6498095013cdbd57e3c44` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:03.753643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766b8ae58fd6498095013cdbd57e3c44)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:03.758931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:03.792381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6b3cf6980468c9f130b14a72dc8c5, user_id=bbbf53792834446a8ac3d587f94794a1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:03.795175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:03.839414 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2739/5424] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:03 2022] PUT /identity/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5/users/bbbf53792834446a8ac3d587f94794a1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:03.843685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:03.883431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766b8ae58fd6498095013cdbd57e3c44', 'request_id': 'req-0f3e8bec-c500-489d-ba95-920096b2aab3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:03.898599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766b8ae58fd6498095013cdbd57e3c44', 'request_id': 'req-0f3e8bec-c500-489d-ba95-920096b2aab3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:03.911983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766b8ae58fd6498095013cdbd57e3c44', 'request_id': 'req-0f3e8bec-c500-489d-ba95-920096b2aab3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:03.937613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] The token cache is being invalidate because project 766b8ae58fd6498095013cdbd57e3c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:03.938653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:03.939601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0f3e8bec-c500-489d-ba95-920096b2aab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:03.953845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2686/5425] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:03 2022] DELETE /identity/v3/projects/766b8ae58fd6498095013cdbd57e3c44 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:03.971210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391470-21a4-4e84-8881-335842640f63 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:03.971990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391470-21a4-4e84-8881-335842640f63 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:03.978322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391470-21a4-4e84-8881-335842640f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.050938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d0391470-21a4-4e84-8881-335842640f63 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:04.052112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0391470-21a4-4e84-8881-335842640f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:04.127442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b15ee-9088-4d0d-aae2-1c19c75c6175 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.314935 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2687/5426] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:04.323905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.324390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.324877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.358606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:04.359322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.359592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.359865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.360609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:04.362808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:04.382625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:04.386553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:04.396037 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2740/5427] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:04.401132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:04.405606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:04.413606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2688/5428] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:04.416970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:04.437442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970578-7628-4786-9aa5-b0365ab523a9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.448230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:04.449287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.449563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.449863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] PATH_INFO: `/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5/users/bbbf53792834446a8ac3d587f94794a1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.452929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49de64-9175-4ac6-979f-c7d0d13891de None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.456402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6b3cf6980468c9f130b14a72dc8c5, user_id=bbbf53792834446a8ac3d587f94794a1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:04.463899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e87a7-25ef-46f7-9930-0df0aa2c1513 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:04.481192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:04.482199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.482549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.482776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.483524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:04.483855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:04.485519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:04.489825 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2741/5429] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:04 2022] PUT /identity/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5/users/bbbf53792834446a8ac3d587f94794a1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:04.504459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.504850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.505039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.550863 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2689/5430] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:04.552820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:04.581870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] MFA Rules not processed for user `bbbf53792834446a8ac3d587f94794a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:04.584202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:04.595254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b089-4c17-4223-8141-98079f336ac1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.615566 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:04.675181 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:04.728985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:04.730954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.731711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.732268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.733189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:04.735403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:04.781030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2742/5431] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:04.790238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:04.792539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:04.807576 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2690/5432] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:04 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:04.811524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:04.969610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749566c-f814-4d85-b7de-a5a2d3447560 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.973814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1afee-5d0e-4319-b6b2-ada13d65d933 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:04.990116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:04.991221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:04.991744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:04.994919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:04.996585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.001143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.047858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2691/5433] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:04 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:05.052435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:05.077426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb693946-bb1a-415d-8289-cbd96ebc3dbd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:05.105978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.112180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.115018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.115559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.118654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.127863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.128907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.129747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.132956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.135178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.165065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2692/5434] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:05.167475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:05.241529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e907af-01d1-4408-9df3-d9b5e6b33718 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:05.270990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.273565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.274717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.278966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.279890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.281769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.337042 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2693/5435] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:05.338604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:05.370818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51675f1-6752-4842-a4ef-440863c73e5b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:05.373396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.375016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daace0-8e77-45ad-abf8-55ab27bf9cd1 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.376628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.377571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.377881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.378166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] PATH_INFO: `/v3/projects/c5af0ebc50de4bd5aaebaa8fcb4733bc/users/7957f23817604b718e468f2610045561/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.400872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2743/5436] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:05.415336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5af0ebc50de4bd5aaebaa8fcb4733bc, user_id=7957f23817604b718e468f2610045561, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.421384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.464803 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2694/5437] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:05 2022] PUT /identity/v3/projects/c5af0ebc50de4bd5aaebaa8fcb4733bc/users/7957f23817604b718e468f2610045561/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:05.467068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357de8b-df58-476a-9757-551b36a63188 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.467783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357de8b-df58-476a-9757-551b36a63188 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.468412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357de8b-df58-476a-9757-551b36a63188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.482342 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:05.533971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8357de8b-df58-476a-9757-551b36a63188 None None] MFA Rules not processed for user `7957f23817604b718e468f2610045561`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:05.535199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8357de8b-df58-476a-9757-551b36a63188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:05.546331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:05.670849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c920d-2357-463a-a15a-dd1fc2121b94 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:05.684574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.685440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.685875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.686278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.694026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:05.715564 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:05.720877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2744/5438] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:05.729029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357de8b-df58-476a-9757-551b36a63188 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:05.938531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.940137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.941306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357de8b-df58-476a-9757-551b36a63188 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:05.951101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:05.952551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:05.953087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:05.953710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:05.954638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:05.956783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:05.977868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2695/5439] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:06.014233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2745/5440] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:05 2022] POST /identity/v3/projects => generated 377 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:06.017182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:06.032411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb81dee-b28f-498e-b34f-2aaf72f2f4a3 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:06.241474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:06.242206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.242495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.242769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.246204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:06.248185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:06.310958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:06.317917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2696/5441] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:06 2022] POST /identity/v3/users => generated 295 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:06.323758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57bf4-9d3d-4ef9-9381-77eae9c9a108 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:06.358154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:06.358850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.359136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.359418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.360172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:06.370977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:06.403039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2746/5442] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:06.404259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:06.420618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bb1c2-e189-4350-8d5c-c8553e9846e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:06.430881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:06.431910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.432198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.432475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] PATH_INFO: `/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0/users/ece13d64152242c296196e3e8dafa21a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.470897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e03a789b53449ebb8a834e3c9ae88e0, user_id=ece13d64152242c296196e3e8dafa21a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:06.476305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:06.530660 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2697/5443] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:06 2022] PUT /identity/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0/users/ece13d64152242c296196e3e8dafa21a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:06.531958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:06.546016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00425c-5b11-4000-b908-ec98d938f323 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:06.688151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:06.688858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.689146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.689427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.690217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:06.691888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdb583-dde0-489c-91ca-90d92f3c1fba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:06.724768 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2747/5444] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:06.725706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:06.756533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8d21-11be-4654-8175-67f18411b959 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:06.763613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:06.764703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.764988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.765269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] PATH_INFO: `/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0/users/ece13d64152242c296196e3e8dafa21a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.809565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e03a789b53449ebb8a834e3c9ae88e0, user_id=ece13d64152242c296196e3e8dafa21a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:06.815774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:06.834135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2698/5445] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:06 2022] PUT /identity/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0/users/ece13d64152242c296196e3e8dafa21a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:06.846756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:06.847093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:06.847332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:06.877183 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:06.963363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] MFA Rules not processed for user `ece13d64152242c296196e3e8dafa21a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:06.971123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:07.179280 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2748/5446] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:07.181384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.205836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661730-0601-4e94-b22f-2d128298df62 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.218903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.219545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.219828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.220112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.220843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.221909 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.221909 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:07.221909 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:07.224512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.283520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2699/5447] 10.222.0.27 () {60 vars in 1184 bytes} [Sun Jul 24 01:33:07 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:07.284740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.306090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d662b2-f523-4d39-82a1-b8484017ed6a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.330123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.332930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.336982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.340521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1be45091f20d468e8253ae49a0243336` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.341421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1be45091f20d468e8253ae49a0243336)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.343010 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.343010 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:33:07.343010 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:33:07.345662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.370528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2749/5448] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:33:07 2022] GET /identity/v3/OS-OAUTH1/consumers/1be45091f20d468e8253ae49a0243336 => generated 220 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:07.371750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.388026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a01114-0aa5-496e-89e5-fbc60acafff5 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.399250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.400935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.401527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.401878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1be45091f20d468e8253ae49a0243336` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.402575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1be45091f20d468e8253ae49a0243336)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.405230 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.405230 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:07.405230 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:07.406183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.406463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer 1be45091f20d468e8253ae49a0243336 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:07.406740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.411941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.458576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1be45091f20d468e8253ae49a0243336', 'request_id': 'req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.485967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2700/5449] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:07 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1be45091f20d468e8253ae49a0243336 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:07.490719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.492600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:07.522689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377951e9-5e38-4865-8b6e-ba0a10b0a724 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.547499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.548246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.548540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.548851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.550395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.551436 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.551436 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:33:07.551436 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:33:07.553587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.603035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2750/5450] 10.222.0.27 () {60 vars in 1184 bytes} [Sun Jul 24 01:33:07 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:07.607331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.623284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064f67f-5ff3-4a04-89e4-0a9b2fd27433 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.638755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.639613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.639896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.640175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.640853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=cab930d2d23f46549dd32a5f26238835)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.641953 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.641953 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:07.641953 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:07.642929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.657993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2701/5451] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:33:07 2022] GET /identity/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835 => generated 221 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:07.661721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.682583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f6ab-39c4-4529-a9a8-026c0831e351 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.702469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.703342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.703631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.703912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.704587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cab930d2d23f46549dd32a5f26238835)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.705616 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:07.705616 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:33:07.705616 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:33:07.706533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.717629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer cab930d2d23f46549dd32a5f26238835 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:07.717629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.719649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.778566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'cab930d2d23f46549dd32a5f26238835', 'request_id': 'req-951c2e5a-bcce-4b59-943e-e753bc998343'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:07.824496 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2751/5452] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:07 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:07.825497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.827357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:07.866446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abca03-d573-4751-afb6-921275f3bdf0 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:07.886504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:07.893984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:07.894689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:07.895273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:07.896218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=cab930d2d23f46549dd32a5f26238835)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:07.904181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 24 01:33:07.962641 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 24 01:33:07.963822 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:33:07.967054 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2702/5453] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:33:07 2022] GET /identity/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835 => generated 74 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:33:07.971261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:07.996337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c2e5a-bcce-4b59-943e-e753bc998343 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.026728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.027609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.027963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.029986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.030837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cab930d2d23f46549dd32a5f26238835)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.032490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.035464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer cab930d2d23f46549dd32a5f26238835 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:08.036014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.038822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 24 01:33:08.097103 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 24 01:33:08.098306 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:33:08.104877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2752/5454] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:07 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cab930d2d23f46549dd32a5f26238835 => generated 74 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:33:08.105420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.108231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:08.156747 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:08.185735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852fe93-ffa1-4cfe-acf1-f446e337fb77 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.207711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.209095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.214141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.214607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.215508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.222350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.275225 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2703/5455] 10.222.0.27 () {60 vars in 1184 bytes} [Sun Jul 24 01:33:08 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:08.276038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.303756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d246575-8eda-412f-94dc-608afab250d2 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.327196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.328996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.328996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.328996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.329582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.331198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.402447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2753/5456] 10.222.0.27 () {60 vars in 1184 bytes} [Sun Jul 24 01:33:08 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:08.407185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.421450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5137-47e8-4bbd-a87e-a748088dd304 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.452584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.453283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.453539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.453853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.454519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.455550 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:08.455550 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:08.455550 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:08.456445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.482728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.494049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2704/5457] 10.222.0.27 () {58 vars in 1163 bytes} [Sun Jul 24 01:33:08 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:08.494574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78340688-f4b3-40e0-9bc5-d203ae2558dd tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.512687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.513464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.517809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.518231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5347b12a935e4ebe968f085683a8af55` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.519097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5347b12a935e4ebe968f085683a8af55)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.520813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.521111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer 5347b12a935e4ebe968f085683a8af55 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:08.521373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.528378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.561625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5347b12a935e4ebe968f085683a8af55', 'request_id': 'req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.625130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.625576 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2754/5458] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:08 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5347b12a935e4ebe968f085683a8af55 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:08.626963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:08.652222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6806a3-5016-4aa7-a188-869b2818f21f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.668514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.669443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.670021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.670309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/62c6951c21084b0aa0a9fb42f71da054` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.670999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=62c6951c21084b0aa0a9fb42f71da054)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.674938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.675216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer 62c6951c21084b0aa0a9fb42f71da054 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:08.675507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.678106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.701890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '62c6951c21084b0aa0a9fb42f71da054', 'request_id': 'req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:08.736561 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2705/5459] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:08 2022] DELETE /identity/v3/OS-OAUTH1/consumers/62c6951c21084b0aa0a9fb42f71da054 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:08.737814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.754104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ce82-e091-4554-9c4a-08bcd7e9a16f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.772924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.773610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.780747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.781092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.781939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.787921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.837084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.838825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:08.839995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2755/5460] 10.222.0.27 () {60 vars in 1184 bytes} [Sun Jul 24 01:33:08 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:08.862209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8849c-5a23-4314-b5ba-a9897e39ea3e tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.875880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.876791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.877090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.877377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.878166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=2e0d8634c9434de38e9932ef14c9814a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.883271 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:08.883271 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:08.883271 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:08.885299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:08.937950 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2706/5461] 10.222.0.27 () {60 vars in 1284 bytes} [Sun Jul 24 01:33:08 2022] PATCH /identity/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a => generated 221 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:08.942093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:08.965023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8856d5-fb87-4945-a99b-6f21d7f6054b tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:08.987089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:08.987964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:08.988269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:08.988566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:08.990089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2e0d8634c9434de38e9932ef14c9814a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:08.992758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:09.007808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:09.010531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2756/5462] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:33:08 2022] GET /identity/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a => generated 221 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:09.027893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbce2-5f70-41fe-92f7-85e7e9fe164c tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:09.069881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece13d64152242c296196e3e8dafa21a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e03a789b53449ebb8a834e3c9ae88e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:09.070760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:09.075522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:09.075897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:09.076635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2e0d8634c9434de38e9932ef14c9814a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:09.078337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:09.078612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invalidating token cache because consumer 2e0d8634c9434de38e9932ef14c9814a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:09.093729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.103086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.148929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a4e4a20a-39ae-4a6e-be04-79264266973f tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2e0d8634c9434de38e9932ef14c9814a', 'request_id': 'req-a4e4a20a-39ae-4a6e-be04-79264266973f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.202572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2707/5463] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:33:09 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2e0d8634c9434de38e9932ef14c9814a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:09.204070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:09.207559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:09.369896 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:09.460869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06282ebe-d06a-4430-b9a2-2d81fd6dea05 tempest-OAUTHConsumersV3Test-1648949898 tempest-OAUTHConsumersV3Test-1648949898-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:09.476279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:09.477195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:09.477482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:09.477798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] PATH_INFO: `/v3/users/7957f23817604b718e468f2610045561` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:09.479534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7957f23817604b718e468f2610045561)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:09.484371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:09.703341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7957f23817604b718e468f2610045561'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.705411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7957f23817604b718e468f2610045561'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.730137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7957f23817604b718e468f2610045561'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.753299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7957f23817604b718e468f2610045561'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.803544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7957f23817604b718e468f2610045561'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:09.823956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2757/5464] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:09 2022] DELETE /identity/v3/users/7957f23817604b718e468f2610045561 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:09.825977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c322-942c-497a-87e1-367de8aaa22a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:09.826269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c322-942c-497a-87e1-367de8aaa22a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:09.826548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c322-942c-497a-87e1-367de8aaa22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:09.886954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e558c322-942c-497a-87e1-367de8aaa22a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:09.888187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e558c322-942c-497a-87e1-367de8aaa22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:10.140695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2708/5465] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:10.260455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:10.262426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:10.515013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96cbe-6415-4005-86bf-0ae6e7c60170 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:10.532884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:10.533799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:10.533885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:10.535177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:10.574465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:10.575959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:10.606594 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2758/5466] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:10.669559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:10.669962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:10.670313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:10.715056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:10.716445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:10.963052 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2709/5467] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:33:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:10.971454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:10.972932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:11.112162 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:11.157954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93bd3b-8795-4c86-b5ca-c43d8fefc828 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:11.171349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:11.173939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:11.174287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:11.174573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:11.210107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:11.214604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:11.236975 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2759/5468] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:12.110247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:12.111654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:12.149576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ff6e-2c5f-4bb3-a73c-f8773123a993 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:12.177687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:12.178918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:12.179038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:12.179287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] PATH_INFO: `/v3/projects/c5af0ebc50de4bd5aaebaa8fcb4733bc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:12.183009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5af0ebc50de4bd5aaebaa8fcb4733bc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:12.185011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:12.240010 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:12.334533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5af0ebc50de4bd5aaebaa8fcb4733bc', 'request_id': 'req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.350807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5af0ebc50de4bd5aaebaa8fcb4733bc', 'request_id': 'req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.367022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5af0ebc50de4bd5aaebaa8fcb4733bc', 'request_id': 'req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.391345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] The token cache is being invalidate because project c5af0ebc50de4bd5aaebaa8fcb4733bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:12.391838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.396365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bb8d8dc-d4a7-4c07-ac12-6ff2a6fda491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.402834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2710/5469] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:12 2022] DELETE /identity/v3/projects/c5af0ebc50de4bd5aaebaa8fcb4733bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:12.407680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:12.423964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41128c-575a-4433-9ba8-b30d25965146 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:12.472588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:12.472878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:12.473216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:12.515897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:12.518645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:12.573611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:12.583552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:12.589994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:12.590449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] PATH_INFO: `/v3/users/ece13d64152242c296196e3e8dafa21a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:12.593291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece13d64152242c296196e3e8dafa21a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:12.600841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:12.652358 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2711/5470] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:12.667670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:12.669850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:12.701348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece13d64152242c296196e3e8dafa21a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.702139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece13d64152242c296196e3e8dafa21a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.719084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece13d64152242c296196e3e8dafa21a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.730812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece13d64152242c296196e3e8dafa21a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.753302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-533cac11-107d-4310-833b-caa2b2db95ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece13d64152242c296196e3e8dafa21a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:12.764598 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2760/5471] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:12 2022] DELETE /identity/v3/users/ece13d64152242c296196e3e8dafa21a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:12.769311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6acc47-162c-4f8f-af07-3eac5ceca9e0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:12.827277 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:12.847685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:12.848607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:12.848969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:12.849320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:12.851369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:12.943056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:12.954764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:12.976843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2712/5472] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:13.657721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:13.658219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:13.658347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:13.702775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:13.703996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:13.734303 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2761/5473] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:13.757222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:13.758709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:13.796875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22d8-f87f-4741-9f78-d7038758ca90 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:13.820449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:13.821136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:13.821426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:13.830910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:13.865428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:13.867547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:13.883235 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2713/5474] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:13.915465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:13.918339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:14.211388 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:14.332098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9782f25-5a77-475a-b527-57cca5c9d248 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:14.346732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:14.348110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.349649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.350384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] PATH_INFO: `/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.352459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e03a789b53449ebb8a834e3c9ae88e0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:14.355248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:14.425745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:14.458660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a12c-1688-4980-adae-d39deba300a4 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:14.493301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e03a789b53449ebb8a834e3c9ae88e0', 'request_id': 'req-7689c1cb-6d2f-4a91-b162-117c96478161'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:14.510626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e03a789b53449ebb8a834e3c9ae88e0', 'request_id': 'req-7689c1cb-6d2f-4a91-b162-117c96478161'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:14.530176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e03a789b53449ebb8a834e3c9ae88e0', 'request_id': 'req-7689c1cb-6d2f-4a91-b162-117c96478161'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:14.564118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] The token cache is being invalidate because project 2e03a789b53449ebb8a834e3c9ae88e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:14.565648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:14.567727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7689c1cb-6d2f-4a91-b162-117c96478161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:14.571193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2762/5475] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:13 2022] DELETE /identity/v3/projects/2e03a789b53449ebb8a834e3c9ae88e0 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:14.576369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07f9b-8cf6-4b89-97cf-aaac16e778b1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.576830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07f9b-8cf6-4b89-97cf-aaac16e778b1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.577251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07f9b-8cf6-4b89-97cf-aaac16e778b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.601219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4ac07f9b-8cf6-4b89-97cf-aaac16e778b1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:14.603363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4ac07f9b-8cf6-4b89-97cf-aaac16e778b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:14.681442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:14.683401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.685638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.685979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.691937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:14.699963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2763/5476] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:14.706949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.707706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.708228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.751921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:14.755941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:14.773544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2764/5477] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:14.776908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:14.799812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da3e0-a0dd-40ba-be7b-c6b278d54f5d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:14.812414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:14.814101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.815367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.816596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.817773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:14.819003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:14.822324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:14.851818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:14.855951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:14.857897 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2765/5478] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:14.862119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:14.882697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2714/5479] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:33:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:33:14.886299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11feab-5c7a-4d85-a366-e266b8aefcbc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:14.892772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:14.893582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:14.894017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:14.894401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:14.895222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:14.897253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:14.964660 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2766/5480] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:14 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:14.968925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:14.985207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d210a-32d6-48aa-8d34-5510d5591c13 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:15.017130 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:15.160095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:15.163340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:15.167632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:15.168087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:15.168984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:15.174840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:15.305402 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2715/5481] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:14 2022] POST /identity/v3/users => generated 285 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:15.309814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:15.331528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f482a3-17a9-477a-8166-6fd1db0e1d0c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:15.409012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:15.412061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:15.412526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:15.414088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:15.415052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:15.418754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:15.470478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2767/5482] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:15.476108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:15.506724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889788d-2182-446d-9518-2a3b4723fec6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:15.525968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:15.527342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:15.529085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:15.529694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:15.532219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:15.534022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0293a2-abfe-4dc9-b7a1-3f5a7e265095 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:15.575243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2716/5483] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:15.578676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:15.612641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ee6b-6b30-4706-b806-0d70828fae71 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:15.670355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:15.673026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:15.673317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:15.678932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] PATH_INFO: `/v3/projects/0305ca2504a24dbc84f0bc7b0f04da52/users/173f3afb03ab4b02b71a3e7c0f103598/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:15.777946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0305ca2504a24dbc84f0bc7b0f04da52, user_id=173f3afb03ab4b02b71a3e7c0f103598, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:15.787219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:15.862681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2768/5484] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:15 2022] PUT /identity/v3/projects/0305ca2504a24dbc84f0bc7b0f04da52/users/173f3afb03ab4b02b71a3e7c0f103598/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:15.870084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:15.871316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:15.873583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:15.990682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] MFA Rules not processed for user `173f3afb03ab4b02b71a3e7c0f103598`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:16.002150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:16.274551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2717/5485] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:16.280800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:16.290499 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:16.423595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c873cc-7d37-4bdf-8f22-aeadcb61c1be admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:16.435366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:16.436031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:16.438467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:16.438739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:16.439529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:16.443831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:16.531004 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2769/5486] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:16 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:16.531842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:16.538321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:16.541545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:16.549091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac1e4-346d-4cc8-8134-eed97bccc4dc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:16.739457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551b7c-9867-4597-855b-ceb51c242107 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:16.743265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:16.744723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:16.745204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:16.752943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:16.759657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:16.775571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:16.779483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:16.780457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:16.781348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:16.782740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:16.786522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:16.825397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2718/5487] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:16 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:16.826412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:16.851621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3c18-3ede-462e-99b5-8e1aeb62ecfb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:16.866990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:16.871006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:16.871577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:16.871680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:16.874730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:16.876398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:16.902208 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2719/5488] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:16.929398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:16.940872 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:16.954402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:16.955866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:16.956126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb325e-6b2b-41ed-a9ca-fe6c91d18e1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:16.962875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:16.975671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:16.976429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:16.976914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] PATH_INFO: `/v3/projects/ed63fc729b3449a197957abc2079c288/users/9c64be7b028c4765b1acf131980ae5d7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:16.990247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2770/5489] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:17.026575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed63fc729b3449a197957abc2079c288, user_id=9c64be7b028c4765b1acf131980ae5d7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:17.029914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:17.055138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2720/5490] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:16 2022] PUT /identity/v3/projects/ed63fc729b3449a197957abc2079c288/users/9c64be7b028c4765b1acf131980ae5d7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:17.059214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:17.077234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483d567-6040-4460-80fe-d74bec9dea5a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:17.161902 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:17.235563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:17.236556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:17.238743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:17.239174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:17.241235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:17.244439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3daf7-7a5e-4f58-ad5a-f93c3a4dfddb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:17.263954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2771/5491] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:17.268221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:17.308114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9f14-f70a-4494-94c6-f1bafee6360c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:17.319922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:17.325555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:17.328240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:17.328632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] PATH_INFO: `/v3/projects/ed63fc729b3449a197957abc2079c288/users/9c64be7b028c4765b1acf131980ae5d7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:17.334240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed63fc729b3449a197957abc2079c288, user_id=9c64be7b028c4765b1acf131980ae5d7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:17.340508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:17.360874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2721/5492] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:17 2022] PUT /identity/v3/projects/ed63fc729b3449a197957abc2079c288/users/9c64be7b028c4765b1acf131980ae5d7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:17.372856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:17.373941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:17.374337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:17.470968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] MFA Rules not processed for user `9c64be7b028c4765b1acf131980ae5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:17.473796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:17.748177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2772/5493] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:17.755230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:17.816476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2abc-f1d7-4502-9bde-161138177e81 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:17.845164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:17.846904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:17.847224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:17.847521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:17.848426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:17.851334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:17.914135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:17.914279 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2722/5494] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:17 2022] POST /identity/v3/projects => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:17.925734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a95a-0f12-4aba-bd9c-8eee333e7fdc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.066212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.066945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.067136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.067622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.068516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.071923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:18.127427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2773/5495] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:17 2022] POST /identity/v3/users => generated 416 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:18.131748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:18.156713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e6500-e201-4f3b-bbca-8bc7c04e3ff9 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.177202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.184311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.184955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.185452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/users/a294a2d18ed04695879058ef4c68b324` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.243051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_user(user_id=a294a2d18ed04695879058ef4c68b324)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.245664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:18.250688 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2723/5496] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:33:18 2022] GET /identity/v3/users/a294a2d18ed04695879058ef4c68b324 => generated 416 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:18.251906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:18.291484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:18.295215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:18.300599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31a146-ebb3-4d87-ac89-fcc0e3a62d3f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.330438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.331485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.331700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.341088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/users/a294a2d18ed04695879058ef4c68b324` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.345193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a294a2d18ed04695879058ef4c68b324)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.347357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:18.514034 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:18.560569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a294a2d18ed04695879058ef4c68b324'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:18.561615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a294a2d18ed04695879058ef4c68b324'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:18.603695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a294a2d18ed04695879058ef4c68b324'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:18.616655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de217-882f-49cd-89de-63644baeee42 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.620325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a294a2d18ed04695879058ef4c68b324'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:18.639881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6e1fe780dd48059853d5f5689251a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad8a68afdcb4f82a9f13d7883e26281', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.640760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.641213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.641647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.642585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:18.643127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.644977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:18.658841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a294a2d18ed04695879058ef4c68b324'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:18.671938 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2774/5497] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:18 2022] DELETE /identity/v3/users/a294a2d18ed04695879058ef4c68b324 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:18.683604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:18.684664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2724/5498] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:33:18.685750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:18.688165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:18.692013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:18.745991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b34a-257a-41dc-a795-53474dc352be tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.922603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6e1fe780dd48059853d5f5689251a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad8a68afdcb4f82a9f13d7883e26281', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.925134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.925480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.925723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.926448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.928672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134ad1-f9c5-471f-a5b0-d01784e1f308 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:18.933844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:18.943245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:18.944144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:18.944432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:18.944726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/e6f315458e0f4d56a71558f451b5c446` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:18.952125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e6f315458e0f4d56a71558f451b5c446)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:18.954105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.025099 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2725/5499] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:18 2022] POST /identity/v3/projects => generated 348 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:19.033254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.054228 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:19.072208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f315458e0f4d56a71558f451b5c446', 'request_id': 'req-6bd5962e-6eda-495b-8926-a547dddedc05'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.093179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f315458e0f4d56a71558f451b5c446', 'request_id': 'req-6bd5962e-6eda-495b-8926-a547dddedc05'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.110319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f315458e0f4d56a71558f451b5c446', 'request_id': 'req-6bd5962e-6eda-495b-8926-a547dddedc05'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.148189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project e6f315458e0f4d56a71558f451b5c446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:19.148482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.150044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.152219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2775/5500] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:18 2022] DELETE /identity/v3/projects/e6f315458e0f4d56a71558f451b5c446 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:19.156902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.160695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:19.188205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82893df4-fd26-4d78-8f03-f6198dc89dd4 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.268073 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:19.325804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5962e-6eda-495b-8926-a547dddedc05 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.343170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:19.343991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:19.344250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:19.344753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:19.345917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:19.352040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.359555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6e1fe780dd48059853d5f5689251a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad8a68afdcb4f82a9f13d7883e26281', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:19.360218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:19.360504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:19.360780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:19.361734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:19.362241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:19.365003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.387817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2776/5501] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:19 2022] POST /identity/v3/projects => generated 348 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:19.391521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.393878 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2726/5502] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:19.500940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0269da-6225-468a-9ed8-b9647046c7e6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.508625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:19.514172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:19.515190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:19.515710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:19.517097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:19.517605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:19.521876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.546120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2777/5503] 10.222.0.27 () {58 vars in 1159 bytes} [Sun Jul 24 01:33:19 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:33:19.550142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.570232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e1abd-3505-43de-841d-bdf99df039e7 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.592259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:19.593172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:19.593550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:19.593960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:19.594795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:19.596532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.603721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.605768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:19.643983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2727/5504] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:33:19 2022] GET /identity/v3/domains => generated 829 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:19.647954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.681004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f85b-aceb-4604-a267-aa93de027592 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.692330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:19.694224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:19.694520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:19.695890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/f40288c399dd4ffbae0433ab926b7ffe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:19.698673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_project(project_id=f40288c399dd4ffbae0433ab926b7ffe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:19.705890 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:19.705890 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:33:19.705890 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:33:19.707000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:19.750563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.755553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.840484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.842906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:19.851194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2728/5505] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:33:19 2022] PATCH /identity/v3/projects/f40288c399dd4ffbae0433ab926b7ffe => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:19.852289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7547-2008-43c4-8c99-aef9762342b3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:19.878688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:19.882849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:20.081643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:20.082350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:20.082684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:20.082986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:20.092396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:20.131851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8f9b8-51cc-486f-bacb-406148cb9be5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:20.139362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:20.140977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:20.141542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:20.142078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/f40288c399dd4ffbae0433ab926b7ffe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:20.146131 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:20.162540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f40288c399dd4ffbae0433ab926b7ffe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:20.170025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:20.203148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.217803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.280387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.293034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.303014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.310238 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:20.328446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project f40288c399dd4ffbae0433ab926b7ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:20.328978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.329879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.340278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.359439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.381221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f40288c399dd4ffbae0433ab926b7ffe', 'request_id': 'req-2da76968-65ab-41ee-b15a-2ee3ea4749dc'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:20.408827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2729/5506] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:19 2022] DELETE /identity/v3/projects/f40288c399dd4ffbae0433ab926b7ffe => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:20.416306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:20.422768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:20.450544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:20.452280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:20.492255 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2778/5507] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 889 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:20.600025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76968-65ab-41ee-b15a-2ee3ea4749dc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:20.611318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:20.612504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:20.613004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:20.613453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:20.614451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:20.618547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:20.706478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2730/5508] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:20 2022] POST /identity/v3/projects => generated 360 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:20.709064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:20.728388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0fe47-5352-4cd3-8724-4c8d799695e2 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:20.851245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:20.852561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:20.853277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:20.854352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/a33ebafaac5f42a8834aced964ea7108` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:20.855801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=a33ebafaac5f42a8834aced964ea7108)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:20.859261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:20.862144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2779/5509] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:20 2022] GET /identity/v3/projects/a33ebafaac5f42a8834aced964ea7108 => generated 360 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:20.866128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:20.888953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a5cc-895f-4959-9ebe-089c83521674 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:20.903609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:20.904554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:20.905138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:20.906129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/a33ebafaac5f42a8834aced964ea7108` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:20.907848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a33ebafaac5f42a8834aced964ea7108)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:20.918261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:20.993955 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:21.029510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.032056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.072401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33ebafaac5f42a8834aced964ea7108', 'request_id': 'req-5c65cd02-7ab8-477e-b133-c5edd2e9406a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.100068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33ebafaac5f42a8834aced964ea7108', 'request_id': 'req-5c65cd02-7ab8-477e-b133-c5edd2e9406a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.139497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33ebafaac5f42a8834aced964ea7108', 'request_id': 'req-5c65cd02-7ab8-477e-b133-c5edd2e9406a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.160639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84391-7f22-49c8-9819-342410adb25b tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:21.164738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project a33ebafaac5f42a8834aced964ea7108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:21.165243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.166132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.168364 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2731/5510] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:20 2022] DELETE /identity/v3/projects/a33ebafaac5f42a8834aced964ea7108 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:21.182860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.184911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.319900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b6e1fe780dd48059853d5f5689251a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fad8a68afdcb4f82a9f13d7883e26281', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:21.321385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:21.341824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:21.342403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] PATH_INFO: `/v3/projects/bf5573d1b09a4ecdba0e56c286c845a7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:21.348292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf5573d1b09a4ecdba0e56c286c845a7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:21.373949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:21.388144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd02-7ab8-477e-b133-c5edd2e9406a tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:21.394056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:21.395406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:21.396149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:21.396543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:21.397493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:21.400029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:21.451174 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2732/5511] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:21 2022] POST /identity/v3/projects => generated 359 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:21.457435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.505112 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:21.541756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5573d1b09a4ecdba0e56c286c845a7', 'request_id': 'req-bcf9da65-2914-4ca6-b3ff-efd335aea203'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.562895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5573d1b09a4ecdba0e56c286c845a7', 'request_id': 'req-bcf9da65-2914-4ca6-b3ff-efd335aea203'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.575760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5573d1b09a4ecdba0e56c286c845a7', 'request_id': 'req-bcf9da65-2914-4ca6-b3ff-efd335aea203'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.581991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1027c-dfb5-4289-a66c-20d7a16da8cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:21.597098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] The token cache is being invalidate because project bf5573d1b09a4ecdba0e56c286c845a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:21.597341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.599134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.604320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2780/5512] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:21 2022] DELETE /identity/v3/projects/bf5573d1b09a4ecdba0e56c286c845a7 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:21.621138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.622697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.638634 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:21.669452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:21.670871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:21.671314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:21.671723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/6dc704fed59848b594357c1336579a0a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:21.673861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=6dc704fed59848b594357c1336579a0a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:21.676796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:21.680508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2733/5513] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:21 2022] GET /identity/v3/projects/6dc704fed59848b594357c1336579a0a => generated 359 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:21.683918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.686123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.716020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4b7ae-d98b-4f28-8315-dc1b1c9b881c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:21.729500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:21.730504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:21.730851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:21.731133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/6dc704fed59848b594357c1336579a0a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:21.732862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6dc704fed59848b594357c1336579a0a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:21.735558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:21.738753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9da65-2914-4ca6-b3ff-efd335aea203 tempest-RoutersIpV6AdminTest-822218436 tempest-RoutersIpV6AdminTest-822218436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:21.751546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:21.752483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:21.754918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:21.756854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:21.763349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.845124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc704fed59848b594357c1336579a0a', 'request_id': 'req-a889d148-5274-436e-abe2-bcd1d37436eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.854545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc704fed59848b594357c1336579a0a', 'request_id': 'req-a889d148-5274-436e-abe2-bcd1d37436eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.862027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc704fed59848b594357c1336579a0a', 'request_id': 'req-a889d148-5274-436e-abe2-bcd1d37436eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.902241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 6dc704fed59848b594357c1336579a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:21.902529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.903442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:21.905546 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2734/5514] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:21 2022] DELETE /identity/v3/projects/6dc704fed59848b594357c1336579a0a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:21.911124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:21.913411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:21.926971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:21.929417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:21.948500 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2781/5515] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:22.018794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889d148-5274-436e-abe2-bcd1d37436eb tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.036228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.037343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.037824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.038296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.039321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.041649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:22.109494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2735/5516] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:33:21 2022] POST /identity/v3/projects => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:22.112584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:22.143774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1969-7a12-4a9a-a556-8794ae4c0c83 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.223233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.224119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.224404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.224677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/3dd2987bf5294de9bddfcde0967576c2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.226343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=3dd2987bf5294de9bddfcde0967576c2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.229354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:22.231649 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2782/5517] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:22 2022] GET /identity/v3/projects/3dd2987bf5294de9bddfcde0967576c2 => generated 347 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:22.236097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:22.266550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bce2a-3b34-4cdc-8780-5ba64f5a726d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.287563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.287904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.288364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.288769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/3dd2987bf5294de9bddfcde0967576c2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.292168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3dd2987bf5294de9bddfcde0967576c2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.301247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:22.465718 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:22.469688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd2987bf5294de9bddfcde0967576c2', 'request_id': 'req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:22.489761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd2987bf5294de9bddfcde0967576c2', 'request_id': 'req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:22.510918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd2987bf5294de9bddfcde0967576c2', 'request_id': 'req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:22.543369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 3dd2987bf5294de9bddfcde0967576c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:22.543604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:22.547516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:22.553744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2736/5518] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:22 2022] DELETE /identity/v3/projects/3dd2987bf5294de9bddfcde0967576c2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:22.558728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:22.560799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:22.594118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1f59a-7d0e-434e-a967-59ad2571fa79 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.624176 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:22.647769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:22.650474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:22.765803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc006b-595a-4a53-b5c6-fe7070e9ad0c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.771126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.772069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.772522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.772971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.775095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:22.798556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.799963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.800256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.800538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.801409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.809519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:22.838700 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2783/5519] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:33:22 2022] POST /identity/v3/domains => generated 277 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:22.842872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:22.889893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.891664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:22.941511 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2737/5520] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:22.956670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15036f6b-3b49-4012-8882-827d427c914f tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:22.970711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:22.971412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:22.971707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:22.974149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:22.976720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:22.983501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:23.066130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2784/5521] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:22 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:23.068774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:23.137041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb66b2e-0ad0-46c2-868c-567a820768c1 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:23.299737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:23.300982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:23.301331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:23.301816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/bdc8d1b3e502479b93dd43b7e7e2663c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:23.304293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=bdc8d1b3e502479b93dd43b7e7e2663c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:23.307179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:23.315196 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2738/5522] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:23 2022] GET /identity/v3/projects/bdc8d1b3e502479b93dd43b7e7e2663c => generated 405 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:23.316041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:23.335064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475e5a-6b5b-428e-b9d0-d24bbf5f3739 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:23.354165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:23.355080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:23.356008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:23.356561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/bdc8d1b3e502479b93dd43b7e7e2663c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:23.358018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bdc8d1b3e502479b93dd43b7e7e2663c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:23.360099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:23.489594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc8d1b3e502479b93dd43b7e7e2663c', 'request_id': 'req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.505381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc8d1b3e502479b93dd43b7e7e2663c', 'request_id': 'req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.522071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc8d1b3e502479b93dd43b7e7e2663c', 'request_id': 'req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.557172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project bdc8d1b3e502479b93dd43b7e7e2663c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:23.557470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.558480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.560422 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2785/5523] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:23 2022] DELETE /identity/v3/projects/bdc8d1b3e502479b93dd43b7e7e2663c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:23.564585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:23.567132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:23.610203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4162d9-92f7-45fa-a344-9c94ce84ab28 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:23.647655 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:23.752481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:23.754694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:23.757278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:23.758549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:23.763988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7ce24037a9e74a90ab913dd76b5ad5c6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:23.763988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:23.795101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.796273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.848950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.848950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:23.864846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:23.865654 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2739/5524] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:33:23 2022] PATCH /identity/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6 => generated 278 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:23.879654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ed6f1-ad55-4979-bcb2-4c6ca9363a1d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:23.892208 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:24.024355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:24.025782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:24.026077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:24.026357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:24.056588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7ce24037a9e74a90ab913dd76b5ad5c6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:24.060179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:24.153497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.210787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.329227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.342628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.358553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.379308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 7ce24037a9e74a90ab913dd76b5ad5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:24.379610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.380381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.398873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.400165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.400798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7ce24037a9e74a90ab913dd76b5ad5c6', 'request_id': 'req-5e492c0e-81db-4f7c-b9be-fea8068278ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:24.419757 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2786/5525] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:23 2022] DELETE /identity/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:24.424877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:24.426487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:24.450018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef01e2-cfbf-41be-936b-ebed8da99dd0 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:24.639604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:24.640354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:24.640655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:24.640941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:24.641755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:24.653971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:24.716664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2740/5526] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:33:24 2022] POST /identity/v3/domains => generated 276 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:24.721440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:24.723187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:24.750698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e492c0e-81db-4f7c-b9be-fea8068278ee tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:24.893938 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:24.935752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:24.940272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:24.940652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:24.941144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:24.944609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:24.948640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:25.089980 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2787/5527] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:24 2022] POST /identity/v3/projects => generated 409 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:25.094535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:25.122411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75745007-d293-49dc-9f18-56a98f8a2bba tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:25.277295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:25.278055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:25.278309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:25.278584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:25.280410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:25.289394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:25.387365 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:25.422051 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2741/5528] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:25 2022] POST /identity/v3/projects => generated 403 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:25.423037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:25.442233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c39c84-1364-4f61-917a-bdf26e0e8508 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:25.699298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:25.700213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:25.703282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:25.703570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/59f6e5810bb2412aa2f6d45d9db01ba3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:25.704992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59f6e5810bb2412aa2f6d45d9db01ba3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:25.715301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:25.810615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f6e5810bb2412aa2f6d45d9db01ba3', 'request_id': 'req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:25.817598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f6e5810bb2412aa2f6d45d9db01ba3', 'request_id': 'req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:25.832581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f6e5810bb2412aa2f6d45d9db01ba3', 'request_id': 'req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:25.881582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 59f6e5810bb2412aa2f6d45d9db01ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:25.882040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:25.883084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:25.889551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2788/5529] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:25 2022] DELETE /identity/v3/projects/59f6e5810bb2412aa2f6d45d9db01ba3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:25.893174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:25.895414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:25.937659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627167b-a1cb-4f90-9704-8b28fc9ada69 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:26.203289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:26.204676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:26.208492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:26.209128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/b1fd086833934b9da8d8c74b26a9c5ca` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:26.217434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1fd086833934b9da8d8c74b26a9c5ca)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:26.217434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:26.351603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fd086833934b9da8d8c74b26a9c5ca', 'request_id': 'req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.368805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fd086833934b9da8d8c74b26a9c5ca', 'request_id': 'req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.379697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fd086833934b9da8d8c74b26a9c5ca', 'request_id': 'req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.406303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project b1fd086833934b9da8d8c74b26a9c5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:26.406603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.414568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2538cc8a-61ba-40c7-abb9-b7fd9acf4f13 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.417305 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2742/5530] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:25 2022] DELETE /identity/v3/projects/b1fd086833934b9da8d8c74b26a9c5ca => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:26.421748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:26.439492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d15302-8e2a-4018-81e8-59cd3cbe75a6 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:26.554828 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:26.573092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:26.574298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:26.575304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:26.575304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/e8ea5a2c7c534507bc6f169df860631f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:26.576312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e8ea5a2c7c534507bc6f169df860631f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:26.578054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:26.613442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:26.616016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:26.616016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:26.644592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.645541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.662546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:26.663838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:26.693496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.694304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:26.703975 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2789/5531] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:33:26 2022] PATCH /identity/v3/domains/e8ea5a2c7c534507bc6f169df860631f => generated 277 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:26.705252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:26.709899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:26.805413 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2743/5532] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:26.855034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8909f2-0394-47b5-8d0d-b0238de84873 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:26.874710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:26.876295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:26.876295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:26.876502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/e8ea5a2c7c534507bc6f169df860631f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:26.916173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e8ea5a2c7c534507bc6f169df860631f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:26.919142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:26.979312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.003225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.099349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.120692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.141944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.183927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project e8ea5a2c7c534507bc6f169df860631f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:27.184266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.185011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.235478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.236893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.237163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e8ea5a2c7c534507bc6f169df860631f', 'request_id': 'req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:27.240007 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:27.264051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2790/5533] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:26 2022] DELETE /identity/v3/domains/e8ea5a2c7c534507bc6f169df860631f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:27.269657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:27.299840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02387-3f55-4575-95d8-7ba92af185d4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:27.362165 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:27.458282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:27.459549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:27.460021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:27.460777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:27.465532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:27.467666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:27.541337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2744/5534] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:27 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:27.542571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:27.544151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:27.567291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3934c4-465c-4aa2-85fb-74cde7fdf7e5 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:27.722641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:27.723323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:27.723583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:27.723882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/83651ffb7cf443c8808f2e9168c63e25` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:27.731993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=83651ffb7cf443c8808f2e9168c63e25)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:27.734155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:27.736376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2791/5535] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:27 2022] GET /identity/v3/projects/83651ffb7cf443c8808f2e9168c63e25 => generated 377 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:27.740266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:27.755792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1ac0d-ea2d-4640-8900-a8db1fb0fcf1 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:27.762296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:27.763842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:27.764112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:27.764394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:27.765162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:27.767286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:27.846222 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2745/5536] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:33:27 2022] GET /identity/v3/projects => generated 7300 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:27.861546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:27.880127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68ffa7-5a2b-4ab0-bc60-e6779711e5a7 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:27.901339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:27.902260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:27.902547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:27.903519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/83651ffb7cf443c8808f2e9168c63e25` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:27.911409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83651ffb7cf443c8808f2e9168c63e25)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:27.921484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:28.079479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83651ffb7cf443c8808f2e9168c63e25', 'request_id': 'req-05da5361-213b-45bf-9d97-62473a6b0b72'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:28.104928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83651ffb7cf443c8808f2e9168c63e25', 'request_id': 'req-05da5361-213b-45bf-9d97-62473a6b0b72'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:28.130681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83651ffb7cf443c8808f2e9168c63e25', 'request_id': 'req-05da5361-213b-45bf-9d97-62473a6b0b72'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:28.199475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 83651ffb7cf443c8808f2e9168c63e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:28.199952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:28.200756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:28.204382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2792/5537] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:27 2022] DELETE /identity/v3/projects/83651ffb7cf443c8808f2e9168c63e25 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:28.213624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:28.222397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:28.274038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6448-cf70-4aa8-96f4-44782703cc4d tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:28.591320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:28.592161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:28.600148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:28.602289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:28.604219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:28.611762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:28.753201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2746/5538] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:33:28 2022] POST /identity/v3/projects => generated 346 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:28.756747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:28.776967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da5361-213b-45bf-9d97-62473a6b0b72 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:29.022518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:29.023259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:29.023549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:29.023830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/b89fc5547f254a33b1de1e02f41965cf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:29.034815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_project(project_id=b89fc5547f254a33b1de1e02f41965cf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:29.036954 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:33:29.036954 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:33:29.036954 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:33:29.039491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:29.108217 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:29.132505 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2793/5539] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:33:28 2022] PATCH /identity/v3/projects/b89fc5547f254a33b1de1e02f41965cf => generated 361 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:29.138567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:29.154701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c58f-ff34-4464-a790-a77f80592399 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:29.171495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:29.174547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:29.174895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:29.175182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/b89fc5547f254a33b1de1e02f41965cf` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:29.215169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=b89fc5547f254a33b1de1e02f41965cf)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:29.217162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:29.227578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:29.231762 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2747/5540] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:29 2022] GET /identity/v3/projects/b89fc5547f254a33b1de1e02f41965cf => generated 348 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:29.271524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45b3d-fa64-4f96-9378-88f4aa42c675 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:29.305476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:29.315459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:29.315749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:29.322580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/b89fc5547f254a33b1de1e02f41965cf` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:29.325348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b89fc5547f254a33b1de1e02f41965cf)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:29.329374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:29.542295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89fc5547f254a33b1de1e02f41965cf', 'request_id': 'req-e7e45cd1-1a27-4726-ada7-b3d04402158c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:29.566991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89fc5547f254a33b1de1e02f41965cf', 'request_id': 'req-e7e45cd1-1a27-4726-ada7-b3d04402158c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:29.587643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89fc5547f254a33b1de1e02f41965cf', 'request_id': 'req-e7e45cd1-1a27-4726-ada7-b3d04402158c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:29.647688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project b89fc5547f254a33b1de1e02f41965cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:29.648038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:29.650445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:29.660007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2794/5541] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:29 2022] DELETE /identity/v3/projects/b89fc5547f254a33b1de1e02f41965cf => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:29.669074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:29.676303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:29.720511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901e382-7059-4054-beed-962b1e7c40c3 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:29.864559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:29.865257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:29.871176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:29.871475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:29.872247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:29.874289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:29.940022 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:30.032520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:30.054527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e45cd1-1a27-4726-ada7-b3d04402158c tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:30.058046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2748/5542] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:29 2022] POST /identity/v3/projects => generated 359 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:30.251183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:30.252071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:30.252351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:30.252626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:30.255913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_project(project_id=8a1ea12b782d4a9e9c0501e2d6e3359a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:30.259297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:30.397341 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2795/5543] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:33:30 2022] PATCH /identity/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a => generated 371 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:30.403955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:30.432850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dfdce-a100-4805-bb9c-21e58e53cfde tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:30.464624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:30.466541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:30.466935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:30.467321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:30.507127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a1ea12b782d4a9e9c0501e2d6e3359a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:30.514751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:30.520598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2749/5544] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:30 2022] GET /identity/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a => generated 358 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:30.523268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:30.563627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d96db-43af-4f4c-b30b-a3261272a737 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:30.586328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:30.593775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:30.594363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:30.597343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:30.606864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a1ea12b782d4a9e9c0501e2d6e3359a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:30.609142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:30.724419 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:30.775887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1ea12b782d4a9e9c0501e2d6e3359a', 'request_id': 'req-53ae2f21-ffb5-4b7d-9009-752ed78ec603'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:30.782743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1ea12b782d4a9e9c0501e2d6e3359a', 'request_id': 'req-53ae2f21-ffb5-4b7d-9009-752ed78ec603'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:30.803004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1ea12b782d4a9e9c0501e2d6e3359a', 'request_id': 'req-53ae2f21-ffb5-4b7d-9009-752ed78ec603'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:30.827630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 8a1ea12b782d4a9e9c0501e2d6e3359a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:30.827922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:30.832744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:30.838040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2796/5545] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:30 2022] DELETE /identity/v3/projects/8a1ea12b782d4a9e9c0501e2d6e3359a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:30.847280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:30.849600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:30.875104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea37afa-ce79-4a8a-8d3c-c8f6b4c0aead tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:31.017949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:31.018794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:31.020890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:31.022005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:31.022968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:31.028779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:31.096923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2750/5546] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:30 2022] POST /identity/v3/projects => generated 353 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:31.101235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:31.142222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae2f21-ffb5-4b7d-9009-752ed78ec603 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:31.227950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:31.230042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:31.381171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:31.382433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:31.384932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:31.385432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/2dcd75820c794b0fa427b82d7028464f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:31.391305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:update_project(project_id=2dcd75820c794b0fa427b82d7028464f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:31.395151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:31.518219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2797/5547] 10.222.0.27 () {60 vars in 1251 bytes} [Sun Jul 24 01:33:31 2022] PATCH /identity/v3/projects/2dcd75820c794b0fa427b82d7028464f => generated 367 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:31.526018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:31.563598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ca9a-4c6f-4db7-a61b-7850844391c2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:31.564615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7113-225c-45eb-8667-0ac2fac88580 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:31.582441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:31.583899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:31.584803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:31.586382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:31.594561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:31.595400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] PATH_INFO: `/v3/users/014d9b85786b4a22b71463e346159fc4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:31.596716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:31.597263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/2dcd75820c794b0fa427b82d7028464f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:31.598257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=014d9b85786b4a22b71463e346159fc4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:31.601434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:31.671383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:get_project(project_id=2dcd75820c794b0fa427b82d7028464f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:31.691720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:31.729162 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2798/5548] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:33:31 2022] GET /identity/v3/projects/2dcd75820c794b0fa427b82d7028464f => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:31.737781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:31.773533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cabb89-8981-42ac-90d7-74ad0007f402 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:31.788375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:31.788375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:31.790541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:31.790541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/projects/2dcd75820c794b0fa427b82d7028464f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:31.794325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2dcd75820c794b0fa427b82d7028464f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:31.794325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:31.807947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014d9b85786b4a22b71463e346159fc4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:31.858517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014d9b85786b4a22b71463e346159fc4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:31.927249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014d9b85786b4a22b71463e346159fc4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:31.958898 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:31.974359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcd75820c794b0fa427b82d7028464f', 'request_id': 'req-0add08ae-ba79-42b3-b012-bdde85fda3cc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.002018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcd75820c794b0fa427b82d7028464f', 'request_id': 'req-0add08ae-ba79-42b3-b012-bdde85fda3cc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.022983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcd75820c794b0fa427b82d7028464f', 'request_id': 'req-0add08ae-ba79-42b3-b012-bdde85fda3cc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.030568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014d9b85786b4a22b71463e346159fc4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.031435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014d9b85786b4a22b71463e346159fc4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.042048 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2751/5549] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:31 2022] DELETE /identity/v3/users/014d9b85786b4a22b71463e346159fc4 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:32.127938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] The token cache is being invalidate because project 2dcd75820c794b0fa427b82d7028464f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:32.128414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.138652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.142223 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2799/5550] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:31 2022] DELETE /identity/v3/projects/2dcd75820c794b0fa427b82d7028464f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:32.149102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:32.152393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:32.298510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd12c6-4806-49b7-8bb5-094d4183f7fb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:32.306392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:32.311028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.314361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.314983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/e8ea5a2c7c534507bc6f169df860631f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.338655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Could not find domain: e8ea5a2c7c534507bc6f169df860631f.: keystone.exception.DomainNotFound: Could not find domain: e8ea5a2c7c534507bc6f169df860631f. Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e8ea5a2c7c534507bc6f169df860631f. Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:33:32.362770 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:33:32.363989 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e8ea5a2c7c534507bc6f169df860631f. Jul 24 01:33:32.365190 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:33:32.368582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:32.370793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:32.374591 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2752/5551] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:33:32 2022] PATCH /identity/v3/domains/e8ea5a2c7c534507bc6f169df860631f => generated 112 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:33:32.393774 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:32.462204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add08ae-ba79-42b3-b012-bdde85fda3cc tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:32.468936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c64be7b028c4765b1acf131980ae5d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed63fc729b3449a197957abc2079c288', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:32.471114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.482197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.482641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] PATH_INFO: `/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.490738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Could not find domain: 7ce24037a9e74a90ab913dd76b5ad5c6.: keystone.exception.DomainNotFound: Could not find domain: 7ce24037a9e74a90ab913dd76b5ad5c6. Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7ce24037a9e74a90ab913dd76b5ad5c6. Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:33:32.508878 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:33:32.510380 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7ce24037a9e74a90ab913dd76b5ad5c6. Jul 24 01:33:32.511624 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:33:32.514442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:32.516224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:32.529698 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2800/5552] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:33:32 2022] PATCH /identity/v3/domains/7ce24037a9e74a90ab913dd76b5ad5c6 => generated 112 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:33:32.570079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:32.572314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:32.702327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655f49-f79b-4797-8286-2d35718bf8ef tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:32.718019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:32.719308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.719936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.720391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] PATH_INFO: `/v3/users/173f3afb03ab4b02b71a3e7c0f103598` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.722005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173f3afb03ab4b02b71a3e7c0f103598)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:32.724244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:32.736029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc95947-a35d-420a-b2ef-ae2e0468a5f2 tempest-ProjectsTestJSON-1961543436 tempest-ProjectsTestJSON-1961543436-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:32.748414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:32.748668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.748774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.749022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] PATH_INFO: `/v3/projects/da60c4b9da1b4445a038238d0db2927e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.752842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da60c4b9da1b4445a038238d0db2927e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:32.756330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:32.824073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173f3afb03ab4b02b71a3e7c0f103598'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.854363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173f3afb03ab4b02b71a3e7c0f103598'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.859717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da60c4b9da1b4445a038238d0db2927e', 'request_id': 'req-c009214f-ed24-4b6f-b96f-badb77b5bac1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.866010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173f3afb03ab4b02b71a3e7c0f103598'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.868486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da60c4b9da1b4445a038238d0db2927e', 'request_id': 'req-c009214f-ed24-4b6f-b96f-badb77b5bac1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.887495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173f3afb03ab4b02b71a3e7c0f103598'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.887495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2d2ccd4d-33f9-4a50-9295-fe071300a519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173f3afb03ab4b02b71a3e7c0f103598'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.890238 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:32.891796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da60c4b9da1b4445a038238d0db2927e', 'request_id': 'req-c009214f-ed24-4b6f-b96f-badb77b5bac1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.894064 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2753/5553] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:32 2022] DELETE /identity/v3/users/173f3afb03ab4b02b71a3e7c0f103598 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:32.898866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.900773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.900773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.915949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] The token cache is being invalidate because project da60c4b9da1b4445a038238d0db2927e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:32.916666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.917553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c009214f-ed24-4b6f-b96f-badb77b5bac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:32.920532 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2801/5554] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:32 2022] DELETE /identity/v3/projects/da60c4b9da1b4445a038238d0db2927e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:32.925698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7245e-c06e-4e13-a883-c141c6ac08df None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:32.926119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7245e-c06e-4e13-a883-c141c6ac08df None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:32.926442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:32.926587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7245e-c06e-4e13-a883-c141c6ac08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:32.927811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:32.955982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0ea7245e-c06e-4e13-a883-c141c6ac08df None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:32.958084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ea7245e-c06e-4e13-a883-c141c6ac08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:33.011344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2754/5555] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:33.017225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.019370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:33.021385 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:33.049347 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2802/5556] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:33.058174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.058463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.058742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.080426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:33.082141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:33.093737 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2803/5557] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:33.095641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.112316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bd5cd-55f5-4bd5-8e7e-918ec38a4d64 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.122406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.123254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.123636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.124037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.125053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:33.125289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.127586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.128881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9676a-b15c-406c-adc0-7bd63f0dd9a2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.132996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.134500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.134790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.135066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.147707 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2804/5558] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:33:33.152550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.154637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.156157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.169455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a14f1-292f-457b-9f5b-d5ccded5e1a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.177067 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2755/5559] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:33.188269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.192960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.193705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.194084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.194933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.201400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.268486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2805/5560] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:33 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:33.275505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.299161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712c41a-132e-4e58-993c-ebfa45ad5d5e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.475970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.476208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.476445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.476671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.477446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.480784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.544700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.550518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2756/5561] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:33 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:33.558759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7c75-544d-4d7e-a1af-833c368dc927 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.566189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.567233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.567790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.568293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.569119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.571785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.601920 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2806/5562] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:33.611613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.626398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5058-f7b2-4e01-aa64-b0024e46c75d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.640953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.642061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.642654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.643259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.645313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.648625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a06618-089d-4c59-97ec-e4e731e6b352 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.666942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.672629 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2757/5563] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:33.678131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada12dd-25f3-4d63-bc01-334444f641df admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.683659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.684564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.684848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.685125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] PATH_INFO: `/v3/projects/109467986076453b893b8720a2b1144a/users/4611d01617d645579ae3529c8f8f9de2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.707138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109467986076453b893b8720a2b1144a, user_id=4611d01617d645579ae3529c8f8f9de2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.710201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:33.728729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2807/5564] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:33 2022] PUT /identity/v3/projects/109467986076453b893b8720a2b1144a/users/4611d01617d645579ae3529c8f8f9de2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:33.736984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.738131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.738779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.764127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:33.765789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:33.793815 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:33.897957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.900646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:33.913777 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2758/5565] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:33.919316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792d90d-c9b0-4ca6-8a8c-b316774e1892 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:33.933539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:33.933539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:33.933539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:33.933539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] PATH_INFO: `/v3/projects/0305ca2504a24dbc84f0bc7b0f04da52` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:33.937730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0305ca2504a24dbc84f0bc7b0f04da52)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:33.941992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:33.943621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:34.036860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0305ca2504a24dbc84f0bc7b0f04da52', 'request_id': 'req-f23f921d-c1fd-4e1c-b00f-661576c88cc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.058413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0305ca2504a24dbc84f0bc7b0f04da52', 'request_id': 'req-f23f921d-c1fd-4e1c-b00f-661576c88cc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.061215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde31886-5b05-4136-a4c8-687b65470e5e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:34.075655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0305ca2504a24dbc84f0bc7b0f04da52', 'request_id': 'req-f23f921d-c1fd-4e1c-b00f-661576c88cc2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.099333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] The token cache is being invalidate because project 0305ca2504a24dbc84f0bc7b0f04da52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:34.099782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.101587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.110276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2808/5566] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:33 2022] DELETE /identity/v3/projects/0305ca2504a24dbc84f0bc7b0f04da52 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:34.112277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:34.117293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:34.214663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:34.215517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:34.215935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:34.216274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:34.222225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:34.257325 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:34.291775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f921d-c1fd-4e1c-b00f-661576c88cc2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:34.307819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:34.308896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:34.309278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:34.309656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] PATH_INFO: `/v3/users/9c64be7b028c4765b1acf131980ae5d7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:34.311959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c64be7b028c4765b1acf131980ae5d7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:34.315625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:34.395021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:34.396793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:34.424855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2759/5567] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:34.429808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c64be7b028c4765b1acf131980ae5d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.430743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c64be7b028c4765b1acf131980ae5d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.440953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c64be7b028c4765b1acf131980ae5d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.452611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c64be7b028c4765b1acf131980ae5d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.469810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fefc2cf4-f96d-44d5-8b4a-0bdb4e6b3284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c64be7b028c4765b1acf131980ae5d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:34.478145 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2809/5568] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:34 2022] DELETE /identity/v3/users/9c64be7b028c4765b1acf131980ae5d7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:36.505929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:36.534716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb35b-82c5-45d9-aa1d-e7a89a270571 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:36.649372 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:36.766633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:36.767554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:36.767837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:36.768114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] PATH_INFO: `/v3/projects/ed63fc729b3449a197957abc2079c288` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:36.769515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed63fc729b3449a197957abc2079c288)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:36.771516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:36.870611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed63fc729b3449a197957abc2079c288', 'request_id': 'req-22f924cb-aca9-4aa1-af0d-a2ba18072587'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:36.886230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed63fc729b3449a197957abc2079c288', 'request_id': 'req-22f924cb-aca9-4aa1-af0d-a2ba18072587'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:36.897474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed63fc729b3449a197957abc2079c288', 'request_id': 'req-22f924cb-aca9-4aa1-af0d-a2ba18072587'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:36.919986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] The token cache is being invalidate because project ed63fc729b3449a197957abc2079c288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:36.921255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:36.922403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22f924cb-aca9-4aa1-af0d-a2ba18072587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:36.932875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:36.933950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:36.934509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:36.935400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2760/5569] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:36 2022] DELETE /identity/v3/projects/ed63fc729b3449a197957abc2079c288 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:36.974322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:36.975730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:37.116887 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2810/5570] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:37.132424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.132742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.135611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.170337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:37.171786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:37.186975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2761/5571] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:37.188319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.204563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305aa9-2cc6-461f-8d5e-cfd63fbedb84 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.216915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.224648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.227524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.231182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.232433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:37.234250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.236368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.271154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2811/5572] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:37.272098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.291149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d2cc-9723-4050-b7e5-a01079ee441e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.297429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.298762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.299209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.299659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.300620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.303669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.373936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2762/5573] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:37 2022] POST /identity/v3/projects => generated 411 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:37.377415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.392847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd30c8-a781-40e6-8f22-2cf57f06d334 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.514343 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:37.524609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.527260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.527564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.530482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.531660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.541593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.606966 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2812/5574] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:37 2022] POST /identity/v3/users => generated 306 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:37.611216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.638001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86825ff-39fd-4bfa-b52e-2ddd1190f4f0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.660123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.660977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.661099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.661381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.662174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.663822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.714730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.726787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2763/5575] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:37.731586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dff88-3627-4eed-acec-8816f24e81a7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.748796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.749409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.749713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.749999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.750745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.752351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01597-a7e6-492e-acb5-3edc328efcbd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.779964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:37.790904 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2813/5576] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:37.795279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10659f9-ca5c-4549-8636-cc7576117240 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:37.809609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:37.810617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.811065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.811374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] PATH_INFO: `/v3/projects/3c632f0be94e4096a428a506c912c5b0/users/6bc3e21f81c5441d93bf0e3d9c273912/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:37.879110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c632f0be94e4096a428a506c912c5b0, user_id=6bc3e21f81c5441d93bf0e3d9c273912, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:37.886040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:37.918990 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2764/5577] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:37 2022] PUT /identity/v3/projects/3c632f0be94e4096a428a506c912c5b0/users/6bc3e21f81c5441d93bf0e3d9c273912/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:37.928828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:37.929135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:37.929425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.003746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] MFA Rules not processed for user `6bc3e21f81c5441d93bf0e3d9c273912`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:38.011244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:38.234811 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2814/5578] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:38.236010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:38.354397 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:38.384862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddc1b3-30af-4d39-ae4c-4e0fca782121 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:38.401426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:38.403279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:38.403733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:38.404178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.405229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:38.407607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:38.471771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2765/5579] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:38 2022] POST /identity/v3/projects => generated 411 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:38.475548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:38.494018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5253b75-ea2d-4ed5-86e7-30a9d9b90cef None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:38.578285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:38.579142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:38.579534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:38.579918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.580775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:38.582981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:38.619504 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2815/5580] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:38 2022] POST /identity/v3/users => generated 312 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:38.623292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:38.642881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f431dc-9cff-420d-8773-ff2bd3cc0c12 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:38.654085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:38.655051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:38.655519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:38.655988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.656909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:38.658756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:38.684024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2766/5581] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:38.688272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:38.703030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ca45-6d4a-4225-87cc-1a8033577407 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:38.719230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:38.720387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:38.720790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:38.721175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] PATH_INFO: `/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c/users/ea7d64dca2a14f71a666f228055f2b5d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.760567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a13b898acd45649d1de5bc8fd5c34c, user_id=ea7d64dca2a14f71a666f228055f2b5d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:38.768733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:38.792399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2816/5582] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:38 2022] PUT /identity/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c/users/ea7d64dca2a14f71a666f228055f2b5d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:38.796363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:38.810644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84e808-214d-4377-9fb6-f51f840e3473 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:38.962116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:38.962823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:38.963104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:38.963382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:38.964132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:38.978034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badf0a3-22fb-47f1-977e-8aa6ae36f557 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:38.995244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:39.000606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2767/5583] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:39.013763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7113d-f93b-4dbf-b3ca-7a7759f09a38 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:39.028547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:39.030264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:39.030264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:39.030740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] PATH_INFO: `/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c/users/ea7d64dca2a14f71a666f228055f2b5d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:39.037234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a13b898acd45649d1de5bc8fd5c34c, user_id=ea7d64dca2a14f71a666f228055f2b5d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:39.042783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:39.056292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2817/5584] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:38 2022] PUT /identity/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c/users/ea7d64dca2a14f71a666f228055f2b5d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:33:39.070181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:39.070386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:39.071283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:39.146515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] MFA Rules not processed for user `ea7d64dca2a14f71a666f228055f2b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:39.147743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:39.320197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2768/5585] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:39.352059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:39.354177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:39.394888 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:39.494592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4c711-738f-4275-b98d-5364a975c50e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:39.507042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:39.508918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:39.509313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:39.509717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:39.529964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:39.534655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f701b-55de-4d50-939d-039e262554dd service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:39.563626 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2818/5586] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:39.659423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:39.660962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:39.699009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71e7c-5b55-486a-b5ec-7b1dfd239ec4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:39.710583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:39.711195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:39.711728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:39.712143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:39.719744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:39.749322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:39.751160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:39.773913 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2769/5587] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:49.549045 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=18 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:49.767605 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:50.821464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:50.822091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:50.822203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:50.867449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] MFA Rules not processed for user `4611d01617d645579ae3529c8f8f9de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:50.868949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:51.013004 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2819/5588] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:51.033414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:51.038102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:51.040375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:51.207286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ac1ec-b916-4ca5-b10a-a51c7d87e9dc service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:51.214268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:51.215179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:51.215583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:51.215869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] PATH_INFO: `/v3/users/6bc3e21f81c5441d93bf0e3d9c273912` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:51.217297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc3e21f81c5441d93bf0e3d9c273912)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:51.219866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:51.240577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de71f3-29d0-45b6-9801-3023893719f2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:51.247760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:51.248908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:51.249316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:51.249877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:51.261006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:51.262830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c23859-1df3-43db-8203-34bca78d5539 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:51.277192 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2820/5589] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:51.342104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc3e21f81c5441d93bf0e3d9c273912'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:51.363476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc3e21f81c5441d93bf0e3d9c273912'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:51.387373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc3e21f81c5441d93bf0e3d9c273912'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:51.421754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc3e21f81c5441d93bf0e3d9c273912'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:51.424920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc3e21f81c5441d93bf0e3d9c273912'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:51.448600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2770/5590] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:51 2022] DELETE /identity/v3/users/6bc3e21f81c5441d93bf0e3d9c273912 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:51.453652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:51.453974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:51.454725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:51.487761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:51.489007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:51.637798 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2821/5591] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:51.661613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:51.664591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:51.840041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311fb8a-7629-4568-bb75-96679f1b3422 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:51.846621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:51.847693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:51.849000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:51.849573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:51.868874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:51.870894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:51.894782 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2771/5592] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:33:53.183935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:53.185380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:53.216060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a375-303a-435b-8707-8b92ed0be410 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:53.231791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:53.232545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:53.232827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:53.233323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] PATH_INFO: `/v3/projects/3c632f0be94e4096a428a506c912c5b0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:53.242384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c632f0be94e4096a428a506c912c5b0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:53.244348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:53.268900 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:53.345213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c632f0be94e4096a428a506c912c5b0', 'request_id': 'req-299f0dbb-794c-46ba-b374-a7d7adc92286'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.356565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c632f0be94e4096a428a506c912c5b0', 'request_id': 'req-299f0dbb-794c-46ba-b374-a7d7adc92286'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.375973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c632f0be94e4096a428a506c912c5b0', 'request_id': 'req-299f0dbb-794c-46ba-b374-a7d7adc92286'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.416426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] The token cache is being invalidate because project 3c632f0be94e4096a428a506c912c5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:53.416630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.419940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.427141 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2822/5593] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:53 2022] DELETE /identity/v3/projects/3c632f0be94e4096a428a506c912c5b0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:53.431856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:53.448189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d030-7c2e-483f-a521-71c657ebf855 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:53.504593 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:53.588889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:53.589717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:53.590011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:53.590321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] PATH_INFO: `/v3/users/ea7d64dca2a14f71a666f228055f2b5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:53.602889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7d64dca2a14f71a666f228055f2b5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:53.604889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:53.691067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7d64dca2a14f71a666f228055f2b5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.709733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7d64dca2a14f71a666f228055f2b5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.723729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7d64dca2a14f71a666f228055f2b5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.750027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7d64dca2a14f71a666f228055f2b5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.751308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8efd11aa-e7a3-4b17-9f40-9af528330564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7d64dca2a14f71a666f228055f2b5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:53.768040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2772/5594] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:33:53 2022] DELETE /identity/v3/users/ea7d64dca2a14f71a666f228055f2b5d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:54.791420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:54.792512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:54.822049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f0dbb-794c-46ba-b374-a7d7adc92286 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:54.935546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:54.936501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:54.936789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:54.937073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] PATH_INFO: `/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:54.950095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a13b898acd45649d1de5bc8fd5c34c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:54.952082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.049468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aca8-6340-4577-bd8c-ac84c605f369 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.050027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aca8-6340-4577-bd8c-ac84c605f369 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.050407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aca8-6340-4577-bd8c-ac84c605f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.057584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a13b898acd45649d1de5bc8fd5c34c', 'request_id': 'req-5cef4f73-79fd-4132-8f82-a7899fa85727'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:55.066908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a13b898acd45649d1de5bc8fd5c34c', 'request_id': 'req-5cef4f73-79fd-4132-8f82-a7899fa85727'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:55.090629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a13b898acd45649d1de5bc8fd5c34c', 'request_id': 'req-5cef4f73-79fd-4132-8f82-a7899fa85727'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:55.091869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f095aca8-6340-4577-bd8c-ac84c605f369 None None] MFA Rules not processed for user `4611d01617d645579ae3529c8f8f9de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:55.093984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f095aca8-6340-4577-bd8c-ac84c605f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:55.134807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] The token cache is being invalidate because project b9a13b898acd45649d1de5bc8fd5c34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:33:55.135157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:55.135843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cef4f73-79fd-4132-8f82-a7899fa85727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:33:55.138204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2823/5595] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:33:54 2022] DELETE /identity/v3/projects/b9a13b898acd45649d1de5bc8fd5c34c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:55.143912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.144206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.144502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.178362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:55.180046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:55.208303 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:55.219790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2773/5596] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:55.283227 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2824/5597] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:33:55.291962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.292302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.292874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.329266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:55.330528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:55.357136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.391494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2774/5598] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:55.404571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab5eb-a89b-47e8-9405-edef133cf0ae None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.433170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.433890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.434177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.434447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.435248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:33:55.435558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.437156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.455425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.467139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b2b5-8b74-45c1-85d2-228bd05da430 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.470333 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2825/5599] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:33:55.475052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.475739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.476022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.476819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.478231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.480534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.547911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.548892 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2775/5600] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:55.559994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c78034-6467-4b12-8904-49a2ce709002 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.659299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.660065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.660452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.662669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.665896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.667957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.722900 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2826/5601] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:33:55.727519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.747029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe9fbe-9aa3-4657-b026-71c757c5fd8a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.782139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.782913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.783266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.783610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.784493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.786234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.800119 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2776/5602] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:55.805258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.821020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc7b4-5f49-4ac4-92f7-7559701e7896 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.826880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.828022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.828517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.829026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.830041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.831913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f34650-dca9-42e6-9f43-9606d83ee164 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.844446 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2827/5603] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:55.851639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:55.867894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c892-cf4c-4846-99c7-18df9b0e9159 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:55.885350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:55.886295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.886571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.886836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] PATH_INFO: `/v3/projects/569eda0a6c17406eb099204765543da8/users/0ada0f79b80e4c7797b1a8c5bf35848a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.890449 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:55.908892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=569eda0a6c17406eb099204765543da8, user_id=0ada0f79b80e4c7797b1a8c5bf35848a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:55.912253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:55.934446 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2777/5604] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:55 2022] PUT /identity/v3/projects/569eda0a6c17406eb099204765543da8/users/0ada0f79b80e4c7797b1a8c5bf35848a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:55.946099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:55.946337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:55.946520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:55.990493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] MFA Rules not processed for user `0ada0f79b80e4c7797b1a8c5bf35848a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:55.992110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:56.085945 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2828/5605] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:56.087194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.197349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41ee9-1cf2-4906-8821-b3e2b3eb9a4b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.202827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.204279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.204889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.205390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.206412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.211429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.248037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2778/5606] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:33:56 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:56.251731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.265167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd96c7f-59ce-41c0-85e4-04617e1069e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.296179 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:56.370009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.371522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.371878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.372753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.373557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.375841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.415670 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2829/5607] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:33:56 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:33:56.419681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.434388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104572b-3fc4-49b6-bf17-7aa608b4d420 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.440079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.440995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.441379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.442440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.442719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.445068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.498097 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2779/5608] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:56.502052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.514225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0a149-6d6c-45df-9a5f-a419fffc32da admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.520778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.521845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.522219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.522569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] PATH_INFO: `/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387/users/efa368a5fc9e45569371aba1349918e1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.560028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53c7d0aef14e2e8d3d6388db11e387, user_id=efa368a5fc9e45569371aba1349918e1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.566732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.605108 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2830/5609] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:56 2022] PUT /identity/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387/users/efa368a5fc9e45569371aba1349918e1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:56.608968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.625213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694294-b215-4fe4-a673-ca0b0d6424a5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.698304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.699409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.699798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.700214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.701022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.704548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0df7a-6e59-4dc7-b6ed-e98cb98118a9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.748851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2780/5610] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:33:56.752793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:56.768485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db583b-b6d9-47a5-a0b5-26679692a5ce admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:56.789352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:56.790548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.790901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.792739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] PATH_INFO: `/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387/users/efa368a5fc9e45569371aba1349918e1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.796995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53c7d0aef14e2e8d3d6388db11e387, user_id=efa368a5fc9e45569371aba1349918e1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:56.803728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:56.837748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2831/5611] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:33:56 2022] PUT /identity/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387/users/efa368a5fc9e45569371aba1349918e1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:33:56.839901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:56.844047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:56.844416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:56.933800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] MFA Rules not processed for user `efa368a5fc9e45569371aba1349918e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:33:56.935249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:57.019422 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:33:57.069259 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2781/5612] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:33:57.078951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:57.080987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:33:57.194703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4a3f3-1f19-458d-969c-1738a004f367 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:57.200743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:57.202431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:57.203126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:57.204460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:57.223762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:57.225867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:57.240841 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2832/5613] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:33:59.678794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:33:59.692499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0b3eb-7cf4-4ebe-bae7-9ca090896e48 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:33:59.698501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:33:59.699039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:33:59.699492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:33:59.700107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:33:59.783849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:33:59.786238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad829b-892e-4c53-8745-2ae3977bd173 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:33:59.798640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2782/5614] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:01.204654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:01.362554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938edfe3-5eb5-4be9-b97b-c81567545ff3 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:01.368228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:01.369704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:01.370656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:01.371160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] PATH_INFO: `/v3/users/0ada0f79b80e4c7797b1a8c5bf35848a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:01.373356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ada0f79b80e4c7797b1a8c5bf35848a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:01.375954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:01.407979 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:01.444444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ada0f79b80e4c7797b1a8c5bf35848a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:01.445345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ada0f79b80e4c7797b1a8c5bf35848a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:01.457441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ada0f79b80e4c7797b1a8c5bf35848a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:01.467748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ada0f79b80e4c7797b1a8c5bf35848a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:01.488338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ada0f79b80e4c7797b1a8c5bf35848a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:01.497742 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2833/5615] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:01 2022] DELETE /identity/v3/users/0ada0f79b80e4c7797b1a8c5bf35848a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:01.500365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:01.500884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:01.501003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:01.575753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:01.577523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:01.665825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2783/5616] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:01.673716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:01.675208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:01.760759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551d1c-a10b-4664-8dac-a525580eaa99 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:01.766411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:01.766411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:01.766957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:01.767660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:01.779886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:01.782823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:01.825054 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2834/5617] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:02.217407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:02.219976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:02.246974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56ba0-4789-446c-8008-de77ca716ff7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:02.254524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:02.255692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:02.255692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:02.255971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] PATH_INFO: `/v3/projects/569eda0a6c17406eb099204765543da8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:02.260085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=569eda0a6c17406eb099204765543da8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:02.261980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:02.332201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569eda0a6c17406eb099204765543da8', 'request_id': 'req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.340542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569eda0a6c17406eb099204765543da8', 'request_id': 'req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.358105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569eda0a6c17406eb099204765543da8', 'request_id': 'req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.375113 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:02.384765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] The token cache is being invalidate because project 569eda0a6c17406eb099204765543da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:02.386063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.386745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.392134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2784/5618] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:02 2022] DELETE /identity/v3/projects/569eda0a6c17406eb099204765543da8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:02.393191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:02.411820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9319-53b6-45af-96ba-49ed1b14c5c4 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:02.565662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:02.584935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:02.585243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:02.586282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] PATH_INFO: `/v3/users/efa368a5fc9e45569371aba1349918e1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:02.588502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa368a5fc9e45569371aba1349918e1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:02.590503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:02.688737 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:02.693286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa368a5fc9e45569371aba1349918e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.694646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa368a5fc9e45569371aba1349918e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.707390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa368a5fc9e45569371aba1349918e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.718742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa368a5fc9e45569371aba1349918e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.734788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e480f4ec-627c-413d-9bb6-2e001e66bcd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa368a5fc9e45569371aba1349918e1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:02.741343 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2835/5619] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:02 2022] DELETE /identity/v3/users/efa368a5fc9e45569371aba1349918e1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:03.288195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:03.290261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:03.315738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee53df-9ce3-49e5-b1a2-97dd67edda4e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:03.459519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:03.460477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:03.460773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:03.461055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] PATH_INFO: `/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:03.463238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef53c7d0aef14e2e8d3d6388db11e387)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:03.465197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:03.579426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef53c7d0aef14e2e8d3d6388db11e387', 'request_id': 'req-a0808aa2-d691-46ab-9c4f-9d23c3492f57'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:03.586763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef53c7d0aef14e2e8d3d6388db11e387', 'request_id': 'req-a0808aa2-d691-46ab-9c4f-9d23c3492f57'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:03.595537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef53c7d0aef14e2e8d3d6388db11e387', 'request_id': 'req-a0808aa2-d691-46ab-9c4f-9d23c3492f57'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:03.631763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] The token cache is being invalidate because project ef53c7d0aef14e2e8d3d6388db11e387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:03.632066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:03.635090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:03.644111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:03.644694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:03.644694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:03.646069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2785/5620] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:03 2022] DELETE /identity/v3/projects/ef53c7d0aef14e2e8d3d6388db11e387 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:03.690386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:03.697030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:03.802558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:03.805176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:03.892420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2836/5621] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:03.892420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:03.892420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:04.016049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ef45-35c4-4f8e-8677-d12aba18c05d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.020870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.022994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.023468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.024391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.027241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:04.044049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.045777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ebeb0-054d-45d1-bfe6-6954a6530bb6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.062105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808aa2-d691-46ab-9c4f-9d23c3492f57 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.069133 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2837/5622] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:04.071686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.073917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.074390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.076640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.077311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.077591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.077909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.087140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:04.122447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:04.135016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:04.141703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.143744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.162826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2838/5623] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:04.162980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.180589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368d88e-4ce9-4495-b54f-08c8a1acca65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.186918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.187654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.187945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.188227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.190905 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2786/5624] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:04.206053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:04.209175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.212194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.257304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2839/5625] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:04.265989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.284454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b51dc-28a4-4b0e-b9cd-0fb0d4a50955 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.301927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.304767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.315071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.315071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.320981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.323141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.359623 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:04.384056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2787/5626] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:04 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:04.386003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.401328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362a255-d935-4b5e-a781-e15ba14b2dc7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.453218 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:04.476646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.477810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.478861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.479317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.481080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.484272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.521055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.523250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2840/5627] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:04 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:04.547243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41117-4e30-43a7-9386-cdf968fdecb6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.554875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.556053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.557248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.557766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.558928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.561750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.584363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.601454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab602e-d723-488c-9acf-44e75fa6be7c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.602204 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2788/5628] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:04.609690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.610391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.610677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.611014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.611715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.613317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f17037-c728-4aea-be14-10fb3cb42d52 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.632052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:04.640061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2841/5629] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:04.645452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3fee-cd74-4e4a-bd40-404d3df4ecd2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:04.652345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:04.653358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.653746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.654098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] PATH_INFO: `/v3/projects/e872f226c086402ba5f3ea88ae1cf397/users/e2da16045d1f4809b7e9d77f606ab5c4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.679432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e872f226c086402ba5f3ea88ae1cf397, user_id=e2da16045d1f4809b7e9d77f606ab5c4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:04.682730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:04.712014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2789/5630] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:04 2022] PUT /identity/v3/projects/e872f226c086402ba5f3ea88ae1cf397/users/e2da16045d1f4809b7e9d77f606ab5c4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:04.723017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:04.723654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:04.723654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:04.800651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] MFA Rules not processed for user `e2da16045d1f4809b7e9d77f606ab5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:04.804512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:05.040608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2842/5631] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:05.044416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.216550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4daf10-731c-4cc6-bd63-76b46bb47c0b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.223284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.224462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.224877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.225248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.226278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.229553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.267325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2790/5632] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:05 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:05.270979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.282402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329c408-8b12-464c-9f85-aa98f5020f79 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.424808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.426136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.426425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.426857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.428198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.431212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.453854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2843/5633] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:05 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:05.457731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.473080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ea36-e9b6-4aac-bdea-894a1ef02235 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.482204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.482990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.483361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.483690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.484535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.486341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.498646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2791/5634] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:05.502471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.515252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c759b1-af52-4384-a35b-e483b22ed4e8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.520525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.521419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.521733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.522010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] PATH_INFO: `/v3/projects/c573fb8d28c44f57afb998d1712f3509/users/910a0210569f45559bfc51349ed07f1e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.544421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c573fb8d28c44f57afb998d1712f3509, user_id=910a0210569f45559bfc51349ed07f1e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.547136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.560665 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2844/5635] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:05 2022] PUT /identity/v3/projects/c573fb8d28c44f57afb998d1712f3509/users/910a0210569f45559bfc51349ed07f1e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:05.564795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.576322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada421fb-9acd-4cc6-8b60-83a968cdc4d3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.644640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.645325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.645773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.646056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.646793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.649320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3dd23-397e-4239-acae-3ac027fe0cdd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.660031 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2792/5636] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:05.664573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:05.676124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946741-252e-4d04-ada4-6c588f007c63 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:05.681184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:05.682131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.682415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.682687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] PATH_INFO: `/v3/projects/c573fb8d28c44f57afb998d1712f3509/users/910a0210569f45559bfc51349ed07f1e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.684665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c573fb8d28c44f57afb998d1712f3509, user_id=910a0210569f45559bfc51349ed07f1e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:05.687322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:05.702347 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2845/5637] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:05 2022] PUT /identity/v3/projects/c573fb8d28c44f57afb998d1712f3509/users/910a0210569f45559bfc51349ed07f1e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:05.795780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:05.796354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:05.796642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:05.828401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] MFA Rules not processed for user `910a0210569f45559bfc51349ed07f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:05.830096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:05.853011 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:05.978840 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2793/5638] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:06.001453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:06.010079 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:06.166575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0fff8-35cf-4f2e-ba78-148c6c20564c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:06.171482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:06.172172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:06.172450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:06.172765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:06.186257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:06.188878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7335-e409-4056-93fa-455b9b15cd0e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:06.213559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2846/5639] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:10.521829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:10.594046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304eb37-f67e-4807-8fb1-1414d2a57cbd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:10.602046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:10.603081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:10.603439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:10.603788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] PATH_INFO: `/v3/users/e2da16045d1f4809b7e9d77f606ab5c4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:10.605454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2da16045d1f4809b7e9d77f606ab5c4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:10.607819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:10.667339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2da16045d1f4809b7e9d77f606ab5c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:10.678908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2da16045d1f4809b7e9d77f606ab5c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:10.687761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2da16045d1f4809b7e9d77f606ab5c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:10.700779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2da16045d1f4809b7e9d77f606ab5c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:10.701500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2da16045d1f4809b7e9d77f606ab5c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:10.708133 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2794/5640] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:10 2022] DELETE /identity/v3/users/e2da16045d1f4809b7e9d77f606ab5c4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:10.713120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:10.713706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:10.713706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:10.737884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:10.739249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:10.859073 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2847/5641] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:10.874322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:10.875873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:10.964363 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:11.009472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044cfa8-b8a6-4e5a-802c-b366448c9f1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:11.016140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:11.016140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:11.016591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:11.016968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:11.039756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:11.049909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:11.071631 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2795/5642] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:11.907589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:11.910011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:11.932221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234acd1c-02c2-49e2-b754-292b2f21053d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:11.974428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:11.975978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:11.976812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:11.978545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] PATH_INFO: `/v3/projects/e872f226c086402ba5f3ea88ae1cf397` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:11.982204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e872f226c086402ba5f3ea88ae1cf397)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:12.010939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:12.142361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e872f226c086402ba5f3ea88ae1cf397', 'request_id': 'req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.153212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e872f226c086402ba5f3ea88ae1cf397', 'request_id': 'req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.165752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e872f226c086402ba5f3ea88ae1cf397', 'request_id': 'req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.206679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] The token cache is being invalidate because project e872f226c086402ba5f3ea88ae1cf397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:12.209104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.210868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.217783 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2848/5643] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:11 2022] DELETE /identity/v3/projects/e872f226c086402ba5f3ea88ae1cf397 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:12.222952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:12.245156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d141-4ccd-473d-9625-fcde84367f8c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:12.402662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:12.403640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:12.403934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:12.404219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] PATH_INFO: `/v3/users/910a0210569f45559bfc51349ed07f1e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:12.407685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=910a0210569f45559bfc51349ed07f1e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:12.409801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:12.530469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910a0210569f45559bfc51349ed07f1e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.550603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910a0210569f45559bfc51349ed07f1e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.562787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910a0210569f45559bfc51349ed07f1e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.594765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910a0210569f45559bfc51349ed07f1e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.602198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-010f5954-ada9-462b-a137-0aa70df039d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910a0210569f45559bfc51349ed07f1e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:12.610160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2796/5644] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:12 2022] DELETE /identity/v3/users/910a0210569f45559bfc51349ed07f1e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:13.218234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:13.219939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:13.246584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f9dfc-6ad0-4618-9a27-34525fc4f2a3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:13.316027 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:13.386643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:13.388199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:13.388489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:13.388767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] PATH_INFO: `/v3/projects/c573fb8d28c44f57afb998d1712f3509` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:13.390087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c573fb8d28c44f57afb998d1712f3509)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:13.393344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:13.455937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c573fb8d28c44f57afb998d1712f3509', 'request_id': 'req-8955be24-c21d-4d92-890a-43f63a1093a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:13.463561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c573fb8d28c44f57afb998d1712f3509', 'request_id': 'req-8955be24-c21d-4d92-890a-43f63a1093a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:13.474500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c573fb8d28c44f57afb998d1712f3509', 'request_id': 'req-8955be24-c21d-4d92-890a-43f63a1093a3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:13.503022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] The token cache is being invalidate because project c573fb8d28c44f57afb998d1712f3509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:13.503613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:13.504781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8955be24-c21d-4d92-890a-43f63a1093a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:13.507901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2849/5645] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:13 2022] DELETE /identity/v3/projects/c573fb8d28c44f57afb998d1712f3509 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:13.512752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:13.513267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:13.513363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:13.533684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:13.534924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:13.636201 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:13.656848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2797/5646] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:13.665626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:13.666082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:13.666474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:13.716136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:13.718568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:13.743175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2850/5647] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:13.747477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:13.762077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10cae-a5f2-4323-97b8-ce7d88447bef None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:13.779850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:13.781020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:13.781495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:13.781968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:13.782900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:13.783423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:13.785405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:13.818335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2798/5648] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:13.819803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:13.834489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5aea5-f1bc-4fc0-a087-643cb4af6d24 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:13.841110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:13.841626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:13.841951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:13.842229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:13.842946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:13.844959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:13.878701 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2851/5649] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:13 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:13.883597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:13.910129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267c29f-ce13-4c4f-856d-7ea517ef2ed6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.068915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.074802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.074802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.075985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.082261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.089379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.146236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2799/5650] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:13 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:14.150859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.181883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fafb46-0986-4fa5-bb96-9a6d9f1f0228 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.215536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.216650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.218246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.220854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.228382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.233045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.259225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2852/5651] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:14.260188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.279679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1ca1-094b-4b8d-ac83-04d841dcadd9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.288439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.289256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.289642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.290094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.293233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.298740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e38c5-da48-4c15-b204-b951691755ae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.324022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2800/5652] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:14.328582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.341148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d390-b955-468f-afae-56d38491f982 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.352705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.354620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.355216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.355641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] PATH_INFO: `/v3/projects/6c67b70d7e294f1ba26e3ee6abb47100/users/3b769c2c42c84e489d940eb4b2ef3b96/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.394906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c67b70d7e294f1ba26e3ee6abb47100, user_id=3b769c2c42c84e489d940eb4b2ef3b96, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.399620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.421889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2853/5653] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:14 2022] PUT /identity/v3/projects/6c67b70d7e294f1ba26e3ee6abb47100/users/3b769c2c42c84e489d940eb4b2ef3b96/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:14.430485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.431793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.431963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.467853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] MFA Rules not processed for user `3b769c2c42c84e489d940eb4b2ef3b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:14.469506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:14.572156 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2801/5654] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:14.572766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.690205 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:14.700933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4be7-8c86-44e5-8be6-aa31ec5ad211 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.711528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.712211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.712498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.712777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.713482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.718819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.770914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2854/5655] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:14 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:14.773846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.798596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21907a-d61e-470d-8b2a-9665ac52d9bf None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.874780 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:14.888192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.889002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.889327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.889933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.890649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.893127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:14.930021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2802/5656] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:14 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:14.930301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:14.947518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88894e84-1ea9-4467-a10a-1ef71c98f42a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:14.975136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:14.976684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:14.977109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:14.977487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:14.978763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:14.981138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:15.040895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2855/5657] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:15.042406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:15.057121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9fbe4-04f5-4518-a6f1-41f5862f5c47 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:15.068321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:15.070414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.070707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.072748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] PATH_INFO: `/v3/projects/4966573c890742e1a87050278eddf800/users/cfe1662000a84420be2f697a5dcc41fd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:15.114708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4966573c890742e1a87050278eddf800, user_id=cfe1662000a84420be2f697a5dcc41fd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:15.117796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:15.143178 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2803/5658] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:15 2022] PUT /identity/v3/projects/4966573c890742e1a87050278eddf800/users/cfe1662000a84420be2f697a5dcc41fd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:15.147088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:15.161054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8441-786f-4301-acdf-d6cbb1970179 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:15.248762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:15.250969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.251649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.252173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:15.253200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:15.255821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0dc25-aa16-4be6-be4a-4bc62b553725 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:15.269872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2856/5659] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:15.275013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:15.288187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294771b-307d-4fb4-a29b-783528b2d2e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:15.302767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:15.303370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.305317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.306251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] PATH_INFO: `/v3/projects/4966573c890742e1a87050278eddf800/users/cfe1662000a84420be2f697a5dcc41fd/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:15.323693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4966573c890742e1a87050278eddf800, user_id=cfe1662000a84420be2f697a5dcc41fd, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:15.330464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:15.344459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2804/5660] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:15 2022] PUT /identity/v3/projects/4966573c890742e1a87050278eddf800/users/cfe1662000a84420be2f697a5dcc41fd/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:15.390356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.390802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.391192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:15.425374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] MFA Rules not processed for user `cfe1662000a84420be2f697a5dcc41fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:15.431686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:15.585382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2857/5661] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:15.597518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:15.599402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:15.703058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8560a9-7df3-4e56-ae56-bd45951c71be admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:15.713577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:15.714627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.715152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.715845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:15.740669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:15.744170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a55a2-e309-414a-8300-f67f8766e68e service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:15.783263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2805/5662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:15.950001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:15.966803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907574a-0ee9-457e-aa59-6ce8349b2ce6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:15.980593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:15.980593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:15.980593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:15.980593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:16.101626 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:16.147860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:16.149439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:16.180854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2858/5663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:18.172562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee224-b0d6-4a44-9424-5dfe3a8fca24 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:18.173136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee224-b0d6-4a44-9424-5dfe3a8fca24 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:18.173382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ee224-b0d6-4a44-9424-5dfe3a8fca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:18.216803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-279ee224-b0d6-4a44-9424-5dfe3a8fca24 None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:18.219815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-279ee224-b0d6-4a44-9424-5dfe3a8fca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:18.398550 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2806/5664] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:22.495927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:22.498163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:22.644404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364fb7-8565-4bab-940b-821cc428e97a service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:22.654544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:22.655454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:22.655741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:22.656020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] PATH_INFO: `/v3/users/0c19cadfd922406197ea2977432c3e5e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:22.657255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c19cadfd922406197ea2977432c3e5e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:22.659981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:22.774726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c19cadfd922406197ea2977432c3e5e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:22.775977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c19cadfd922406197ea2977432c3e5e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:22.788703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c19cadfd922406197ea2977432c3e5e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:22.801276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c19cadfd922406197ea2977432c3e5e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:22.817360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c19cadfd922406197ea2977432c3e5e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:22.831203 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2859/5665] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:22 2022] DELETE /identity/v3/users/0c19cadfd922406197ea2977432c3e5e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:22.832585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:22.833126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:22.833444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:22.868823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:22.871265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:22.931331 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:22.983472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2807/5666] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:23.002083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:23.005289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:23.292310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd48c1a-8ed5-4a87-889d-89dd82ec43d8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:23.297754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:23.298579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:23.299312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:23.300265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:23.323707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:23.325523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:23.341408 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2860/5667] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:23.952412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:23.954075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:23.976830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c95d70-ba80-44a3-b82f-9438ffd47f8c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:23.995283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:23.996203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:23.996548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:23.996744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] PATH_INFO: `/v3/projects/df1ac3b8a412437cb066846a0edc2cc5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:23.998109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1ac3b8a412437cb066846a0edc2cc5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:24.000083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:24.089148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1ac3b8a412437cb066846a0edc2cc5', 'request_id': 'req-34febdfc-2dfe-4abf-963e-2c067c4a4623'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.103531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1ac3b8a412437cb066846a0edc2cc5', 'request_id': 'req-34febdfc-2dfe-4abf-963e-2c067c4a4623'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.112650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1ac3b8a412437cb066846a0edc2cc5', 'request_id': 'req-34febdfc-2dfe-4abf-963e-2c067c4a4623'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.144195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] The token cache is being invalidate because project df1ac3b8a412437cb066846a0edc2cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:24.146002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.147951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.151408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2808/5668] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:23 2022] DELETE /identity/v3/projects/df1ac3b8a412437cb066846a0edc2cc5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:24.155376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:24.176793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf20fa-adae-4cf4-b2c0-cd8b5e5c5f56 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:24.196294 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:24.276632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:24.277418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:24.277991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:24.278470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] PATH_INFO: `/v3/users/5b6e1fe780dd48059853d5f5689251a8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:24.280226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6e1fe780dd48059853d5f5689251a8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:24.283020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:24.398073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6e1fe780dd48059853d5f5689251a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.402127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6e1fe780dd48059853d5f5689251a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.413729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6e1fe780dd48059853d5f5689251a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.425129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6e1fe780dd48059853d5f5689251a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.446190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-53c42bcf-d651-478b-b411-fea436e5b267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6e1fe780dd48059853d5f5689251a8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:24.454596 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2861/5669] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:24 2022] DELETE /identity/v3/users/5b6e1fe780dd48059853d5f5689251a8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:24.784759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:24.786396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:24.836093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34febdfc-2dfe-4abf-963e-2c067c4a4623 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:24.969425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:24.970348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:24.970648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:24.970917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] PATH_INFO: `/v3/projects/fad8a68afdcb4f82a9f13d7883e26281` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:24.972172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad8a68afdcb4f82a9f13d7883e26281)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:24.974153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.096299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad8a68afdcb4f82a9f13d7883e26281', 'request_id': 'req-8c94a6e0-917e-41b1-871f-30062c5c9ec2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:25.127038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad8a68afdcb4f82a9f13d7883e26281', 'request_id': 'req-8c94a6e0-917e-41b1-871f-30062c5c9ec2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:25.135848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad8a68afdcb4f82a9f13d7883e26281', 'request_id': 'req-8c94a6e0-917e-41b1-871f-30062c5c9ec2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:25.163999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] The token cache is being invalidate because project fad8a68afdcb4f82a9f13d7883e26281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:25.164358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:25.165277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c94a6e0-917e-41b1-871f-30062c5c9ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:25.167606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2809/5670] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:24 2022] DELETE /identity/v3/projects/fad8a68afdcb4f82a9f13d7883e26281 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:25.172383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.172853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.173027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.205553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:25.207201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:25.298511 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2862/5671] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:25.306567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.307236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.307756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.325691 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:25.355093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:25.357566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:25.368167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2810/5672] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:25.373199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.386025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa60d-e4d7-46b5-9222-06ca54981fc5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.392195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.393260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.394005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.394556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.395544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:25.396073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.398773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.418595 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2863/5673] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:25.423507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.436614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c1164-265f-4322-af33-da266d48ac73 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.449042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.449933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.450314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.450690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.451494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.454884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.493832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2811/5674] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:25 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:25.495336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.507159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558372-1156-42c7-8cf0-49f9dbfa4e76 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.545993 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:25.608886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.609887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.610266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.610639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.612065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.614110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.639239 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2864/5675] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:25 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:25.643368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.655448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10040c4-dc6b-48d9-b5f5-d4bc473a7cda admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.661780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.663465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.663927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.664516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.666587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.669624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.683074 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2812/5676] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:25.687002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.704337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b24fe-a14d-42ce-ada2-3158ea5e1369 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.727937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.728900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.729397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.729909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.730900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.733003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17db5ee-db9a-47c4-9e97-7bde136c4b7f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.745498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2865/5677] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:25.749521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.761537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb9fa3-43f9-4951-b3dd-384a25034146 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:25.766729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:25.767780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.768132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.768477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] PATH_INFO: `/v3/projects/ab565d3e8f6341edae381b9cbfd8aa4b/users/f1aa22b79edf4f18aa1bc104be2b99cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.786628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab565d3e8f6341edae381b9cbfd8aa4b, user_id=f1aa22b79edf4f18aa1bc104be2b99cd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:25.790243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:25.814961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2813/5678] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:25 2022] PUT /identity/v3/projects/ab565d3e8f6341edae381b9cbfd8aa4b/users/f1aa22b79edf4f18aa1bc104be2b99cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:25.827104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:25.827403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:25.827897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:25.861962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] MFA Rules not processed for user `f1aa22b79edf4f18aa1bc104be2b99cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:25.863201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:25.943456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2866/5679] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:25.954558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:25.956622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:26.027814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a14c7-58ab-459c-8ec6-18522fecba0b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:26.033549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:26.034455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:26.034898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:26.035460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:26.047428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:26.049402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:26.062249 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2814/5680] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:31.137754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:31.159778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7e3df-8171-4b60-ab57-1a8970ee3630 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:31.168213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:31.169073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:31.169368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:31.172664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:31.176878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:31.251800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:31.254039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:31.466346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:31.475719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02404bc-391c-4be6-9237-fd91d1d3a483 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:31.476198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:31.489651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:31.492125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:31.492675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:31.493438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:31.499184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:31.521529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2867/5681] 10.222.0.27 () {60 vars in 1396 bytes} [Sun Jul 24 01:34:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:31.553286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:31.560601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b9574-e313-402f-9dbf-0c6e8c428ee6 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:31.571631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:31.573427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:31.609878 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2815/5682] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:31.646490 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:31.782788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a072-91b2-4e3f-b19c-3a602ba5d276 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:31.800612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:31.810763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:31.811392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:31.811888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] PATH_INFO: `/v3/users/3b769c2c42c84e489d940eb4b2ef3b96` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:31.815145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b769c2c42c84e489d940eb4b2ef3b96)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:31.818040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:31.947296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b769c2c42c84e489d940eb4b2ef3b96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:31.954069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b769c2c42c84e489d940eb4b2ef3b96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:31.983946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b769c2c42c84e489d940eb4b2ef3b96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:32.002543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b769c2c42c84e489d940eb4b2ef3b96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:32.039583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b769c2c42c84e489d940eb4b2ef3b96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:32.056376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2868/5683] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:31 2022] DELETE /identity/v3/users/3b769c2c42c84e489d940eb4b2ef3b96 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:32.067612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:32.073093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:32.074815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:32.131992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:32.138185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:32.230715 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:32.337685 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2816/5684] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:32.338294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:32.339760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:32.443790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2993c6-6a8f-47a0-ac53-938535de936e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:32.448522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:32.449599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:32.449984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:32.450325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:32.469031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:32.469031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:32.485063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2869/5685] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:33.344031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:33.345522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:33.369246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b27415-7053-4b53-97fa-c490cb9a1280 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:33.378537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:33.379447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:33.379732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:33.380013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] PATH_INFO: `/v3/projects/6c67b70d7e294f1ba26e3ee6abb47100` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:33.387923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c67b70d7e294f1ba26e3ee6abb47100)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:33.390409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:33.531706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c67b70d7e294f1ba26e3ee6abb47100', 'request_id': 'req-22a02b61-c750-4bfc-bc6f-3f110dd202d8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.563084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c67b70d7e294f1ba26e3ee6abb47100', 'request_id': 'req-22a02b61-c750-4bfc-bc6f-3f110dd202d8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.579028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c67b70d7e294f1ba26e3ee6abb47100', 'request_id': 'req-22a02b61-c750-4bfc-bc6f-3f110dd202d8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.613241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] The token cache is being invalidate because project 6c67b70d7e294f1ba26e3ee6abb47100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:33.615909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.616775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.622322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2817/5686] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:33 2022] DELETE /identity/v3/projects/6c67b70d7e294f1ba26e3ee6abb47100 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:33.622766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:33.641361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4082-7f11-4390-8af8-21288a3a2db7 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:33.743536 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:33.769287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:33.770695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:33.771326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:33.772639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] PATH_INFO: `/v3/users/cfe1662000a84420be2f697a5dcc41fd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:33.775851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe1662000a84420be2f697a5dcc41fd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:33.778570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:33.882415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe1662000a84420be2f697a5dcc41fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.883840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe1662000a84420be2f697a5dcc41fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.898053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe1662000a84420be2f697a5dcc41fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.918874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe1662000a84420be2f697a5dcc41fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.945664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d1d0d11d-3beb-44d1-8a5f-cb48d65c8f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe1662000a84420be2f697a5dcc41fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:33.959326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2870/5687] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:33 2022] DELETE /identity/v3/users/cfe1662000a84420be2f697a5dcc41fd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:34.774397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:34.776091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:34.811215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02b61-c750-4bfc-bc6f-3f110dd202d8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:34.929968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:34.931187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:34.931448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:34.931943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] PATH_INFO: `/v3/projects/4966573c890742e1a87050278eddf800` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:34.933461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4966573c890742e1a87050278eddf800)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:34.935550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.030658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4966573c890742e1a87050278eddf800', 'request_id': 'req-1b826f14-1134-4276-8d00-590bb915bc0e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:35.038622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4966573c890742e1a87050278eddf800', 'request_id': 'req-1b826f14-1134-4276-8d00-590bb915bc0e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:35.042046 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:35.053202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4966573c890742e1a87050278eddf800', 'request_id': 'req-1b826f14-1134-4276-8d00-590bb915bc0e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:35.070625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] The token cache is being invalidate because project 4966573c890742e1a87050278eddf800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:35.070920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:35.071712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b826f14-1134-4276-8d00-590bb915bc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:35.073475 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2818/5688] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:34 2022] DELETE /identity/v3/projects/4966573c890742e1a87050278eddf800 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:35.079239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.079760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.079865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.103791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:35.105847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:35.262030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2871/5689] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:35.269562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.269882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.270176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.299283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:35.317882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:35.372983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2819/5690] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:35.377273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.388067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61264b8-e229-4a99-9efa-c4e5bd609f10 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.393779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.394466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.394749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.395225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.396144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:35.397183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:35.401024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.433298 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2872/5691] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:35.437548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.465366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f51fe-0dfd-4a46-adfd-2c4da5caba2d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.473085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.473814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.474103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.474380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.475665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:35.477722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.518446 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2820/5692] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:35 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:35.522425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.559925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113da9c-e132-400d-a60d-4ffba2eea48f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.750282 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:35.782370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.793488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.795369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.795742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.796569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:35.804231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.853358 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2873/5693] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:35 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:35.857771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.872371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859ea29-ad6e-4fcd-a545-ca5c2efac7c6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.879177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.880165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.880633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.881172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.882674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:35.884545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.899399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2821/5694] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:35.903128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.916299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84523a0a-fdb3-4efa-8399-4f9748494839 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.924276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.924869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.925155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.925600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.927048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:35.932562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:35.950278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2874/5695] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:35.951543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.963303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07965706-b2b0-4f38-acff-f95ba6b9d796 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:35.967596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:35.970210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:35.974396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:35.978483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:35.978663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:35.980376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] PATH_INFO: `/v3/projects/6b6b0a8af1f64233b8d01421f3b88ac5/users/ad7cf3099ec04e7891d60c5574a8c2df/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:35.993869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a6ba-e8d1-44a9-9351-18c6e8267879 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.002653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.004581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.005488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.006335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] PATH_INFO: `/v3/users/524fbca79dd74fe59142f4526546bf37` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.009169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524fbca79dd74fe59142f4526546bf37)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.011972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.031230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6b0a8af1f64233b8d01421f3b88ac5, user_id=ad7cf3099ec04e7891d60c5574a8c2df, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.036678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d1868-81bb-442d-a65c-9110f75c2ed4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.081600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2822/5696] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:35 2022] PUT /identity/v3/projects/6b6b0a8af1f64233b8d01421f3b88ac5/users/ad7cf3099ec04e7891d60c5574a8c2df/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:36.095238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.095437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.097931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.183942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524fbca79dd74fe59142f4526546bf37'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:36.187258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524fbca79dd74fe59142f4526546bf37'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:36.188853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] MFA Rules not processed for user `ad7cf3099ec04e7891d60c5574a8c2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:36.190624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:36.206667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524fbca79dd74fe59142f4526546bf37'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:36.226923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524fbca79dd74fe59142f4526546bf37'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:36.260514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0dd6fd71-0054-470d-95fc-835818e31ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524fbca79dd74fe59142f4526546bf37'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:36.286352 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2875/5697] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:35 2022] DELETE /identity/v3/users/524fbca79dd74fe59142f4526546bf37 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:36.289975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.290838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.291384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.327883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:36.329517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:36.343851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2823/5698] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:36.351529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.353566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:36.420754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2876/5699] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:36.442477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.444621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:36.485430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9237-f386-4238-ace0-63976c9be35c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.514159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.515268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.515572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.515855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.516917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.519086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.541553 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:36.550781 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:36.556790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e05c2-bb0a-4722-9f1f-a4d350d9b813 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.565657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.566357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.566932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.567382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.575577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2824/5700] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:36 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:36.580684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.583990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.587734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.618990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2877/5701] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:36.694985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f400876-6ee5-42b1-ae63-815c5acd6cd4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.701258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.702255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.703111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.703111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.703981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.706388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.736724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2825/5702] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:36 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:36.740202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.752673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d6e80-2cf9-4d53-bf08-d6ed69fee81c service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.759783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.760835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.760835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.761042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.761812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.763586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.798937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2878/5703] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:36.803726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.816008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287433-e65c-4ecd-9476-afd9a3b6328c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:36.822137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:36.826558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:36.826966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:36.827277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] PATH_INFO: `/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac/users/753d53303a80415b82054a745cca69ec/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:36.879220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cf14e9124b461f94fe57cb670dd3ac, user_id=753d53303a80415b82054a745cca69ec, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:36.887941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:36.920701 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2826/5704] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:36 2022] PUT /identity/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac/users/753d53303a80415b82054a745cca69ec/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:36.924732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:36.941539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1165f-5155-438d-b4f3-a99ba3eede58 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.075274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.076253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.076763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.077206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.078198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.081794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9893d1-4199-4aee-980f-48df1cc43772 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:37.105431 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2879/5705] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:37.108413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:37.127726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d940-5c6c-4d77-96b7-3fa8e0bb6aa3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.148977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.150153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.150507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.150851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] PATH_INFO: `/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac/users/753d53303a80415b82054a745cca69ec/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.154198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cf14e9124b461f94fe57cb670dd3ac, user_id=753d53303a80415b82054a745cca69ec, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.160827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:37.179027 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2827/5706] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:37 2022] PUT /identity/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac/users/753d53303a80415b82054a745cca69ec/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:37.189395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.189904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.190011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.228222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] MFA Rules not processed for user `753d53303a80415b82054a745cca69ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:37.229490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:37.379071 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2880/5707] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:37.384110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:37.389012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:37.391845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:37.393547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:37.558944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e0fa6-bd83-4486-a9e7-8d697bc1ba48 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.570814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.575454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.576009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.576796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.607196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.611969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:37.623488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7665-ae96-47cf-8bc2-1053fff63221 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.638777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2881/5708] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:37.639122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.640037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.642080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.642494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] PATH_INFO: `/v3/projects/9701771015da4becb66a8a5f94122d2c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.643998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9701771015da4becb66a8a5f94122d2c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.650968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:37.748181 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=6,keystone:SELECT=90,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:37.755301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9701771015da4becb66a8a5f94122d2c', 'request_id': 'req-77e0a678-0350-4b44-b5cc-cae16513ae0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:37.755789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:37.762067 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:37.767274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9701771015da4becb66a8a5f94122d2c', 'request_id': 'req-77e0a678-0350-4b44-b5cc-cae16513ae0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:37.771334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519d16-d0aa-45c1-b712-517ccf9c5720 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.777662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9701771015da4becb66a8a5f94122d2c', 'request_id': 'req-77e0a678-0350-4b44-b5cc-cae16513ae0c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:37.804821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] The token cache is being invalidate because project 9701771015da4becb66a8a5f94122d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:37.805368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:37.806370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:37.809338 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2828/5709] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:37 2022] DELETE /identity/v3/projects/9701771015da4becb66a8a5f94122d2c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:37.813438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:37.815426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:37.902208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.909146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.912075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.912361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] PATH_INFO: `/v3/users/ad7cf3099ec04e7891d60c5574a8c2df` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.920216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7cf3099ec04e7891d60c5574a8c2df)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.921494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a678-0350-4b44-b5cc-cae16513ae0c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:37.922540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:37.934188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:37.936728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:37.938992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:37.942799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] PATH_INFO: `/v3/users/bbbf53792834446a8ac3d587f94794a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:37.950848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbf53792834446a8ac3d587f94794a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:37.969064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:38.090756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbf53792834446a8ac3d587f94794a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.108973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbf53792834446a8ac3d587f94794a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.165002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbf53792834446a8ac3d587f94794a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.202170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbf53792834446a8ac3d587f94794a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.206081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3e5790f2-3de5-411a-91a4-f45746fddd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbf53792834446a8ac3d587f94794a1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.231441 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2829/5710] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:37 2022] DELETE /identity/v3/users/bbbf53792834446a8ac3d587f94794a1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:38.325661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7cf3099ec04e7891d60c5574a8c2df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.327239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7cf3099ec04e7891d60c5574a8c2df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.359198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7cf3099ec04e7891d60c5574a8c2df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.392385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7cf3099ec04e7891d60c5574a8c2df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.442214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7cf3099ec04e7891d60c5574a8c2df'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.468656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:38.468957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:38.469243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:38.470637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2882/5711] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:37 2022] DELETE /identity/v3/users/ad7cf3099ec04e7891d60c5574a8c2df => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:38.493008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:38.494814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:38.563930 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:38.594830 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2830/5712] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:38.632257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:38.634386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:38.702523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:38.704029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:38.748489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c21bcf-0a6c-4951-b924-0b91e88996c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:38.766000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:38.766888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:38.767259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:38.767447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] PATH_INFO: `/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:38.768734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa6b3cf6980468c9f130b14a72dc8c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:38.771300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:38.793975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af27f4-f119-4a56-8d92-e6ca47a1059d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:38.798640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:38.799306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:38.799644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:38.799919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:38.821312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:38.832480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd974e-4ac0-4544-afc7-92548c7c192a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:38.845311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa6b3cf6980468c9f130b14a72dc8c5', 'request_id': 'req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.856776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa6b3cf6980468c9f130b14a72dc8c5', 'request_id': 'req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.860919 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2883/5713] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:38.867165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa6b3cf6980468c9f130b14a72dc8c5', 'request_id': 'req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.884582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] The token cache is being invalidate because project 3fa6b3cf6980468c9f130b14a72dc8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:38.885136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.886189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b06f7ef-da6f-47fa-aa80-4e8200fbb5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:38.888499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2831/5714] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:38 2022] DELETE /identity/v3/projects/3fa6b3cf6980468c9f130b14a72dc8c5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:38.894307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:38.894669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:38.895017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:38.932325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:38.935709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:38.966711 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:39.063395 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2884/5715] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:39.071043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.071892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.072369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.107451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:39.116053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:39.132807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2832/5716] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:39.133514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.145259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09de6c0-93dd-49db-ac0e-2d3f90001b06 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.166084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.166914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.167280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.167544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.168304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:39.169298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.170392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.207238 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2885/5717] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:39.211190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.246420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b72e07-29b6-44e4-b820-537bbc3cfbd5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.258287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.259718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.262719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.263535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.265707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.271211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.329802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.354120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9046ad-3279-40e0-aa01-135063f8fefd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.368678 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2833/5718] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:39 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:39.483720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.484723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.485210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.485657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.486898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.489943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.525370 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2886/5719] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:39 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:34:39.527419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.553122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a6ec-7e9d-4cbe-987c-034644e80bb5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.570483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.571429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.571745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.572015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.573004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.574735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.604989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.608598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2834/5720] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:39.620994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688215-282a-4ed8-ba25-66992d7f6c69 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.634344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.635110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.636233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.636514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.637538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.640514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f643c11-573d-4ef8-a1bb-fc4d404eed3f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.661736 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2887/5721] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:39.666490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.681826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1802-420a-44d0-ad75-b3e1bf57935b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:39.686952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:39.688007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.688307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.688569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] PATH_INFO: `/v3/projects/c7e088a89b0e4fe5b0282bef7ccee36f/users/03fb12a1cad045cdb9b55fddf5cb9bdd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.722698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e088a89b0e4fe5b0282bef7ccee36f, user_id=03fb12a1cad045cdb9b55fddf5cb9bdd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:39.729565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:39.754411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2835/5722] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:39 2022] PUT /identity/v3/projects/c7e088a89b0e4fe5b0282bef7ccee36f/users/03fb12a1cad045cdb9b55fddf5cb9bdd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:39.774288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:39.775011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:39.775459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:39.824137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] MFA Rules not processed for user `03fb12a1cad045cdb9b55fddf5cb9bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:39.827885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:39.921554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2888/5723] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:39.927170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.993234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:39.995145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:40.022909 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:40.031454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8fab7-89ae-4ba8-be0a-eb0814441389 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.039299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.040207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.041705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.041705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.042060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.044387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.098730 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:40.119316 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2836/5724] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:39 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:40.125651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.128340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becbf27-59b4-4de4-b590-cc5954680050 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.222323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.225065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.226295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.226579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] PATH_INFO: `/v3/projects/6b6b0a8af1f64233b8d01421f3b88ac5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.230947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6b0a8af1f64233b8d01421f3b88ac5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.230947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.250130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9816f-a638-43db-8030-4ebaf7bbf113 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.258397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.259418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.259874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.260319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.261198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.264132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.298312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2837/5725] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:40 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:40.299979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.302276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6b0a8af1f64233b8d01421f3b88ac5', 'request_id': 'req-0990ab71-d8ef-4e85-9d04-8ab44d513b07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.311100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6b0a8af1f64233b8d01421f3b88ac5', 'request_id': 'req-0990ab71-d8ef-4e85-9d04-8ab44d513b07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.315024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6e94-62bc-4a03-bb7f-15edf3a45a17 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.319266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6b0a8af1f64233b8d01421f3b88ac5', 'request_id': 'req-0990ab71-d8ef-4e85-9d04-8ab44d513b07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.339171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] The token cache is being invalidate because project 6b6b0a8af1f64233b8d01421f3b88ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:40.340541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.341537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.343601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2889/5726] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:39 2022] DELETE /identity/v3/projects/6b6b0a8af1f64233b8d01421f3b88ac5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:40.347884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.351541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:40.403812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.405005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.405467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.405934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.407631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.410088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.437864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2838/5727] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:40.441127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.444202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:40.452795 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:40.462701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990ab71-d8ef-4e85-9d04-8ab44d513b07 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.470269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.471575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.472089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.472626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] PATH_INFO: `/v3/users/753d53303a80415b82054a745cca69ec` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.475148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753d53303a80415b82054a745cca69ec)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.477571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.480214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037678c-512d-4b4c-a0b1-10c82a85b92d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.489745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.491796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.492491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.492944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] PATH_INFO: `/v3/projects/5b4bc818f63a4a29801fe40c1b825f63/users/3b8cc7fce6c4442c838378a80a9e39b5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.538408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4bc818f63a4a29801fe40c1b825f63, user_id=3b8cc7fce6c4442c838378a80a9e39b5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.546784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.567131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753d53303a80415b82054a745cca69ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.567759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753d53303a80415b82054a745cca69ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.591183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753d53303a80415b82054a745cca69ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.593037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2839/5728] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:40 2022] PUT /identity/v3/projects/5b4bc818f63a4a29801fe40c1b825f63/users/3b8cc7fce6c4442c838378a80a9e39b5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:40.596658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.598630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:40.610320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753d53303a80415b82054a745cca69ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.641560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753d53303a80415b82054a745cca69ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:40.655444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2890/5729] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:40 2022] DELETE /identity/v3/users/753d53303a80415b82054a745cca69ec => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:40.720222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf7f7-2e9f-4f84-a206-2f25662f8a2c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.733434 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:40.840647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.842118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.842537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.842914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.843762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.845693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065556-43a8-4ea1-9f8e-82319fb72092 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.865801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:40.878245 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2840/5730] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:40.883358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591cd9-b722-4fe0-8955-ba3f706fa838 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:40.901697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:40.904161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.909355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.909662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] PATH_INFO: `/v3/projects/5b4bc818f63a4a29801fe40c1b825f63/users/3b8cc7fce6c4442c838378a80a9e39b5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:40.915212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4bc818f63a4a29801fe40c1b825f63, user_id=3b8cc7fce6c4442c838378a80a9e39b5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:40.929140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:40.945662 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2891/5731] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:40 2022] PUT /identity/v3/projects/5b4bc818f63a4a29801fe40c1b825f63/users/3b8cc7fce6c4442c838378a80a9e39b5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:40.958347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:40.958816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:40.959182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.006355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] MFA Rules not processed for user `3b8cc7fce6c4442c838378a80a9e39b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:41.007812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.079985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.082255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.145292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2841/5732] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:41.160379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.165757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.213541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe848-9d99-4c56-99f7-e228e6937cbb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.230617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.231857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.232205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.232548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] PATH_INFO: `/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.233929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cf14e9124b461f94fe57cb670dd3ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.235950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.249053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd1ec5-1f64-44c4-ae87-47c3c2fb2eea None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.255701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.256894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.257398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.257913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.269845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.272469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bffea-0306-498b-9bf7-aa0285f10b6f service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.284887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2842/5733] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:41.294584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cf14e9124b461f94fe57cb670dd3ac', 'request_id': 'req-f8629c3a-8e40-41ef-863b-94407f7912fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.302362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cf14e9124b461f94fe57cb670dd3ac', 'request_id': 'req-f8629c3a-8e40-41ef-863b-94407f7912fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.316113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cf14e9124b461f94fe57cb670dd3ac', 'request_id': 'req-f8629c3a-8e40-41ef-863b-94407f7912fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.318669 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:41.340933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] The token cache is being invalidate because project c6cf14e9124b461f94fe57cb670dd3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:41.341582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.342102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8629c3a-8e40-41ef-863b-94407f7912fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.344373 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2892/5734] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:41 2022] DELETE /identity/v3/projects/c6cf14e9124b461f94fe57cb670dd3ac => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:41.348975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.349270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.349615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.381627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:41.382861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.432946 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:41.486538 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2843/5735] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:41.488265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.488555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.488828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.515585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:41.517086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.556528 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2893/5736] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:41.559273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.572366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079df27f-4977-4407-84a2-312dea47dc8b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.578785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.579628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.580012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.580418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.581464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:41.581840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.585042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.621211 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2844/5737] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:41.622609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.636490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ced075-a5e5-4e79-b010-eab5f0cf20d5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.643113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.644760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.645073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.645640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.647247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.665636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.718602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2894/5738] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:41 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:41.723343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.735242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750189b-ff25-4ae3-ae2c-d30fa47bf95a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.841400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.842012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.842145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.842487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.843340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.845336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.873728 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2845/5739] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:41 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:41.876965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.883715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.885817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:41.894235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458ff69-0d8f-4133-87a6-4295250feed0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.901144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.901945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.902228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.902501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.903177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dc85-77d3-4e3f-aac0-a35837359ffa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.903314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.905300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.910056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.911536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.913414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.913944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] PATH_INFO: `/v3/users/03fb12a1cad045cdb9b55fddf5cb9bdd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.915972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fb12a1cad045cdb9b55fddf5cb9bdd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.918321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.919589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2895/5740] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:41.924378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.946750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cf69a-bbde-45a3-b150-f72d3642aa8e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:41.961096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:41.962085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:41.962855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:41.963619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:41.964575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:41.966779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:41.980432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2896/5741] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:41.984255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fb12a1cad045cdb9b55fddf5cb9bdd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.984627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:41.996182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fb12a1cad045cdb9b55fddf5cb9bdd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:41.997323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4b2ed-3142-4434-9f68-d70ed895254f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.002872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.004230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.004615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.005008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] PATH_INFO: `/v3/projects/1b8a8e2102054cd2b519867ed65b0664/users/f95ffd8ceb3a4de588d478ed9fd625c1/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.008652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fb12a1cad045cdb9b55fddf5cb9bdd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:42.026627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8a8e2102054cd2b519867ed65b0664, user_id=f95ffd8ceb3a4de588d478ed9fd625c1, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.027200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fb12a1cad045cdb9b55fddf5cb9bdd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:42.027974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a26ac0fd-35cb-4daa-8035-60f66873e385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fb12a1cad045cdb9b55fddf5cb9bdd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:42.030265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8ee30-16fa-486a-9ad7-871f314b57ad admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.035108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2846/5742] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:41 2022] DELETE /identity/v3/users/03fb12a1cad045cdb9b55fddf5cb9bdd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:42.039967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.040256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.040528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.048027 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2897/5743] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:41 2022] PUT /identity/v3/projects/1b8a8e2102054cd2b519867ed65b0664/users/f95ffd8ceb3a4de588d478ed9fd625c1/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:42.060899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.061071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:42.061174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.061503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.062645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:42.088944 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:42.096399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] MFA Rules not processed for user `f95ffd8ceb3a4de588d478ed9fd625c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:42.097736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:42.175634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2847/5744] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:42.183897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.185658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:42.224981 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2898/5745] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:42.241006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.242657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:42.288610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307102b5-e537-4d0a-bdf9-8b2cf40ac54d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.300542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5e20b-0f11-4948-aa83-760a3d1801c7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.302404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.303576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.303861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.304217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.304833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.308047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.310795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.310795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.311055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.311373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.327850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.330988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.363858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2848/5746] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:42.382063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2899/5747] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:42 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:42.383587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.398837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd121-8a49-4362-b4ef-459709190e3d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.538671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.539908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.540169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.540450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.545612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.547946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.580706 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2849/5748] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:42 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:42.585495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.600908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fab7f-62ed-4c1c-b619-c7aa82c7a51d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.611020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.611953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.614919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.615607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.616560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.622503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.653557 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2900/5749] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:42.655797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.672672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe430-aea9-4412-b1d6-45c7b830a904 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.687865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.689051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.689645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.690114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] PATH_INFO: `/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e/users/acc59bac991442e189a314aba9199863/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.712179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3685d1ddd6645bfb6384f58e6b1773e, user_id=acc59bac991442e189a314aba9199863, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.715704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:42.739861 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2850/5750] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:42 2022] PUT /identity/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e/users/acc59bac991442e189a314aba9199863/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:42.744621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.760681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1908e5-89c7-41b9-b370-1e916e21a307 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:42.888482 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:42.899395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:42.902273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:42.956325 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:42.978446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:42.980168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:42.986293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:42.986734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:42.987724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:42.989490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:43.013962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2901/5751] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:43.022778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:43.054604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88aada-169d-4941-9836-1d92a6558ae1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:43.057499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509d29-4835-4c55-b6be-b2d9d8857883 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:43.064283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:43.065196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:43.066791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:43.067728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:43.068007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:43.068927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] PATH_INFO: `/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e/users/acc59bac991442e189a314aba9199863/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:43.074090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:43.074422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] PATH_INFO: `/v3/projects/c7e088a89b0e4fe5b0282bef7ccee36f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:43.074546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3685d1ddd6645bfb6384f58e6b1773e, user_id=acc59bac991442e189a314aba9199863, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:43.077123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945f5a9-4563-49a5-8f86-0893bb2f06b1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:43.083333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e088a89b0e4fe5b0282bef7ccee36f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:43.085495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:43.112288 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2902/5752] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:43 2022] PUT /identity/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e/users/acc59bac991442e189a314aba9199863/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:43.123604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:43.123814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:43.124056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:43.198834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] MFA Rules not processed for user `acc59bac991442e189a314aba9199863`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:43.199987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:43.242487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e088a89b0e4fe5b0282bef7ccee36f', 'request_id': 'req-f620187d-b8a6-40b9-a517-b04fe2a28d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.263122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e088a89b0e4fe5b0282bef7ccee36f', 'request_id': 'req-f620187d-b8a6-40b9-a517-b04fe2a28d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.276394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e088a89b0e4fe5b0282bef7ccee36f', 'request_id': 'req-f620187d-b8a6-40b9-a517-b04fe2a28d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.296241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] The token cache is being invalidate because project c7e088a89b0e4fe5b0282bef7ccee36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:43.296543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.297592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.300815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2851/5753] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:42 2022] DELETE /identity/v3/projects/c7e088a89b0e4fe5b0282bef7ccee36f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:43.306611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:43.310453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:43.393345 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2903/5754] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:43.421809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:43.429217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:43.468676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620187d-b8a6-40b9-a517-b04fe2a28d5f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:43.487798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:43.488761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:43.489046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:43.489544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] PATH_INFO: `/v3/users/3b8cc7fce6c4442c838378a80a9e39b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:43.494206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8cc7fce6c4442c838378a80a9e39b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:43.496247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:43.555550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860441-61aa-4b56-9034-a04e4ba4c4cf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:43.562426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:43.563218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:43.563758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:43.564095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:43.577045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:43.578943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:43.593523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2904/5755] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:43.602434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8cc7fce6c4442c838378a80a9e39b5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.617557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8cc7fce6c4442c838378a80a9e39b5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.639670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8cc7fce6c4442c838378a80a9e39b5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.647200 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:43.675538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8cc7fce6c4442c838378a80a9e39b5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.676456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8cc7fce6c4442c838378a80a9e39b5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:43.687673 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2852/5756] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:43 2022] DELETE /identity/v3/users/3b8cc7fce6c4442c838378a80a9e39b5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:44.292220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:44.304418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09966d49-565c-4447-adaf-728dff3741b7 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:44.408594 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:44.425859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc59bac991442e189a314aba9199863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3685d1ddd6645bfb6384f58e6b1773e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:44.426857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.427340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.428490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.429606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:44.430131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:44.431928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:44.445988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2905/5757] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:44.450283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:44.455392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:44.475316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af709043-676f-4a87-8dca-6e84e8c3219d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:44.480245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc59bac991442e189a314aba9199863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3685d1ddd6645bfb6384f58e6b1773e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:44.481118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.481979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.482270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.482994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:44.484943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:44.547332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2853/5758] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:44 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:34:44.551912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:44.570875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811225-b5d9-4a11-9867-31a8aa6b6cef tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:44.585603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:44.587915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:44.704228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f33e0-3729-488a-ae16-3244d95aef81 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:44.711181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:44.711719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc59bac991442e189a314aba9199863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3685d1ddd6645bfb6384f58e6b1773e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:44.712397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.712718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.712999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.713242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.713579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.713800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:44.713990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] PATH_INFO: `/v3/projects/5b4bc818f63a4a29801fe40c1b825f63` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.714100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:44.715423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4bc818f63a4a29801fe40c1b825f63)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:44.715677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:44.717809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:44.745159 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2906/5759] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:44.785212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4bc818f63a4a29801fe40c1b825f63', 'request_id': 'req-96dd7093-1d03-4008-b48d-966cce43c62a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:44.793394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4bc818f63a4a29801fe40c1b825f63', 'request_id': 'req-96dd7093-1d03-4008-b48d-966cce43c62a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:44.800253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4bc818f63a4a29801fe40c1b825f63', 'request_id': 'req-96dd7093-1d03-4008-b48d-966cce43c62a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:44.820602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:44.829322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] The token cache is being invalidate because project 5b4bc818f63a4a29801fe40c1b825f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:44.829621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:44.833591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-96dd7093-1d03-4008-b48d-966cce43c62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:44.837183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38778c7-6739-4a15-bb81-44925d0308d2 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:44.839901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2854/5760] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:44 2022] DELETE /identity/v3/projects/5b4bc818f63a4a29801fe40c1b825f63 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:44.846430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336652-9823-43a6-9145-451ca5499311 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.846849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336652-9823-43a6-9145-451ca5499311 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.847236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336652-9823-43a6-9145-451ca5499311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.872558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d1336652-9823-43a6-9145-451ca5499311 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:44.874102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d1336652-9823-43a6-9145-451ca5499311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:44.972911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc59bac991442e189a314aba9199863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3685d1ddd6645bfb6384f58e6b1773e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:44.978895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:44.979103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:44.979448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] PATH_INFO: `/v3/projects/2467762e63d64c71a9d5e08b596aab63` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:44.981163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2467762e63d64c71a9d5e08b596aab63)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:44.982777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:44.986609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.025430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2855/5761] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:45.033398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.033776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.034125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.084502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:45.087072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:45.107122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2467762e63d64c71a9d5e08b596aab63', 'request_id': 'req-b6193484-8b1c-475d-91ca-3106d1234036'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.118590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2467762e63d64c71a9d5e08b596aab63', 'request_id': 'req-b6193484-8b1c-475d-91ca-3106d1234036'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.143040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2467762e63d64c71a9d5e08b596aab63', 'request_id': 'req-b6193484-8b1c-475d-91ca-3106d1234036'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.191211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] The token cache is being invalidate because project 2467762e63d64c71a9d5e08b596aab63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:45.191865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.193214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.195676 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2907/5762] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:44 2022] DELETE /identity/v3/projects/2467762e63d64c71a9d5e08b596aab63 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:45.276285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.278309 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2856/5763] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:45.286706 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:45.294513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6193484-8b1c-475d-91ca-3106d1234036 tempest-VolumeQuotaClassesTest-451733046 tempest-VolumeQuotaClassesTest-451733046-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.303748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.304958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.306811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.307984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.309804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:45.310483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.314736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.335482 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2908/5764] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:45.337483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.354794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111e92b-a694-4b6f-a3c7-893951b26105 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.369600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.371586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.371795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.375235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.376028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.382626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.450067 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2857/5765] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:45 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:45.454015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.473223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc411a9-8d6c-4e29-85d0-545886419fbf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.574672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.576563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:45.577501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.578381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.578666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.578946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.579801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.582277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.594008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e04f5-177a-499a-9029-cf732be77ead admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.601226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.603863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.605287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.605869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] PATH_INFO: `/v3/users/f95ffd8ceb3a4de588d478ed9fd625c1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.609101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95ffd8ceb3a4de588d478ed9fd625c1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.611483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.627556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2909/5766] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:45 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:34:45.628606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.645371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777192e7-ff43-4291-bcc5-49490cf1720f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.654437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.656865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.658081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.658378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.661109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.666026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.686046 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2910/5767] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:45.691752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.724854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed81c2-120e-476f-a710-1a36d39db56f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.736744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.737437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.737752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.738115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.738769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.740507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.748232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95ffd8ceb3a4de588d478ed9fd625c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.761537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95ffd8ceb3a4de588d478ed9fd625c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.776671 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2911/5768] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:45.777797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:45.781072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95ffd8ceb3a4de588d478ed9fd625c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.800628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e777d-498a-4242-bb05-5748048329f4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:45.806899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:45.808475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.808774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.809076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] PATH_INFO: `/v3/projects/7d9e293b7e9840769cbe14ae6785745e/users/6933bdf3247a42558349e9484afece54/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.817083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95ffd8ceb3a4de588d478ed9fd625c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.818948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5a801e75-d6cf-4a34-9415-b0d91f167940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95ffd8ceb3a4de588d478ed9fd625c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:45.831765 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2858/5769] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:45 2022] DELETE /identity/v3/users/f95ffd8ceb3a4de588d478ed9fd625c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:45.839364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.840163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.840453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.844308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9e293b7e9840769cbe14ae6785745e, user_id=6933bdf3247a42558349e9484afece54, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:45.847845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc552b-4329-47e0-a784-5d93596829fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:45.877173 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2912/5770] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:45 2022] PUT /identity/v3/projects/7d9e293b7e9840769cbe14ae6785745e/users/6933bdf3247a42558349e9484afece54/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:45.879326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:45.879788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:45.880261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:45.885014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:45.888160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:45.965445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] MFA Rules not processed for user `6933bdf3247a42558349e9484afece54`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:45.966736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:45.987329 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:46.049809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2859/5771] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:46.061710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.063201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:46.080381 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2913/5772] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:46.085183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.091608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:46.134174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f3d4-4702-46b4-994f-dd5699beebdf None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.139674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.140482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.140851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.141198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.142038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.144090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.191804 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2914/5773] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:46 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:46.196740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.207244 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:46.210544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2545153-3caa-4b27-8b00-5f9ba547947b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.283652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.284495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.285180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.285180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.406874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab9143-e8fe-4efe-a62e-608a02df5cc2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.419633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.420342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.420672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.420904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.421616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.423601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.464812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.467296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.481131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2915/5774] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:46 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:46.483144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.511235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10245447-7f94-4781-a458-ce95cc28ea7d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.524522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.525721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.526233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.526425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.527997 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2860/5775] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:34:46.529078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.530797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.558640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2916/5776] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:46.560283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.577136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64c3b-be69-4ba7-85bf-0d35516c43a5 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.591577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.594039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.594452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.594841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] PATH_INFO: `/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677/users/3d11dbc130f6439280f0339ab531ee41/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.634560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9f7e7a023f4ae7adf3f66a23572677, user_id=3d11dbc130f6439280f0339ab531ee41, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.637868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.664756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.665644 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2861/5777] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:46 2022] PUT /identity/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677/users/3d11dbc130f6439280f0339ab531ee41/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:46.677243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c18-0121-4920-92b5-7b76163dab3a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.793965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.794732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.794940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.795211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.795963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.797748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b6f99-ed2c-42a0-bb94-1619b907f69e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.838139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:46.839473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2917/5778] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:46.857081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba342f-08f3-4585-a119-028f27c8cd9b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:46.870005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:46.872585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.874019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.874438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] PATH_INFO: `/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677/users/3d11dbc130f6439280f0339ab531ee41/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.881861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9f7e7a023f4ae7adf3f66a23572677, user_id=3d11dbc130f6439280f0339ab531ee41, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:46.892927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:46.932596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:46.933181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:46.933664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:46.944717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2862/5779] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:46 2022] PUT /identity/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677/users/3d11dbc130f6439280f0339ab531ee41/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:46.975865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] MFA Rules not processed for user `3d11dbc130f6439280f0339ab531ee41`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:46.977520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:47.145872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2918/5780] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:47.152857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:47.155588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:47.170328 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:47.272423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501ccbd-81fc-4012-b407-5df8dbc66db4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:47.277167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:47.278129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:47.278647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:47.279038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:47.293184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:47.294939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:47.316024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2863/5781] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:47.617450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:47.625327 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:47.715750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:47.718557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:47.774089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9a660-2e59-42e0-92f8-f2ca5d6964e2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:47.779498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:47.780496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:47.781579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:47.781996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] PATH_INFO: `/v3/users/6933bdf3247a42558349e9484afece54` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:47.783804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6933bdf3247a42558349e9484afece54)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:47.785927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:47.914448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6933bdf3247a42558349e9484afece54'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:47.915207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6933bdf3247a42558349e9484afece54'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:47.923757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3323ca-6879-48a7-8e88-f91b08bce6e3 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:47.926156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6933bdf3247a42558349e9484afece54'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:47.931104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:47.931692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:47.931978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:47.932254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:47.937224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6933bdf3247a42558349e9484afece54'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:47.940280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:47.952776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6933bdf3247a42558349e9484afece54'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:47.965854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2919/5782] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:47 2022] DELETE /identity/v3/users/6933bdf3247a42558349e9484afece54 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:47.965854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:47.966127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:47.966572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:47.967527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:47.989693 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2864/5783] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:47.991248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:47.993785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.025228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a0e5a-082a-4ea2-8482-7685ac8068c5 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:48.105066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:48.106554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.107543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.107839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] PATH_INFO: `/v3/users/a5c3bab09678422b97397764530e5d2f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.109276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c3bab09678422b97397764530e5d2f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:48.111772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:48.173983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc25e-1688-4df6-a8bc-34147df43c52 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:48.193193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:48.197593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.198826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.199284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] PATH_INFO: `/v3/users/e0b873c4cd7b4558ab357acff39f0253` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.202979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b873c4cd7b4558ab357acff39f0253)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:48.213602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:48.243896 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:48.270169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c3bab09678422b97397764530e5d2f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.273832 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:48.285708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c3bab09678422b97397764530e5d2f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.314292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c3bab09678422b97397764530e5d2f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.331020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b873c4cd7b4558ab357acff39f0253'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.331971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b873c4cd7b4558ab357acff39f0253'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.344537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b873c4cd7b4558ab357acff39f0253'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.363320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b873c4cd7b4558ab357acff39f0253'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.363566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c3bab09678422b97397764530e5d2f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.364571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75355bc-bb7f-42a6-8cdf-a59baa4baa96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c3bab09678422b97397764530e5d2f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.380213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2865/5784] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:47 2022] DELETE /identity/v3/users/a5c3bab09678422b97397764530e5d2f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:48.383355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.383647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.383926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.390748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b873c4cd7b4558ab357acff39f0253'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.407700 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2920/5785] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:47 2022] DELETE /identity/v3/users/e0b873c4cd7b4558ab357acff39f0253 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:48.411039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:48.412905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.441842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:48.443693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.570056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688758-2a0c-40b4-a0f5-21fc3ca0495a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:48.577444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:48.579264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.579621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.580154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] PATH_INFO: `/v3/projects/1b8a8e2102054cd2b519867ed65b0664` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.581562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8a8e2102054cd2b519867ed65b0664)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:48.584566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:48.691857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8a8e2102054cd2b519867ed65b0664', 'request_id': 'req-4fef2e2d-a409-474e-b65c-dbc93097dd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.709816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8a8e2102054cd2b519867ed65b0664', 'request_id': 'req-4fef2e2d-a409-474e-b65c-dbc93097dd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.731847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8a8e2102054cd2b519867ed65b0664', 'request_id': 'req-4fef2e2d-a409-474e-b65c-dbc93097dd12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.748509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] The token cache is being invalidate because project 1b8a8e2102054cd2b519867ed65b0664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:48.749164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.750262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4fef2e2d-a409-474e-b65c-dbc93097dd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:48.752818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2921/5786] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:48 2022] DELETE /identity/v3/projects/1b8a8e2102054cd2b519867ed65b0664 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:48.754934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.756771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.757431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.792132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:48.793922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.829475 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:48.909134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2866/5787] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:48.914753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:48.916344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.957495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847fc1a-6bd9-483c-bbb8-4cdc5916e559 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:48.962962 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2922/5788] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:48.963862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:48.967097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:48.975482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:48.977799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:48.978104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:48.978387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] PATH_INFO: `/v3/users/acc59bac991442e189a314aba9199863` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:48.983222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc59bac991442e189a314aba9199863)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:48.987727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.067100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc59bac991442e189a314aba9199863'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.080078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc59bac991442e189a314aba9199863'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.089640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc59bac991442e189a314aba9199863'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.105186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d9df-cb30-42a1-bf5f-badff8e265af None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.106769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc59bac991442e189a314aba9199863'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.108647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc59bac991442e189a314aba9199863'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.113396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.118341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.119271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.121354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.125053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.138171 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2867/5789] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:48 2022] DELETE /identity/v3/users/acc59bac991442e189a314aba9199863 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:49.139118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.157525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.158122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.159969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.185112 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2923/5790] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:49.186385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.192496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.234581 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:49.256512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80bd1-3878-4ccf-a4d3-20a763ee2b28 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.358766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eb6f3-c8d7-4aaa-a0eb-1dde384d5891 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.375160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.376218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.376594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.376963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] PATH_INFO: `/v3/projects/0d638e520c9c4152afb6125e91dcb399` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.380527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d638e520c9c4152afb6125e91dcb399)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.382685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.423701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.425008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.426034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.426904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.431968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.511486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.514259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.538749 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2924/5791] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:49.540998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.542671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d638e520c9c4152afb6125e91dcb399', 'request_id': 'req-680be860-0400-4a34-86ad-14692635b37e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.543577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.550619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d638e520c9c4152afb6125e91dcb399', 'request_id': 'req-680be860-0400-4a34-86ad-14692635b37e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.559010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d638e520c9c4152afb6125e91dcb399', 'request_id': 'req-680be860-0400-4a34-86ad-14692635b37e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.567345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b353d0-6d4a-47d5-811d-0befe485d51b service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.576748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] The token cache is being invalidate because project 0d638e520c9c4152afb6125e91dcb399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:49.577060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.577911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-680be860-0400-4a34-86ad-14692635b37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.581002 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2868/5792] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:49 2022] DELETE /identity/v3/projects/0d638e520c9c4152afb6125e91dcb399 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:49.586741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510efa9-27ee-4d3f-9b7b-e73496cffb16 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.587092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510efa9-27ee-4d3f-9b7b-e73496cffb16 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.587448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510efa9-27ee-4d3f-9b7b-e73496cffb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.615615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6510efa9-27ee-4d3f-9b7b-e73496cffb16 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:49.617205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6510efa9-27ee-4d3f-9b7b-e73496cffb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.661226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.662998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.663457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.663731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] PATH_INFO: `/v3/users/f1aa22b79edf4f18aa1bc104be2b99cd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.665070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1aa22b79edf4f18aa1bc104be2b99cd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.666979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.694139 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:49.695022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2869/5793] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:49.704844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.705530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.706089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.734843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:49.735954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.743196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1aa22b79edf4f18aa1bc104be2b99cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.744264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1aa22b79edf4f18aa1bc104be2b99cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.746466 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2870/5794] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:49.750852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.757644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1aa22b79edf4f18aa1bc104be2b99cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.765551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7a037-e264-4ee3-b4e4-91da0ba1468c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.772230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.773177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.773508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.774017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.775017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:49.775380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.777255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.782262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1aa22b79edf4f18aa1bc104be2b99cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.795388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2871/5795] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:34:49.800386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.802611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.807536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f35fd507-37ee-4864-872f-35cc91830c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1aa22b79edf4f18aa1bc104be2b99cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:49.816417 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2925/5796] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:49 2022] DELETE /identity/v3/users/f1aa22b79edf4f18aa1bc104be2b99cd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:49.821423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.821775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.822011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.823710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4e4e-aa3a-4b0e-acb1-3fa044dd2900 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:49.848473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:49.851674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.884215 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:49.920976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:49.921770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:49.922150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:49.922529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:49.923327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:49.925840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:49.954751 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2926/5797] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:49.965730 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2872/5798] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:49 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:49.967740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.970034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:49.971948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:49.980048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f7f1-d334-42c0-aab3-d8bccb554bbc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.063049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9f6-97a4-4126-83b7-6ae06e7b2278 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.067425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.069107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.069789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.070252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.070910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.071183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.071541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.071780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.072342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.074779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.093705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.095556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.107326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2927/5799] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:49 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:34:50.114003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.119341 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2873/5800] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:50.127463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc88de-a787-4b52-994b-9e3f2960ea30 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.134712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.135566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.136011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.136318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.137474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.140027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.158025 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2928/5801] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:50.160330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.179397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0016c65-ac71-4362-81ad-4213c02d8ec3 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.186620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.186815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.187659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.187659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.188791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.190653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b341b-ffa5-45f4-8d79-4c2dd627483c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.209361 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2874/5802] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:50.212050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.229555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f82b1b-44e3-47eb-91ea-3752049802ce admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.238136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.239232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.239232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.240564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] PATH_INFO: `/v3/projects/3d222453d2a14232b467364e9d39ec72/users/491186789eb04cf5bf6c16d9d9d7d043/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.257447 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:50.262243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d222453d2a14232b467364e9d39ec72, user_id=491186789eb04cf5bf6c16d9d9d7d043, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.265835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.327428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2929/5803] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:50 2022] PUT /identity/v3/projects/3d222453d2a14232b467364e9d39ec72/users/491186789eb04cf5bf6c16d9d9d7d043/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:50.336646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.337745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.339768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.383178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:50.387263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:50.524603 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2875/5804] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:50.557285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.575789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.577455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:50.617307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055b1f6-7bb3-402a-a43f-7665e3320ab7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.631543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8945f7-4ae4-430b-9407-620257127bbe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.632115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.633293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.633780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.634715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] PATH_INFO: `/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.636611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3685d1ddd6645bfb6384f58e6b1773e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.638032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.639131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.639330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.639939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.640562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.653585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.655868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c8d9-525e-4d31-a988-851fb4469d95 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.671017 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2930/5805] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:50.706297 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:50.708084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3685d1ddd6645bfb6384f58e6b1773e', 'request_id': 'req-c63ace21-f223-4411-86af-0d0ca99f91c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:50.718753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3685d1ddd6645bfb6384f58e6b1773e', 'request_id': 'req-c63ace21-f223-4411-86af-0d0ca99f91c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:50.727849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3685d1ddd6645bfb6384f58e6b1773e', 'request_id': 'req-c63ace21-f223-4411-86af-0d0ca99f91c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:50.749831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] The token cache is being invalidate because project f3685d1ddd6645bfb6384f58e6b1773e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:50.750831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:50.751658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:50.757881 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2876/5806] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:50 2022] DELETE /identity/v3/projects/f3685d1ddd6645bfb6384f58e6b1773e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:50.760054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.760522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.760618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.791483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:50.792942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:50.795745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.798948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:50.926971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ace21-f223-4411-86af-0d0ca99f91c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.932931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.933998 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2931/5807] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:34:50.934909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:50.936294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:50.940459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.940753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.941028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] PATH_INFO: `/v3/projects/7d9e293b7e9840769cbe14ae6785745e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.942459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9e293b7e9840769cbe14ae6785745e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.944995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:50.953326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7aa1-338b-4ee9-8a34-2732606e4632 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:50.962542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:50.963890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:50.964678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:50.965206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] PATH_INFO: `/v3/projects/ab565d3e8f6341edae381b9cbfd8aa4b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:50.967607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab565d3e8f6341edae381b9cbfd8aa4b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:50.969994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.011894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9e293b7e9840769cbe14ae6785745e', 'request_id': 'req-d387528b-9528-478e-a8aa-d8f88a54a5e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.018593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9e293b7e9840769cbe14ae6785745e', 'request_id': 'req-d387528b-9528-478e-a8aa-d8f88a54a5e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.027053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9e293b7e9840769cbe14ae6785745e', 'request_id': 'req-d387528b-9528-478e-a8aa-d8f88a54a5e0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.037234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab565d3e8f6341edae381b9cbfd8aa4b', 'request_id': 'req-911c8110-03cd-4183-8248-36703381a6a4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.043483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab565d3e8f6341edae381b9cbfd8aa4b', 'request_id': 'req-911c8110-03cd-4183-8248-36703381a6a4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.046963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] The token cache is being invalidate because project 7d9e293b7e9840769cbe14ae6785745e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:51.047295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.050253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.051029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab565d3e8f6341edae381b9cbfd8aa4b', 'request_id': 'req-911c8110-03cd-4183-8248-36703381a6a4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.057746 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2877/5808] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:50 2022] DELETE /identity/v3/projects/7d9e293b7e9840769cbe14ae6785745e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:51.060261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.062802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.066216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] The token cache is being invalidate because project ab565d3e8f6341edae381b9cbfd8aa4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:51.066589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.067352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-911c8110-03cd-4183-8248-36703381a6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.073109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2932/5809] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:50 2022] DELETE /identity/v3/projects/ab565d3e8f6341edae381b9cbfd8aa4b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:51.073109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.073109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.073503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.097141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:51.098791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.116762 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:51.160684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387528b-9528-478e-a8aa-d8f88a54a5e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.171083 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:51.201689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2933/5810] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:51.201689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.201689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.220870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9edba-2f60-4507-8fe1-aadc22b4e898 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.227053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.228530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.228908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.229197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] PATH_INFO: `/v3/users/3d11dbc130f6439280f0339ab531ee41` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.230884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d11dbc130f6439280f0339ab531ee41)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.234064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.244687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.245752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.246296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.246673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] PATH_INFO: `/v3/projects/761163f4b25d4d6da7c1b164ecb868ed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.248105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=761163f4b25d4d6da7c1b164ecb868ed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.250590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.293229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d11dbc130f6439280f0339ab531ee41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.293968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d11dbc130f6439280f0339ab531ee41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.303949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d11dbc130f6439280f0339ab531ee41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.316264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761163f4b25d4d6da7c1b164ecb868ed', 'request_id': 'req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.322668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d11dbc130f6439280f0339ab531ee41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.323959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761163f4b25d4d6da7c1b164ecb868ed', 'request_id': 'req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.330947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761163f4b25d4d6da7c1b164ecb868ed', 'request_id': 'req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.354243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b6f3052-2414-476d-b498-4265d0c9b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d11dbc130f6439280f0339ab531ee41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.363170 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2934/5811] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:51 2022] DELETE /identity/v3/users/3d11dbc130f6439280f0339ab531ee41 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:51.364772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] The token cache is being invalidate because project 761163f4b25d4d6da7c1b164ecb868ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:51.365230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.368076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.368414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.372291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.375797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.378757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2878/5812] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:51 2022] DELETE /identity/v3/projects/761163f4b25d4d6da7c1b164ecb868ed => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:51.380003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.382995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.418896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:51.420165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.499049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd39464-0d5e-4a7f-9c9e-5cfb79c05e2d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.547703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2935/5813] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:51.548638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.550074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.567693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587d5b0-3b8a-4e16-bc39-c05f9118a5c5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.574501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.575625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.575955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.576239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] PATH_INFO: `/v3/users/395e456b484d4aed8929b2ac9c6793db` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.577830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=395e456b484d4aed8929b2ac9c6793db)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.579837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.584325 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:51.612405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.613296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.613713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.614110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.615773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:51.616254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.621776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2ebcd-1088-456d-99b4-69174421b61c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.629247 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:51.642947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2879/5814] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:51.644287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.644684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.644993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.667447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395e456b484d4aed8929b2ac9c6793db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.670410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395e456b484d4aed8929b2ac9c6793db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.670664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:51.672343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.683019 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2880/5815] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:51.684009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.685906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:51.690885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395e456b484d4aed8929b2ac9c6793db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.702485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e5db1-95a8-4a4b-bf7d-434391ba033e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.705093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395e456b484d4aed8929b2ac9c6793db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.711365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.712047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.712510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.712774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.713512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.716142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.731648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395e456b484d4aed8929b2ac9c6793db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:51.748307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2936/5816] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:34:51 2022] DELETE /identity/v3/users/395e456b484d4aed8929b2ac9c6793db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:51.749259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.757058 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2881/5817] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/projects => generated 399 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:51.758288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.837017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6edcf-373f-48d0-a3e2-a53fb77bbcec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.843570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.844013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.844302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.844575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.845350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.847845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.878352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2882/5818] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:34:51.878522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e923-967a-4d3a-b2eb-319ee41a72dd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.880293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.885103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.885964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.886324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.886747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.887600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:51.887973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.889971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.895035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38698-a883-4428-b86d-bb8838fa989d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.901041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.902377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.903004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.903511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.904425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.907055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.915107 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2937/5819] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:51.919560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.930529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52683246-1d0d-4cbf-95e5-07ccd56f0491 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.930794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2883/5820] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:51.933309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.938789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.939616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.939973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.940411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.941415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.943815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.951359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930bdc-c0e2-4af2-b405-27a2b2ceb2d4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:51.960023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:51.960962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:51.961517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:51.962095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:51.963256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:51.965225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:51.979539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2884/5821] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:51.984042 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2938/5822] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:51.984774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:51.985508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.006394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e5308-ee7c-4bd8-a2e1-390165d87ed7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.075261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd421ca-d608-407e-afeb-8cb232db0283 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.081820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.082696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.083101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.084028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.085149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.087407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.098736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.100529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.101094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.101552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] PATH_INFO: `/v3/projects/6e3f111730c04b47bf755ed025ec5d8a/users/2cd0156a41d14d22aedc4ffd08e19267/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.117247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2939/5823] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:51 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:52.118489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.126723 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:52.134358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6fcb3-f876-4f28-ab6d-e3c84a98fccf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.138215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3f111730c04b47bf755ed025ec5d8a, user_id=2cd0156a41d14d22aedc4ffd08e19267, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.143484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.144350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.144990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.145512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.147355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.149835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de7eeb-70bb-4d84-b572-be2374500294 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.150320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.167335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2940/5824] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:52.168797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.174257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2885/5825] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:51 2022] PUT /identity/v3/projects/6e3f111730c04b47bf755ed025ec5d8a/users/2cd0156a41d14d22aedc4ffd08e19267/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:34:52.181733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85218f70-fb30-40fe-8d65-23fcac30e5a1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.186296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.187922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.188437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.212817 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:52.243969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] MFA Rules not processed for user `2cd0156a41d14d22aedc4ffd08e19267`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:52.245469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:52.317134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.321086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.321969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.322825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.324787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.326823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.351651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2941/5826] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:34:52.353005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.356033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:52.376238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4d75-7e14-41ac-a47d-9e2173d1b714 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.391394 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2886/5827] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:52.393404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.402205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.403263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.405463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.405649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] PATH_INFO: `/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.407460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9f7e7a023f4ae7adf3f66a23572677)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.410629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.413280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeba56f-4703-4e7a-b5ca-721ab03494cd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.420210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.421558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.422283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.422729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] PATH_INFO: `/v3/projects/c1e8cf7bc5d54e85ba3cceae8f946af3/users/ab67a481784740b4b119c458c2c897f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.449424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e8cf7bc5d54e85ba3cceae8f946af3, user_id=ab67a481784740b4b119c458c2c897f8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.453055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.471628 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2887/5828] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:52 2022] PUT /identity/v3/projects/c1e8cf7bc5d54e85ba3cceae8f946af3/users/ab67a481784740b4b119c458c2c897f8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:52.473077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.506965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9f7e7a023f4ae7adf3f66a23572677', 'request_id': 'req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:52.514964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9f7e7a023f4ae7adf3f66a23572677', 'request_id': 'req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:52.529949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9f7e7a023f4ae7adf3f66a23572677', 'request_id': 'req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:52.574696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] The token cache is being invalidate because project cd9f7e7a023f4ae7adf3f66a23572677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:52.575796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:52.576848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f1b7ff6-32a3-44d6-ba30-eeb3b7d68486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:52.585595 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2942/5829] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:52 2022] DELETE /identity/v3/projects/cd9f7e7a023f4ae7adf3f66a23572677 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:52.591738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7b32-4130-4de4-b5c3-2180c659c679 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.593992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7b32-4130-4de4-b5c3-2180c659c679 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.595436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7b32-4130-4de4-b5c3-2180c659c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.627359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89c03-4214-415b-9953-98d112147de7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.662724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8ccd7b32-4130-4de4-b5c3-2180c659c679 None None] MFA Rules not processed for user `ab67a481784740b4b119c458c2c897f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:52.664679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ccd7b32-4130-4de4-b5c3-2180c659c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:52.747729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.748499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.748812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.751326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.751326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.753821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:52.797315 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2943/5830] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:52.798842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.799134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.799411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.807900 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:52.822504 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2888/5831] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:52 2022] POST /identity/v3/projects => generated 399 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:52.823708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:52.825393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:52.833196 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:52.844511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:52.845819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:52.932589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da6e51-f2a5-421a-889d-46b184a9b066 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:52.946467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:52.947469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:52.947761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:52.948043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] PATH_INFO: `/v3/projects/916568798ce44878958685fc48954370` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:52.951638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916568798ce44878958685fc48954370)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:52.953595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.008588 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2944/5832] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:53.008588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.010783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.050170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916568798ce44878958685fc48954370', 'request_id': 'req-f1a61a02-dd9d-45a8-ac42-587a21a30370'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:53.064472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916568798ce44878958685fc48954370', 'request_id': 'req-f1a61a02-dd9d-45a8-ac42-587a21a30370'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:53.078661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916568798ce44878958685fc48954370', 'request_id': 'req-f1a61a02-dd9d-45a8-ac42-587a21a30370'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:53.107676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] The token cache is being invalidate because project 916568798ce44878958685fc48954370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:34:53.108040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:53.111026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:34:53.119847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2889/5833] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:34:52 2022] DELETE /identity/v3/projects/916568798ce44878958685fc48954370 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:53.123887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.125796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.165798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f338cf5-3e86-42ae-b3ff-b38a87a15b46 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.298183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.298183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.298183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.298183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.299121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.303419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a61a02-dd9d-45a8-ac42-587a21a30370 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.310499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.311857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.312312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.313003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.314208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.317152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e5ac4-5e97-45c5-996e-5a1b62b785c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.362211 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2890/5834] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/users => generated 306 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:53.363716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ad04-7fda-4f51-8fdf-bd55a091b613 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.365449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ad04-7fda-4f51-8fdf-bd55a091b613 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.365992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ad04-7fda-4f51-8fdf-bd55a091b613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.396816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9408ad04-7fda-4f51-8fdf-bd55a091b613 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:53.398606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9408ad04-7fda-4f51-8fdf-bd55a091b613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.409506 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2891/5835] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:53.418199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.418492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.418774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.422062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.423535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.434649 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2945/5836] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:53.435530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.447502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946eed-4a73-4aa9-bfa2-6bd5c3dccde4 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.456685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.457431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.457738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.458022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.459420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.461054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.472130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2946/5837] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:53.473143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.479340 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:53.484180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:53.485502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.489225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711205a3-fa33-4417-8be7-b9e89ffe780d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.495325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2892/5838] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:53.524478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.531001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.535450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.535450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.535450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.535450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:53.535450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.537638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3e84-b3f1-4bff-86eb-7ab1f55f2215 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.562817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2947/5839] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:53.562817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.562817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.562817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.569783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f531-2ff6-4854-a4cb-6f90b5fc0b71 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.591646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.593233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.593514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.593940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] PATH_INFO: `/v3/projects/60b78f8889e64e5685bbfd974a67e83c/users/69775542255e49da8804a97b965dd538/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.599160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:53.608271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:53.609865 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:53.633783 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2948/5840] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:53.634653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.643893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b78f8889e64e5685bbfd974a67e83c, user_id=69775542255e49da8804a97b965dd538, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.647652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.656496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403ddc-eda5-4d0e-b37a-ed28d66f835a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.672715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2893/5841] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:53 2022] PUT /identity/v3/projects/60b78f8889e64e5685bbfd974a67e83c/users/69775542255e49da8804a97b965dd538/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:53.672715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.675117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.676089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.676624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.677128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.680009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.683992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.747076 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2949/5842] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:53.748193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.770763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1108-2001-4f53-a866-67e80e8bb054 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.871443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b4b6-8fd4-4a3c-8c03-127898a7d287 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.878332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.879186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.880416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.880966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.882276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.885005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.889935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.892599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.893578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.894197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.896828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:34:53.897521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.902463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.906416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2950/5843] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:53.906416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.917879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2719d-9910-42fe-a8e5-2518905ad766 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.924925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.925934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.926298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.926653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.928006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.934435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2894/5844] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:34:53.935713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.944950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:53.961886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945369f9-a5ff-479a-a380-805e595e99cf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:53.977739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:53.978922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:53.979809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:53.981012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] PATH_INFO: `/v3/projects/60b78f8889e64e5685bbfd974a67e83c/users/69775542255e49da8804a97b965dd538/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:53.988120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b78f8889e64e5685bbfd974a67e83c, user_id=69775542255e49da8804a97b965dd538, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:53.996349 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2951/5845] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:53.996349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:53.996673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.009921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780979-4f28-463f-9952-af19ab582403 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.023730 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2895/5846] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:53 2022] PUT /identity/v3/projects/60b78f8889e64e5685bbfd974a67e83c/users/69775542255e49da8804a97b965dd538/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:54.024676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.175545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652daa-1387-40fa-aed7-04aa4b427322 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.182396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.183173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.183526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.183870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.184640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.193340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.194279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.195530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.195988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.196980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.200178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.203911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6d45a-68da-4c70-8dda-6eb23199b707 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.233572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2896/5847] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:54.241139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.241792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.242251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.254138 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2952/5848] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:53 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:54.258530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.276408 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:54.290662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] MFA Rules not processed for user `69775542255e49da8804a97b965dd538`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:54.294670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:54.326990 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:54.414249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144738e-d42c-4b42-8a4d-a00210712a64 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.426993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.427756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.428036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.428311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.429056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.430715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.459780 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2953/5849] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:54.460516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.475754 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2897/5850] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:54.480552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.483722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa6c8-1c0b-4e3a-9d0c-0c35eeb9eae8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.495866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059dbd7-62bd-4cc2-85f7-a3143b33e03a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.496199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.496895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.497359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.497640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.499996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.502102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.502470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.503658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.504010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.504357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] PATH_INFO: `/v3/projects/827f09c11e8c4c2c81da44f8267ffff8/users/c1d69099241e4f2f8284165f47f6cb73/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.546584 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2954/5851] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:54 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:54.548115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.549340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827f09c11e8c4c2c81da44f8267ffff8, user_id=c1d69099241e4f2f8284165f47f6cb73, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.550898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:54.553081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.576813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2898/5852] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:54 2022] PUT /identity/v3/projects/827f09c11e8c4c2c81da44f8267ffff8/users/c1d69099241e4f2f8284165f47f6cb73/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:54.587713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.684080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b415-f675-4dfb-8907-dab83f8cf4d6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.734541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d20fa8-10dd-4ec6-b30f-968252df7408 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.762225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.776349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.776761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.777046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.778104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.781294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6243b8-83eb-49f3-9111-19324de658eb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.799957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2899/5853] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:54.801619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.802000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.803186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.809331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.810037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.810389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.810880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.839172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] MFA Rules not processed for user `c1d69099241e4f2f8284165f47f6cb73`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:54.841123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:54.918666 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:54.926258 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2900/5854] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:54.927600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.942607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7a5e-b95b-453e-95bb-c929afb63a11 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.949393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.950966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.951318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.951664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.952954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.953655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:54.955351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.955656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:54.969018 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2955/5855] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:54.970379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2901/5856] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:54.971234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.976220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:54.991407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f1b57-57ab-4cdd-9c0a-6452a430735e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.991856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a04bc-973c-4d55-98a5-aaf8ec35580a service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:54.997139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.998182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:54.998581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:54.998910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:54.999069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] PATH_INFO: `/v3/projects/d02e4111158048e38ed1255fd58b46a1/users/fc2ca29d52494f899bb14574bf6ddeef/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:54.999946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.000395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.000979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.002246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.004388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.010912 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:55.046547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02e4111158048e38ed1255fd58b46a1, user_id=fc2ca29d52494f899bb14574bf6ddeef, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.049707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773aa3-574e-401a-843b-a896e21924c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.064063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2956/5857] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:34:54 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:55.065201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:55.077496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2902/5858] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:54 2022] PUT /identity/v3/projects/d02e4111158048e38ed1255fd58b46a1/users/fc2ca29d52494f899bb14574bf6ddeef/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:55.089091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.092383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.092577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.126777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] MFA Rules not processed for user `fc2ca29d52494f899bb14574bf6ddeef`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:55.128315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:55.227381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2903/5859] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:55.270079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a85bc-08b2-41a6-bc2b-a12076aa7919 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:55.279430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:55.385041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970ac6-bdd6-41ba-bde5-218272ae9518 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:55.390856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:55.392606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.392883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.393153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.415980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.417621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.432485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:55.433184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.433467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.433768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.434400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2904/5860] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:55.434541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.447689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.498011 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2957/5861] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:34:55 2022] POST /identity/v3/users => generated 303 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:34:55.502707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:55.539121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bad3a9-a3c4-4c93-ae47-1b619f88663f service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:55.561413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:55.563236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.564457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.564975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.567233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.570100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.594761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:55.594960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2905/5862] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:55.613952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079f9-32ad-452d-aea4-6931bf300b36 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:55.632133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:55.633252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.634913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.635216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] PATH_INFO: `/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002/users/cf74a85ce6954841a1edb7458cdc0fcb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.678462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b4a7b0f22f4c88be7d7f22ba175002, user_id=cf74a85ce6954841a1edb7458cdc0fcb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.681136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.733746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2958/5863] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:55 2022] PUT /identity/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002/users/cf74a85ce6954841a1edb7458cdc0fcb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:55.737928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:55.754144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958285-844c-4ebd-a123-bb2227484fec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:55.910227 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:55.951785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:55.953166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:55.953625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:55.954106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:55.955055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:55.956878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73cae-64c6-4297-92c0-ac2821408b23 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:55.996115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2906/5864] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:34:55.998227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:56.017282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae006-fa87-4d87-9d12-36b84961ff1d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:56.034768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:56.035751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:56.036070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:56.038262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] PATH_INFO: `/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002/users/cf74a85ce6954841a1edb7458cdc0fcb/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:56.046074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b4a7b0f22f4c88be7d7f22ba175002, user_id=cf74a85ce6954841a1edb7458cdc0fcb, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:56.050916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:56.077866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2959/5865] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:34:55 2022] PUT /identity/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002/users/cf74a85ce6954841a1edb7458cdc0fcb/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:34:56.089232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:56.090980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:56.091677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:56.091959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:56.182757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] MFA Rules not processed for user `cf74a85ce6954841a1edb7458cdc0fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:56.184011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:56.214677 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:34:56.230943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501dc1-17fd-46b7-a59d-076fe3dcbd96 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:56.240422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:56.241109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:56.241402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:56.241696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:56.244857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:56.359105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2907/5866] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:56.383790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:56.385252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:56.408836 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2960/5867] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:57.045732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:57.066681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db800-4399-4eb1-93c8-b912fec34e78 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:57.082445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:57.085175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:57.085629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:57.086028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:57.120557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:57.125139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e1d9f-8d95-47a7-87ac-7422e8ae3a14 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:57.159342 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2908/5868] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:57.271473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:57.282838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683d759-919d-40ba-b72c-195c20bfd690 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:57.307192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:57.307663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:57.307948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:57.308224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:57.437845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:57.439323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:34:57.456082 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2961/5869] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:34:59.468937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:59.470576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:59.471264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:59.532028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] MFA Rules not processed for user `491186789eb04cf5bf6c16d9d9d7d043`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:34:59.533273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:59.729697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2909/5870] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:34:59.736091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:34:59.737535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:34:59.944208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4009-73ff-4f35-93e2-d9cee597b3f2 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:34:59.977063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:34:59.978315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:34:59.979180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:34:59.980152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:34:59.996125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:34:59.998990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe40c2a-56fd-412c-b44a-0ebed31fbf8c service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:00.028837 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2962/5871] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:04.470485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:04.471964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:04.583914 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:04.618743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeab5-22d8-4123-a072-438865403b56 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:04.624882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:04.627451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:04.628118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:04.628571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] PATH_INFO: `/v3/users/ab67a481784740b4b119c458c2c897f8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:04.630737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab67a481784740b4b119c458c2c897f8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:04.633584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:04.721506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab67a481784740b4b119c458c2c897f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:04.743614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab67a481784740b4b119c458c2c897f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:04.774978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab67a481784740b4b119c458c2c897f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:04.813005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab67a481784740b4b119c458c2c897f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:04.818477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab67a481784740b4b119c458c2c897f8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:04.838063 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2910/5872] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:04 2022] DELETE /identity/v3/users/ab67a481784740b4b119c458c2c897f8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:04.839936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:04.846097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:04.846385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:04.884808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:04.886231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:04.923412 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:04.994302 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2963/5873] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:05.004007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:05.007111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:05.172562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c853e1-2f21-4d90-9e97-8e24a8951eb8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:05.177375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:05.178078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:05.178367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:05.178790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:05.191356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:05.193493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec857-9b63-4e56-a774-87134d5b0a73 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:05.205929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2911/5874] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:05.521618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:05.524153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:05.551312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad80f-d2f5-4481-ba6b-e46024a1c843 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:05.566803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:05.568867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:05.569431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:05.570004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] PATH_INFO: `/v3/projects/c1e8cf7bc5d54e85ba3cceae8f946af3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:05.574600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e8cf7bc5d54e85ba3cceae8f946af3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:05.579410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:05.612143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574003fc-0149-4b3a-af50-8a36a08352af None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:05.613313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574003fc-0149-4b3a-af50-8a36a08352af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:05.614041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574003fc-0149-4b3a-af50-8a36a08352af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:05.665747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-574003fc-0149-4b3a-af50-8a36a08352af None None] MFA Rules not processed for user `491186789eb04cf5bf6c16d9d9d7d043`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:05.670051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-574003fc-0149-4b3a-af50-8a36a08352af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:05.726876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e8cf7bc5d54e85ba3cceae8f946af3', 'request_id': 'req-4ecf3828-dd44-4eb6-a525-805be958d1d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:05.745617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e8cf7bc5d54e85ba3cceae8f946af3', 'request_id': 'req-4ecf3828-dd44-4eb6-a525-805be958d1d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:05.782047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e8cf7bc5d54e85ba3cceae8f946af3', 'request_id': 'req-4ecf3828-dd44-4eb6-a525-805be958d1d7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:05.830453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] The token cache is being invalidate because project c1e8cf7bc5d54e85ba3cceae8f946af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:05.830780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:05.831864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2912/5875] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:05.832363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ecf3828-dd44-4eb6-a525-805be958d1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:05.847183 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2964/5876] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:05 2022] DELETE /identity/v3/projects/c1e8cf7bc5d54e85ba3cceae8f946af3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:05.855258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:05.855577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:05.855813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:05.943592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:05.948753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:05.964134 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:06.135699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2913/5877] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:06.138473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.141503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.141984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.187789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:06.191709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:06.227293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2965/5878] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:06.232190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.249626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a1d2-1a87-44c6-8143-d3e32ffd767d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:06.265346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:06.268624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.269043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.270636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.272126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:06.272595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:06.275366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:06.307289 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2914/5879] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:06.312835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.338047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d2a0-baf4-4414-9220-b7b9583bae32 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:06.361615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:06.362349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.362632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.362912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.367034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:06.373285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:06.460866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.475261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2966/5880] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:06 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:06.476492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.479567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9a86-ce5c-40b0-bf80-d3d394632458 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:06.483005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:06.628673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:06.631149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.631915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.632476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.633937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:06.637642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:06.685247 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2915/5881] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:06 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:06.686471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.689551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:06.704295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e1aa3-54fc-4024-8f2f-64e7ed47f3eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:06.713313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa45a0-2a21-4103-9f28-6c85224d8496 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:06.716544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:06.718128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.718408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.718827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] PATH_INFO: `/v3/users/fc2ca29d52494f899bb14574bf6ddeef` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.721124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2ca29d52494f899bb14574bf6ddeef)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:06.724291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:06.726435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:06.727575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.728009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.728450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] PATH_INFO: `/v3/users/2cd0156a41d14d22aedc4ffd08e19267` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.733836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd0156a41d14d22aedc4ffd08e19267)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:06.736295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:06.779822 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:06.831377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2ca29d52494f899bb14574bf6ddeef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.832820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2ca29d52494f899bb14574bf6ddeef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.850159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd0156a41d14d22aedc4ffd08e19267'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.852503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2ca29d52494f899bb14574bf6ddeef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.866960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd0156a41d14d22aedc4ffd08e19267'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.871885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2ca29d52494f899bb14574bf6ddeef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.879267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd0156a41d14d22aedc4ffd08e19267'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.910915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2ca29d52494f899bb14574bf6ddeef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.911921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd0156a41d14d22aedc4ffd08e19267'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.913403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-40743c35-3222-4e9a-a3aa-0a71ac045b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd0156a41d14d22aedc4ffd08e19267'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:06.919571 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:06.940923 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2967/5882] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:06 2022] DELETE /identity/v3/users/fc2ca29d52494f899bb14574bf6ddeef => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:06.942766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:06.943010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2916/5883] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:06 2022] DELETE /identity/v3/users/2cd0156a41d14d22aedc4ffd08e19267 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:06.946637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727ba8f-8f4a-455e-a2a7-8b4bb63eef0c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:06.948138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727ba8f-8f4a-455e-a2a7-8b4bb63eef0c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:06.948409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727ba8f-8f4a-455e-a2a7-8b4bb63eef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:06.949533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.013263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1727ba8f-8f4a-455e-a2a7-8b4bb63eef0c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:07.014265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1727ba8f-8f4a-455e-a2a7-8b4bb63eef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.155130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837611c3-7d70-4e9c-934a-e647c05ef622 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:07.168517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2917/5884] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:07.169215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:07.169555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.169822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.170014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.170138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.170342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.170553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.170985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:07.172600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:07.199273 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2968/5885] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:07.200211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:07.204100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.207547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:07.208881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.224723 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2918/5886] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:07.234168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:07.237112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.265013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e369f-e8bc-488a-a88e-1fcbef2b5391 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:07.275930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:07.278710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.278710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.279001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.280932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:07.285733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:07.311594 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2919/5887] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:07.312554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:07.316913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.356489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a63e-1f0e-460b-ab1a-0de5bf86ebb5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:07.360764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:07.361429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.361758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.362871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.387178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:07.394848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:07.427425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956b23-9d93-4f9d-9684-89ba1de125f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:07.431937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:07.432915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.433415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.433962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.434851 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2969/5888] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:07.435774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:07.448936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:07.450886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2e13c-8840-4ffc-8428-ab11fc005a77 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:07.463606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2920/5889] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:07.471136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559db8c9-58bc-41cc-bed3-15abc71d4d43 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:07.488533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:07.490414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.490773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.491121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] PATH_INFO: `/v3/projects/b9d3b47785a5476ba1befe718e4f7e39/users/212314e131334e4abe2def271df7c74f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.513185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d3b47785a5476ba1befe718e4f7e39, user_id=212314e131334e4abe2def271df7c74f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:07.516230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:07.561869 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2970/5890] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:07 2022] PUT /identity/v3/projects/b9d3b47785a5476ba1befe718e4f7e39/users/212314e131334e4abe2def271df7c74f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:07.571721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:07.572566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:07.573129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:07.660190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] MFA Rules not processed for user `212314e131334e4abe2def271df7c74f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:07.664107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.930493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:07.934672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:07.947201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2921/5891] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:07.976751 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:08.139128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777c217-63f3-4c24-be9c-1b370628649c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:08.158449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:08.159954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:08.160210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:08.160496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] PATH_INFO: `/v3/users/c1d69099241e4f2f8284165f47f6cb73` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:08.167408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d69099241e4f2f8284165f47f6cb73)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:08.169899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:08.261263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:08.262918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:08.318372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d69099241e4f2f8284165f47f6cb73'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:08.320070 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:08.320410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d69099241e4f2f8284165f47f6cb73'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:08.346721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d69099241e4f2f8284165f47f6cb73'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:08.374446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d69099241e4f2f8284165f47f6cb73'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:08.424222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-00be2972-7217-4dbd-9f02-88d076819032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d69099241e4f2f8284165f47f6cb73'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:08.461748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2971/5892] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:07 2022] DELETE /identity/v3/users/c1d69099241e4f2f8284165f47f6cb73 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:08.470014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:08.470317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:08.472800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:08.519782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156025a-848a-422e-8f27-d6b2db700492 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:08.530417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:08.534758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:08.662064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:08.665136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:08.665468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:08.665775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:08.669287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:08.710278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2972/5893] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:08.771563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:08.772998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:08.825238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b23dc-f5ec-4916-8c96-3b580285dd5e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:08.842278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:08.842953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:08.843242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:08.843520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:08.885284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:08.888000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:08.892364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:08.894390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:08.930565 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2922/5894] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:08.930931 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2973/5895] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:09.090303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.093990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.110832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.112322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.166477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620871a2-e721-45fc-add4-0eff3f8c3a45 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.170740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018b6ea-c922-48c5-b572-fde29879f5e6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.184214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.186700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.187233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.187619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.188084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] PATH_INFO: `/v3/projects/6e3f111730c04b47bf755ed025ec5d8a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.188650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.189520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.189520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] PATH_INFO: `/v3/projects/d02e4111158048e38ed1255fd58b46a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.191465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02e4111158048e38ed1255fd58b46a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.192396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3f111730c04b47bf755ed025ec5d8a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.194016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.198868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.250581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:09.371774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02e4111158048e38ed1255fd58b46a1', 'request_id': 'req-6fb7c640-a26a-453d-8531-bd1b367a070b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.375640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3f111730c04b47bf755ed025ec5d8a', 'request_id': 'req-20989424-6a55-41f2-8725-3bd8d9b00f9a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.393297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02e4111158048e38ed1255fd58b46a1', 'request_id': 'req-6fb7c640-a26a-453d-8531-bd1b367a070b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.397120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3f111730c04b47bf755ed025ec5d8a', 'request_id': 'req-20989424-6a55-41f2-8725-3bd8d9b00f9a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.423793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3f111730c04b47bf755ed025ec5d8a', 'request_id': 'req-20989424-6a55-41f2-8725-3bd8d9b00f9a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.431628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02e4111158048e38ed1255fd58b46a1', 'request_id': 'req-6fb7c640-a26a-453d-8531-bd1b367a070b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.453218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] The token cache is being invalidate because project d02e4111158048e38ed1255fd58b46a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:09.453610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.455026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.456947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2923/5896] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:09 2022] DELETE /identity/v3/projects/d02e4111158048e38ed1255fd58b46a1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:09.457300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] The token cache is being invalidate because project 6e3f111730c04b47bf755ed025ec5d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:09.457990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.458794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.459776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20989424-6a55-41f2-8725-3bd8d9b00f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.460893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.464785 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2974/5897] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:09 2022] DELETE /identity/v3/projects/6e3f111730c04b47bf755ed025ec5d8a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:09.464785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.464785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.464785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.478876 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:09.503190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:09.504440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.622578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c640-a26a-453d-8531-bd1b367a070b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.636463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.638006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.638611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.641247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.644692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.673059 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2975/5898] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:09.673059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.674727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.675855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.679468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11839-c5d4-4105-a1af-b69003eee752 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.699996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637bc9-408d-4973-bb10-70a2800d0818 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.704778 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2924/5899] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:09.706156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.706449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.706732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.714082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.714977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.715263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.715544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] PATH_INFO: `/v3/users/69775542255e49da8804a97b965dd538` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.718576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69775542255e49da8804a97b965dd538)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.720762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.753087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:09.754387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.784817 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2925/5900] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:09.793230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.818721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25099935-4eec-421a-84f3-8d31e07bbda0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.824277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.824974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.825258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.825538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.826379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:09.826691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.828609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.857367 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2926/5901] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:09.858471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.860318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.873770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69775542255e49da8804a97b965dd538'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.878591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69775542255e49da8804a97b965dd538'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.887199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400ee3-f389-45ce-aacd-40f8aef8ca8c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:09.893276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69775542255e49da8804a97b965dd538'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.900065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:09.901210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:09.903563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:09.904065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] PATH_INFO: `/v3/projects/827f09c11e8c4c2c81da44f8267ffff8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:09.909723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827f09c11e8c4c2c81da44f8267ffff8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:09.910825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69775542255e49da8804a97b965dd538'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.913501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:09.946468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69775542255e49da8804a97b965dd538'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:09.961688 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2976/5902] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:09 2022] DELETE /identity/v3/users/69775542255e49da8804a97b965dd538 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:09.962547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:09.986940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:09.996197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827f09c11e8c4c2c81da44f8267ffff8', 'request_id': 'req-84b96a00-3544-4643-91c9-41fd6e581097'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.027804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827f09c11e8c4c2c81da44f8267ffff8', 'request_id': 'req-84b96a00-3544-4643-91c9-41fd6e581097'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.046312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827f09c11e8c4c2c81da44f8267ffff8', 'request_id': 'req-84b96a00-3544-4643-91c9-41fd6e581097'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.057280 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:10.085708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] The token cache is being invalidate because project 827f09c11e8c4c2c81da44f8267ffff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:10.086562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.088314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.093492 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2927/5903] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:09 2022] DELETE /identity/v3/projects/827f09c11e8c4c2c81da44f8267ffff8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:10.098258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:10.100372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:10.208183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4d1bc-d129-408d-9244-9174f8bfbd25 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:10.213464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:10.214200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:10.215214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:10.215691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:10.216586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:10.219347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:10.277143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2977/5904] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:09 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:10.282829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:10.292887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:10.427374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b96a00-3544-4643-91c9-41fd6e581097 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:10.447047 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:10.541924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc01b2-4ef6-4ab9-a814-2ca8af9bbea8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:10.554897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:10.555752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:10.556039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:10.556320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:10.562994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:10.574909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:10.666014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:10.666986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:10.667274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:10.667543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] PATH_INFO: `/v3/users/cf74a85ce6954841a1edb7458cdc0fcb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:10.670512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf74a85ce6954841a1edb7458cdc0fcb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:10.673463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:10.680400 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2978/5905] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:10 2022] POST /identity/v3/users => generated 287 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:10.684261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:10.723155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611db3a-fc13-4626-82e2-1b2a9a26476c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:10.767278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:10.769180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:10.769469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:10.772593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:10.772854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:10.775827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:10.799641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf74a85ce6954841a1edb7458cdc0fcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.813698 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2979/5906] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:10.814641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:10.824518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf74a85ce6954841a1edb7458cdc0fcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.841198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf74a85ce6954841a1edb7458cdc0fcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.844198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26edc-f9cd-4f19-9623-ff1b5fbc2b77 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:10.858650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:10.859123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:10.860975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:10.861929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:10.862722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:10.865889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95305034-4ce6-496a-b02a-114233bc65f6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:10.875368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf74a85ce6954841a1edb7458cdc0fcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.878460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf74a85ce6954841a1edb7458cdc0fcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:10.904177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2928/5907] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:10 2022] DELETE /identity/v3/users/cf74a85ce6954841a1edb7458cdc0fcb => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:10.917067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:10.917633 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2980/5908] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:10.918772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.108078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60435ee-2be7-4650-9d7d-7449953803b6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:11.113121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:11.120874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.120874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.120874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] PATH_INFO: `/v3/projects/81e420896e8b4382b3441e63abf81c15/users/280d6677ca794b7eab9fb6f4214f572e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.153912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e420896e8b4382b3441e63abf81c15, user_id=280d6677ca794b7eab9fb6f4214f572e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:11.158698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:11.211503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.212016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.212372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.214945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2929/5909] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:10 2022] PUT /identity/v3/projects/81e420896e8b4382b3441e63abf81c15/users/280d6677ca794b7eab9fb6f4214f572e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:11.226117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:11.228129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.240251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:11.242845 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:11.244096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.407697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19571d81-d719-4914-9a34-f719cb6ca600 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:11.420055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:11.421130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.421284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.421464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] PATH_INFO: `/v3/projects/60b78f8889e64e5685bbfd974a67e83c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.426678 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2981/5910] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:11.426934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b78f8889e64e5685bbfd974a67e83c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:11.426934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:11.437427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:11.441420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.464947 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:11.555011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b78f8889e64e5685bbfd974a67e83c', 'request_id': 'req-c4d975b6-ab54-46ee-9873-ada3830dc2af'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:11.580129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b78f8889e64e5685bbfd974a67e83c', 'request_id': 'req-c4d975b6-ab54-46ee-9873-ada3830dc2af'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:11.592152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b78f8889e64e5685bbfd974a67e83c', 'request_id': 'req-c4d975b6-ab54-46ee-9873-ada3830dc2af'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:11.619140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29fad-5348-4ebc-b96b-8f6bdeb9d703 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:11.633021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] The token cache is being invalidate because project 60b78f8889e64e5685bbfd974a67e83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:11.635066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:11.637298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4d975b6-ab54-46ee-9873-ada3830dc2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:11.640461 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2930/5911] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:11 2022] DELETE /identity/v3/projects/60b78f8889e64e5685bbfd974a67e83c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:11.646843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6d51-6ebf-421a-b977-50759481467d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.647468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6d51-6ebf-421a-b977-50759481467d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.648352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd6d51-6ebf-421a-b977-50759481467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.686930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1ccd6d51-6ebf-421a-b977-50759481467d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:11.688313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ccd6d51-6ebf-421a-b977-50759481467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.716407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:11.717072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.717357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.717632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.719774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.808331 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2931/5912] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:11.823053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.823340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.823622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.854231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:11.855957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:11.872589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2932/5913] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:11.874507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:11.894293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:11.902334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:11.909441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3ccf-dbba-4ff7-ac0a-903e92321813 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:11.919315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:11.920003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.920282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.920551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.921297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:11.921598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:11.924947 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2982/5914] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:11.926022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:11.939410 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2933/5915] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:11.944700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:11.955122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045994e-c338-4eaf-9ad4-c848d66a96cc service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:11.961228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:11.961935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:11.962226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:11.964526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:11.964526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:11.965242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:11.998147 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2983/5916] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:11 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:35:12.002045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.014435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e600021-68e0-4da3-a9cf-e204a532be84 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.045006 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:12.106722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.107647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.108093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.109218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.110154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.113370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.164056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2934/5917] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:12.166745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.184678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad374-2ea3-4f7f-9d5c-16da8feb6d63 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.201406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.202748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.203057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.203253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.204000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.205607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.236364 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2984/5918] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:12.238726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.258408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2be38-070e-4ff0-b491-202eca28104e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.274340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.280940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.281378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.283664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.286961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.298436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.334921 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2935/5919] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:12.336572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.355560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d41def-1732-4953-bece-b817ffd05810 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.369073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.370813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.373428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.374140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] PATH_INFO: `/v3/projects/abbf0f596b7244e7be44677c6dbd03f1/users/261fe700479d4c149b21d7d95c51e7f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.380609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.382201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:12.416789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ab61b-8caa-48bc-873d-cfc2f95600c0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.429058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.430398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbf0f596b7244e7be44677c6dbd03f1, user_id=261fe700479d4c149b21d7d95c51e7f3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.432564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.432729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.434505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] PATH_INFO: `/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.434609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ccfe-fada-4ddd-a218-b8f679f15d6d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.439980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b4a7b0f22f4c88be7d7f22ba175002)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.442991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.455389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2985/5920] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:12 2022] PUT /identity/v3/projects/abbf0f596b7244e7be44677c6dbd03f1/users/261fe700479d4c149b21d7d95c51e7f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:12.472518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.473566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.476208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.543994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] MFA Rules not processed for user `261fe700479d4c149b21d7d95c51e7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:12.545230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:12.550699 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:12.564370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b4a7b0f22f4c88be7d7f22ba175002', 'request_id': 'req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:12.583825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b4a7b0f22f4c88be7d7f22ba175002', 'request_id': 'req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:12.591467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b4a7b0f22f4c88be7d7f22ba175002', 'request_id': 'req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:12.618198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] The token cache is being invalidate because project 78b4a7b0f22f4c88be7d7f22ba175002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:12.619252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:12.619725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6f6fdb4f-2d14-4e0d-b4ca-2fac708cad1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:12.625836 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2936/5921] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:12 2022] DELETE /identity/v3/projects/78b4a7b0f22f4c88be7d7f22ba175002 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:12.653275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e9d4-584b-42ea-beb6-6b830cbbb0d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.656622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e9d4-584b-42ea-beb6-6b830cbbb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.662783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e9d4-584b-42ea-beb6-6b830cbbb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.696202 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2986/5922] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:12.700849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.702934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:12.708092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f205e9d4-584b-42ea-beb6-6b830cbbb0d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:12.710182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f205e9d4-584b-42ea-beb6-6b830cbbb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:12.814069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2937/5923] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:12.827791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.828353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.828780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.840031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95787a52-063d-41aa-91bd-2cfe4f0952a9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.853220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:12.854065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:12.854475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:12.855713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:12.858315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:12.860383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:12.871003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:12.876338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:12.898757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2938/5924] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:12.902285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.926755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2987/5925] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:12.930529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:12.932989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c4523-9549-4a02-8829-220ba7f5353b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:12.974377 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:13.085927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.088194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.090910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.091206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.093551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:13.093551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.108265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.139632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1182b-6682-41b6-a303-175840fad38a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.142522 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2939/5926] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:35:13.143539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.151371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.152336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.154496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.154929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.155749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.156645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedef7-a14d-487b-8c5b-1bd0ade240db admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.162731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.169990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.170682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.170968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.171247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.171958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.176761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.214565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2988/5927] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:12 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:13.215514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.226581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2940/5928] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:13 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:13.228869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.246198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab9029-4f32-43cc-aca6-8f0d7b1689aa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.281159 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:13.328899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b33c8-d84b-44f8-84ce-f652f4642085 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.333819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.334927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.335475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.335996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.338379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.338682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.339380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.339663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.339937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.340131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.340630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.343538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.357601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2989/5929] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:13.358748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.371039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06b8e-74c0-42d2-a043-6a7f9c966c91 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.376397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2941/5930] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:13 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:13.377511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.378273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.378649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.379044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] PATH_INFO: `/v3/projects/c7e547cd026740e08cac822ac2f6d35c/users/b2e593c3045b438385a299b36a3d6f3b/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.381412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.399377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a3b4e-4475-4a08-960c-a54111e3642c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.400458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e547cd026740e08cac822ac2f6d35c, user_id=b2e593c3045b438385a299b36a3d6f3b, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.404319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.405303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.406193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.406477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.406753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.407703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.409771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.420803 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2990/5931] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:13 2022] PUT /identity/v3/projects/c7e547cd026740e08cac822ac2f6d35c/users/b2e593c3045b438385a299b36a3d6f3b/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:13.424539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2942/5932] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:13.426131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.426559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.444107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d200bb8-d07a-496c-b194-bcfe72b91521 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.512437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6ba1-380d-457b-8563-2a87a95d804b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.519354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.520864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.521407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.521900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.522081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.522468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.522752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.522939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.523050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.523761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.524787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.525368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.541429 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2991/5933] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:13.542510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.556667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2350d2-f047-481e-a5f8-36a1d4e36f2b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.558097 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2943/5934] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:13.559062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.562404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.563605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.563986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.564888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] PATH_INFO: `/v3/projects/c7e547cd026740e08cac822ac2f6d35c/users/b2e593c3045b438385a299b36a3d6f3b/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.568303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e547cd026740e08cac822ac2f6d35c, user_id=b2e593c3045b438385a299b36a3d6f3b, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.571759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841093a-2ca4-4108-b133-ae03be5f9db5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.575172 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:13.589603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea05d-418a-4076-bbc9-4dc37f47289d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:13.607471 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2992/5935] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:13 2022] PUT /identity/v3/projects/c7e547cd026740e08cac822ac2f6d35c/users/b2e593c3045b438385a299b36a3d6f3b/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:13.609198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.610424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.611807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.666155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] MFA Rules not processed for user `b2e593c3045b438385a299b36a3d6f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:13.667766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:13.705500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:13.706796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.706991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.707307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] PATH_INFO: `/v3/projects/64b9be90c4164b669023b4a6a42df574/users/93af4655b28648d08cded0540173d2ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.733384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b9be90c4164b669023b4a6a42df574, user_id=93af4655b28648d08cded0540173d2ac, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:13.736768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63026afd-ebc5-4a39-a39a-6888ad89f8a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:13.760612 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2944/5936] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:13 2022] PUT /identity/v3/projects/64b9be90c4164b669023b4a6a42df574/users/93af4655b28648d08cded0540173d2ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:13.766082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:13.766377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:13.766663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:13.777369 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2993/5937] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:13.788288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:13.788892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.789500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:13.790493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:13.796574 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:13.888969 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2945/5938] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:13.896782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:13.899524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:13.919310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2c53-2c1d-487d-bbf5-1b619374c793 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:14.007804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a227e1-44f0-43cb-b4dc-9b120f707e6e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:14.012622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:14.013288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:14.013609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:14.013860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:14.025861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:14.036077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:14.048528 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2946/5939] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:14.075195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:14.076147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:14.076514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:14.077021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:14.222554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:14.226353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e7bfb-84cd-4d11-aba5-945832683b89 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:14.240875 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2994/5940] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:14.421153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:14.428136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:14.428695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:14.428892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:14.447788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684022-ff5b-4f0c-ae97-528d2d5e6a6b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:14.455296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:14.456179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:14.456463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:14.459571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:14.472774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] MFA Rules not processed for user `280d6677ca794b7eab9fb6f4214f572e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:14.474611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:14.575560 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:14.603125 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:14.622623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2995/5941] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:14.627404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:14.628939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:14.649458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf870-1d6f-4aa3-80f8-bb5bd48a6934 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:14.657793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:14.657793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:14.657793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:14.657793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:14.689796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:14.694939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51954d1b-0a30-44ff-80ef-b4572506c560 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:14.724639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:14.729781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:14.737081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2996/5942] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:14.758180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2947/5943] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:16.270705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:16.271833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:16.271833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:16.333094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] MFA Rules not processed for user `93af4655b28648d08cded0540173d2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:16.335756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:16.495944 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2997/5944] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:16.496789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:16.513309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae5e86-417f-436a-ae94-18028c094f76 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:16.535038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:16.536213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:16.536491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:16.537306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:16.538136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:16.540568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:16.636850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:16.638588 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2948/5945] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:16 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:16.656585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697344b5-95c1-49fc-b25f-2d0bf3347668 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:16.803650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:16.804363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:16.804666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:16.805004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:16.806695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:16.811175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:16.863469 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2998/5946] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:16 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:35:16.864174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:16.875798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe9bcc-3cf8-4dad-9afa-9e3ad36d5532 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:16.902599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:16.903303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:16.903587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:16.903865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:16.909407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:16.914282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:16.946996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2949/5947] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:35:16.951555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:16.968858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177f3a-51b0-4367-88d5-fca58d5ec1c9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:16.990830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:16.991963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:16.992546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:16.992546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] PATH_INFO: `/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d/users/b5868f042aab4af78667da4af123f8d5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:17.037272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f32ff6bc944c2399238fed43f1ed2d, user_id=b5868f042aab4af78667da4af123f8d5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:17.050628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:17.079730 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 2999/5948] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:16 2022] PUT /identity/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d/users/b5868f042aab4af78667da4af123f8d5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:17.084599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:17.099768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfbe7-2e6a-4ff6-8bbc-5821157d2711 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:17.263056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:17.263826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:17.264109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:17.264638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:17.265652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:17.269127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d8f8e-8173-4ac7-a0d0-48c62188f2fd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:17.287791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2950/5949] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:35:17.291537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:17.310442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e7a3-e161-467d-871a-5a19a0dc4958 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:17.320168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:17.321091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:17.321941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:17.322255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] PATH_INFO: `/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d/users/b5868f042aab4af78667da4af123f8d5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:17.327377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f32ff6bc944c2399238fed43f1ed2d, user_id=b5868f042aab4af78667da4af123f8d5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:17.334733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a9ad0-48d1-4ec1-a58e-dbbb2d55a03f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:17.361076 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3000/5950] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:17 2022] PUT /identity/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d/users/b5868f042aab4af78667da4af123f8d5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:17.791088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c745-462c-4f22-aa8a-283676e954a6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:17.791702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c745-462c-4f22-aa8a-283676e954a6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:17.791702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c745-462c-4f22-aa8a-283676e954a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:17.822538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-74d2c745-462c-4f22-aa8a-283676e954a6 None None] MFA Rules not processed for user `280d6677ca794b7eab9fb6f4214f572e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:17.826356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-74d2c745-462c-4f22-aa8a-283676e954a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:18.024472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2951/5951] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:19.323338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:19.324387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:19.324935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:19.386597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] MFA Rules not processed for user `b5868f042aab4af78667da4af123f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:19.387754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:19.395713 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:19.558308 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3001/5952] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:19.560393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:19.560808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:19.560956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:19.583739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] MFA Rules not processed for user `93af4655b28648d08cded0540173d2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:19.584955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:19.623807 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:19.698987 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2952/5953] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:19.719391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:19.721027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:19.846892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ba3d-0a18-4d34-b5a5-ac2519d4dc7c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:19.854841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:19.855526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:19.855813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:19.856094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:19.877157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:19.880108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984ed0-646b-4435-acfe-8b44aa295d57 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:19.914369 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3002/5954] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:20.633337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:20.634864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:20.831925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbd73f-008b-41a9-a28c-4b8c0af61a1d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:20.868394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:20.869308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:20.869587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:20.869892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] PATH_INFO: `/v3/users/212314e131334e4abe2def271df7c74f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:20.879402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=212314e131334e4abe2def271df7c74f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:20.881591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:21.016038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212314e131334e4abe2def271df7c74f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:21.049438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212314e131334e4abe2def271df7c74f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:21.071110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212314e131334e4abe2def271df7c74f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:21.131126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212314e131334e4abe2def271df7c74f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:21.132197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212314e131334e4abe2def271df7c74f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:21.152294 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2953/5955] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:20 2022] DELETE /identity/v3/users/212314e131334e4abe2def271df7c74f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:21.156468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:21.156939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:21.157033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:21.200230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:21.202013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:21.343019 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3003/5956] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:21.370148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:21.375010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:21.590791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbd3fd-8027-46c4-84de-11be69cdc29b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:21.624043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:21.624824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:21.625273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:21.626452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:21.676214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:21.683426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f639b4d-3ff8-45d4-a26a-b6a37604c16a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:21.734787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2954/5957] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:22.829905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:22.831924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:22.851969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50c56a-43fa-4dd1-b605-d552c7de1793 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:22.863363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:22.864950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:22.865237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:22.865517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] PATH_INFO: `/v3/projects/b9d3b47785a5476ba1befe718e4f7e39` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:22.869480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d3b47785a5476ba1befe718e4f7e39)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:22.871649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:22.926886 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:22.980908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d3b47785a5476ba1befe718e4f7e39', 'request_id': 'req-633b6532-09e8-4216-bee6-0064c806e26c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:22.999323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d3b47785a5476ba1befe718e4f7e39', 'request_id': 'req-633b6532-09e8-4216-bee6-0064c806e26c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:23.024320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d3b47785a5476ba1befe718e4f7e39', 'request_id': 'req-633b6532-09e8-4216-bee6-0064c806e26c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:23.050333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] The token cache is being invalidate because project b9d3b47785a5476ba1befe718e4f7e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:23.050859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:23.052318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-633b6532-09e8-4216-bee6-0064c806e26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:23.056083 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3004/5958] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:22 2022] DELETE /identity/v3/projects/b9d3b47785a5476ba1befe718e4f7e39 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:23.060862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.061341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.061452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.070818 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:23.100011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:23.102080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:23.264739 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2955/5959] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:23.274399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.274637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.275041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.328453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:23.337522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:23.366612 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3005/5960] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:23.379171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.398919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3806a2e-486b-44ac-92e8-e3041c73b0cb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.419887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.421259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.421559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.421959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.422731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:23.423041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.427718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.462227 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2956/5961] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:23.463763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.476171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d6e06-bd0e-4663-a9fc-7d17dbaa3f6d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.485081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.485890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.486162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.486484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.487230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.490255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.529397 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3006/5962] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:23 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:23.530941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.543910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2970-28ba-4067-ab6c-3008702081e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.628176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.630068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.630764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.631305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.632222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.634424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.659699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2957/5963] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:23 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:23.663903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.678444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29aca2-0417-45fb-96b1-8db10959898c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.683060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.683748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.684022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.684301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.685046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.686840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.700147 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3007/5964] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:23.703817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.716870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5157d04-1bbc-4d2b-92b1-4f3fc1b472a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.722481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.724293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.724741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.725127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.726257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.727963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738965fb-7817-4d75-a13a-ca37f079d24a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.741505 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2958/5965] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:23.746081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:23.760216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012abd1-854f-412b-bc31-ce8256e41f61 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:23.767383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:23.768515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.768870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.769238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] PATH_INFO: `/v3/projects/5fb9b1e992144abaa71119f62af8cb11/users/9b5205ca060b43798451eb30dabba224/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.789182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb9b1e992144abaa71119f62af8cb11, user_id=9b5205ca060b43798451eb30dabba224, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:23.792054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:23.813223 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3008/5966] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:23 2022] PUT /identity/v3/projects/5fb9b1e992144abaa71119f62af8cb11/users/9b5205ca060b43798451eb30dabba224/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:23.825717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:23.826047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:23.826260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:23.878787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] MFA Rules not processed for user `9b5205ca060b43798451eb30dabba224`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:23.882863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:24.005829 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:24.023827 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2959/5967] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:24.056499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:24.059562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:24.230042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cfa6-6ddc-43c0-8cbb-23ff3252d9a1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:24.234834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:24.235979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:24.236457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:24.237909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:24.249515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:24.252241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:24.272514 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3009/5968] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:24.516402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:24.519529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:24.659333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e6b1-df4a-4d29-a07d-b25fac2f7a1c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:24.688686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:24.690020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:24.692639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:24.694558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:24.699633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:24.747871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:24.749919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd15b7-9977-4778-ab1f-0beef9285d5d service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:24.818912 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2960/5969] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:25.799305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:25.802040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:25.962866 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:26.000510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b85a-17de-4846-b132-9099dc907cd9 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:26.012167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:26.013064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:26.013902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:26.014188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] PATH_INFO: `/v3/users/261fe700479d4c149b21d7d95c51e7f3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:26.018080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261fe700479d4c149b21d7d95c51e7f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:26.020924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:26.180503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261fe700479d4c149b21d7d95c51e7f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:26.181258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261fe700479d4c149b21d7d95c51e7f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:26.205800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261fe700479d4c149b21d7d95c51e7f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:26.216128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261fe700479d4c149b21d7d95c51e7f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:26.260846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261fe700479d4c149b21d7d95c51e7f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:26.276126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3010/5970] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:25 2022] DELETE /identity/v3/users/261fe700479d4c149b21d7d95c51e7f3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:26.277519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:26.278101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:26.278316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:26.329928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:26.329928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:26.551952 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2961/5971] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:26.648226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:26.652029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:26.822966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1b21-7dcb-41f5-aeda-8fbeeff8ebc7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:26.848952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:26.850338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:26.850624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:26.850909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:26.873143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:26.877610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:26.909509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3011/5972] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:28.396236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:28.398671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:28.415802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e7491-99d9-47a8-8de6-b6b9513b8263 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:28.420805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:28.422272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:28.422604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:28.422883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] PATH_INFO: `/v3/projects/abbf0f596b7244e7be44677c6dbd03f1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:28.424145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbf0f596b7244e7be44677c6dbd03f1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:28.435597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:28.542069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbf0f596b7244e7be44677c6dbd03f1', 'request_id': 'req-cf07b22a-4342-4800-aecc-14b0af1b39c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.555527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbf0f596b7244e7be44677c6dbd03f1', 'request_id': 'req-cf07b22a-4342-4800-aecc-14b0af1b39c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.570579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbf0f596b7244e7be44677c6dbd03f1', 'request_id': 'req-cf07b22a-4342-4800-aecc-14b0af1b39c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.596606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] The token cache is being invalidate because project abbf0f596b7244e7be44677c6dbd03f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:28.596980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.598054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.601209 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2962/5973] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:28 2022] DELETE /identity/v3/projects/abbf0f596b7244e7be44677c6dbd03f1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:28.605033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:28.618718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44f9d-f287-419b-85e4-f8090b14c732 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:28.737298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:28.739088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:28.739630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:28.740186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] PATH_INFO: `/v3/users/b2e593c3045b438385a299b36a3d6f3b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:28.741949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e593c3045b438385a299b36a3d6f3b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:28.744158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:28.762836 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:28.841599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e593c3045b438385a299b36a3d6f3b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.851296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e593c3045b438385a299b36a3d6f3b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.865784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e593c3045b438385a299b36a3d6f3b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.885064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e593c3045b438385a299b36a3d6f3b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.913927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-021657ca-6d6f-434f-a0bc-d760fcb62225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e593c3045b438385a299b36a3d6f3b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:28.924772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3012/5974] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:28 2022] DELETE /identity/v3/users/b2e593c3045b438385a299b36a3d6f3b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:29.866253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:29.868289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:29.903721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07b22a-4342-4800-aecc-14b0af1b39c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:29.919899 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:30.042046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.044151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.045858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.046337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] PATH_INFO: `/v3/projects/c7e547cd026740e08cac822ac2f6d35c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.053927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e547cd026740e08cac822ac2f6d35c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.056274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.181321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e547cd026740e08cac822ac2f6d35c', 'request_id': 'req-18c10451-f635-48a3-933f-128e649ed303'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:30.201387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e547cd026740e08cac822ac2f6d35c', 'request_id': 'req-18c10451-f635-48a3-933f-128e649ed303'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:30.216690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e547cd026740e08cac822ac2f6d35c', 'request_id': 'req-18c10451-f635-48a3-933f-128e649ed303'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:30.245340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] The token cache is being invalidate because project c7e547cd026740e08cac822ac2f6d35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:30.245616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:30.248316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18c10451-f635-48a3-933f-128e649ed303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:30.254732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2963/5975] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:29 2022] DELETE /identity/v3/projects/c7e547cd026740e08cac822ac2f6d35c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:30.260452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.261000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.261000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.288470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:30.290099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:30.439063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3013/5976] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:30.447297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.447514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.447785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.492947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:30.494226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:30.509520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2964/5977] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:30.513573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.530868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46376-de2e-4f62-9bec-1e9adbdc0d86 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:30.537922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.538887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.539494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.540072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.541009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:30.541607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.551896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.570676 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3014/5978] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:30.574348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.588147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c849-ae0a-4033-a0aa-f11358cd8583 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:30.594490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.595972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.596476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.596941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.598935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.601578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.657381 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2965/5979] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:30 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:35:30.663980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.681523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d5f5-2387-4455-9033-7c8dacddfe50 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:30.820061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.826278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.826918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.827390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.829419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.838881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.876480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3015/5980] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:30 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:30.878643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.892472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc4346-f1ee-46fe-b4ab-2196a7a48209 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:30.900436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.901346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.901727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.902492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.903251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.905630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.924454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2966/5981] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:30.930608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.945054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48e5e4-93d1-4bad-aeb8-e88164664722 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:30.952008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:30.952958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:30.953444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:30.953959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:30.955181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:30.957506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be3199-9e13-4888-b8a7-431943d01a65 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:30.959437 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:30.974409 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3016/5982] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:30.978270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:30.994608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271316-7db0-423b-8fa5-29fa610b2c50 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:31.017338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:31.019675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.020011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.022321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] PATH_INFO: `/v3/projects/dbda11c04de54abaa05af76e40580f84/users/113d51b9843b4f3090413f07d60fad3c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.073749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbda11c04de54abaa05af76e40580f84, user_id=113d51b9843b4f3090413f07d60fad3c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:31.076768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:31.116422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2967/5983] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:30 2022] PUT /identity/v3/projects/dbda11c04de54abaa05af76e40580f84/users/113d51b9843b4f3090413f07d60fad3c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:31.118421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.118717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.118999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.196676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] MFA Rules not processed for user `113d51b9843b4f3090413f07d60fad3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:31.198226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:31.329615 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3017/5984] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:31.335400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:31.382777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:31.423218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696c4e4-c09b-4c46-9015-70fb7c58a8a9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:31.431374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:31.432330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.434620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.435128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.436034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:31.438833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:31.519327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2968/5985] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:31 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:31.522986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:31.541911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669ee65-d5b3-4c13-ba53-754f6404123f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:31.675549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:31.676980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.677271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.677550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.678299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:31.683509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:31.726181 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3018/5986] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:31 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:31.731427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:31.751071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0a7d-ae34-4bcd-af61-b93d36fd3c60 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:31.766349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:31.767085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.767371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.767651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.768404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:31.770137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:31.799582 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2969/5987] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:31.803284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:31.820091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6765b-dc98-4b25-986e-df71335c03c1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:31.831675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def92444-3334-426f-931d-928af59f110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:31.834577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92444-3334-426f-931d-928af59f110b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:31.836290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92444-3334-426f-931d-928af59f110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:31.836594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92444-3334-426f-931d-928af59f110b admin admin] PATH_INFO: `/v3/projects/4b90939a361f465a80c1b2a50b95c533/users/5be1b5f4b5614888a4e9200b7b6bda91/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:31.877146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def92444-3334-426f-931d-928af59f110b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b90939a361f465a80c1b2a50b95c533, user_id=5be1b5f4b5614888a4e9200b7b6bda91, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:31.885426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def92444-3334-426f-931d-928af59f110b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:31.913464 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3019/5988] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:31 2022] PUT /identity/v3/projects/4b90939a361f465a80c1b2a50b95c533/users/5be1b5f4b5614888a4e9200b7b6bda91/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:31.917499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:31.934227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f68a-2c7d-4294-a307-0cf6de5d93eb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:32.085275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:32.086030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:32.086318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:32.086600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:32.087635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:32.089783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff5145-7b48-4c59-b910-230ed4af5fc9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:32.111416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def92444-3334-426f-931d-928af59f110b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:32.143903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2970/5989] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:32.146934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def92444-3334-426f-931d-928af59f110b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:32.164771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:32.166198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:32.166670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:32.167143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] PATH_INFO: `/v3/projects/4b90939a361f465a80c1b2a50b95c533/users/5be1b5f4b5614888a4e9200b7b6bda91/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:32.169455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b90939a361f465a80c1b2a50b95c533, user_id=5be1b5f4b5614888a4e9200b7b6bda91, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:32.173817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:32.188914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3020/5990] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:32 2022] PUT /identity/v3/projects/4b90939a361f465a80c1b2a50b95c533/users/5be1b5f4b5614888a4e9200b7b6bda91/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:32.201783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:32.202716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:32.203291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:32.258851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] MFA Rules not processed for user `5be1b5f4b5614888a4e9200b7b6bda91`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:32.262367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:32.394395 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2971/5991] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:32.406560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:32.409261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:32.483527 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:32.507370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c666-e824-48c3-a051-18afff307a05 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:32.512933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:32.513870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:32.514338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:32.514806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:32.546857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:32.560174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441613c2-44e2-4d5c-bf0a-9fbddee55086 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:32.591041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3021/5992] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:33.564588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:33.604768 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:33.644230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe664b0-8624-4eaa-9814-d9f4fb3eee51 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:33.649293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:33.650242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:33.650544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:33.650820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] PATH_INFO: `/v3/users/113d51b9843b4f3090413f07d60fad3c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:33.652022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113d51b9843b4f3090413f07d60fad3c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:33.654456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:33.713291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113d51b9843b4f3090413f07d60fad3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:33.723219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113d51b9843b4f3090413f07d60fad3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:33.732969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113d51b9843b4f3090413f07d60fad3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:33.759906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113d51b9843b4f3090413f07d60fad3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:33.760935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113d51b9843b4f3090413f07d60fad3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:33.769068 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2972/5993] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:33 2022] DELETE /identity/v3/users/113d51b9843b4f3090413f07d60fad3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:33.773615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:33.774148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:33.774244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:33.805719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:33.807317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:33.896581 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3022/5994] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:33.906952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:33.908571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:33.984856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1bedb-5c5c-4729-acdc-a2ef5a36af23 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:33.989846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:33.990815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:33.991395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:33.991789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:34.002712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:34.004625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:34.017012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2973/5995] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:34.983908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:34.985626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:35.018231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed430022-94ef-4952-9662-39a114b9b7be None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:35.024891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:35.026658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:35.027173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:35.027748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] PATH_INFO: `/v3/projects/dbda11c04de54abaa05af76e40580f84` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:35.029089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbda11c04de54abaa05af76e40580f84)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:35.032356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:35.096303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbda11c04de54abaa05af76e40580f84', 'request_id': 'req-ef3b5370-edb6-44d3-a9f4-0e117feddf71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.112486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbda11c04de54abaa05af76e40580f84', 'request_id': 'req-ef3b5370-edb6-44d3-a9f4-0e117feddf71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.126050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbda11c04de54abaa05af76e40580f84', 'request_id': 'req-ef3b5370-edb6-44d3-a9f4-0e117feddf71'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.145572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] The token cache is being invalidate because project dbda11c04de54abaa05af76e40580f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:35.145956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.146635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.149209 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3023/5996] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:34 2022] DELETE /identity/v3/projects/dbda11c04de54abaa05af76e40580f84 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:35.152964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:35.165134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeaab1-2fb3-4300-aac3-b54a31cc28a0 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:35.240099 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:35.254255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:35.255188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:35.255661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:35.256127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] PATH_INFO: `/v3/users/5be1b5f4b5614888a4e9200b7b6bda91` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:35.257791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be1b5f4b5614888a4e9200b7b6bda91)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:35.259722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:35.324133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be1b5f4b5614888a4e9200b7b6bda91'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.335681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be1b5f4b5614888a4e9200b7b6bda91'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.345939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be1b5f4b5614888a4e9200b7b6bda91'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.366848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be1b5f4b5614888a4e9200b7b6bda91'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.368104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cdc7f3e-d374-4518-bda6-576078e3471f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be1b5f4b5614888a4e9200b7b6bda91'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:35.383621 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2974/5997] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:35 2022] DELETE /identity/v3/users/5be1b5f4b5614888a4e9200b7b6bda91 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:35.974972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:35.977169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:35.994132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5370-edb6-44d3-a9f4-0e117feddf71 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.082885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.084567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.084982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.085326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] PATH_INFO: `/v3/projects/4b90939a361f465a80c1b2a50b95c533` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.087229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b90939a361f465a80c1b2a50b95c533)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.090823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.098875 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:36.156082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b90939a361f465a80c1b2a50b95c533', 'request_id': 'req-d7cd685f-114c-4f83-b059-94b11eca9a61'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:36.162658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b90939a361f465a80c1b2a50b95c533', 'request_id': 'req-d7cd685f-114c-4f83-b059-94b11eca9a61'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:36.173943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b90939a361f465a80c1b2a50b95c533', 'request_id': 'req-d7cd685f-114c-4f83-b059-94b11eca9a61'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:36.188400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] The token cache is being invalidate because project 4b90939a361f465a80c1b2a50b95c533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:36.189117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:36.189949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7cd685f-114c-4f83-b059-94b11eca9a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:36.192137 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3024/5998] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:35 2022] DELETE /identity/v3/projects/4b90939a361f465a80c1b2a50b95c533 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:36.198410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.199044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.199661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.237237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:36.239367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:36.335672 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2975/5999] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:36.342834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.343499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.344071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.381545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:36.382911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:36.395482 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3025/6000] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:36.399566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.411586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44effc34-7d06-4aca-bb7c-9360dd5fdc9e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.416368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.416988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.417267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.417539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.418322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:36.418627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.420229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.433238 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2976/6001] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:36.437623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.447524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ff7a3-450f-4ff0-81b6-8f3f48b0b7f4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.452092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.452747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.453026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.453301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.454024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.456036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.488668 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3026/6002] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:36 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:36.489913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.500184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1f6e-aeed-42d5-a769-f877a60f5728 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.555039 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:36.562283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.563979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.564563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.565012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.565934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.568761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.592537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2977/6003] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:36 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:36.596383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.610119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438a0a8-d4ea-49b4-a206-0718d9b35b37 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.616336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.617097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.617397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.617716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.618615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.620259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.631362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3027/6004] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:36.636068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.647788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c390315-35ef-4b09-80a4-087be98e9bac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.657231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.658351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.658802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.659434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.661553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.664035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5d2b0-8bec-42d2-83f6-984690572142 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.679386 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2978/6005] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:36.683059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.696858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb229dd-f523-4c41-b43e-83b33169e99b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:36.703781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:36.705157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.705619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.706006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] PATH_INFO: `/v3/projects/0839ccf09534460f927a04a9bbb60800/users/7ad2e92264e14d32a4fd22f8a4b46c4e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.736886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0839ccf09534460f927a04a9bbb60800, user_id=7ad2e92264e14d32a4fd22f8a4b46c4e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:36.742450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:36.761595 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3028/6006] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:36 2022] PUT /identity/v3/projects/0839ccf09534460f927a04a9bbb60800/users/7ad2e92264e14d32a4fd22f8a4b46c4e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:36.772298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ee82-48a2-404c-b25a-b86bdc215cf9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:36.772612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ee82-48a2-404c-b25a-b86bdc215cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:36.772873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ee82-48a2-404c-b25a-b86bdc215cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:36.807119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7e99ee82-48a2-404c-b25a-b86bdc215cf9 None None] MFA Rules not processed for user `7ad2e92264e14d32a4fd22f8a4b46c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:36.808345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e99ee82-48a2-404c-b25a-b86bdc215cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:36.895598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2979/6007] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:36.905599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:36.907434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:37.032213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebce1-94ea-45cf-a305-f53365b7410f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:37.038989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:37.039800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:37.040179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:37.040724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:37.055332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:37.059108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:37.088883 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3029/6008] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:39.421939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:39.422449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:39.422671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:39.446209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] MFA Rules not processed for user `280d6677ca794b7eab9fb6f4214f572e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:39.447722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:39.517748 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2980/6009] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:39.521007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:39.523077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:39.562218 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:39.617402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672953df-323c-4d1c-8c02-158760ac823f service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:39.627075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:39.628252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:39.628505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:39.628931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:39.631358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:39.750747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:39.752421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362e4c5-4c39-4fdc-b410-f6f01fdf28f4 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:39.767705 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3030/6010] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:35:41.479635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:41.483977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:41.595459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b814a4-11e3-4979-8bd7-5fb83ee66125 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:41.602211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:41.603475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:41.604005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:41.605095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] PATH_INFO: `/v3/users/9b5205ca060b43798451eb30dabba224` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:41.607152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5205ca060b43798451eb30dabba224)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:41.609476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:41.629885 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:41.687198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5205ca060b43798451eb30dabba224'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:41.698239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5205ca060b43798451eb30dabba224'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:41.708026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5205ca060b43798451eb30dabba224'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:41.723601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5205ca060b43798451eb30dabba224'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:41.724332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5205ca060b43798451eb30dabba224'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:41.734613 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2981/6011] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:35:41 2022] DELETE /identity/v3/users/9b5205ca060b43798451eb30dabba224 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:41.736640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:41.737123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:41.737437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:41.762648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:41.763982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:41.843573 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3031/6012] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:41.857567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:41.860302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:41.965613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420f63-1f17-4b25-b986-ca173b640843 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:41.970464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:41.971724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:41.972297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:41.972696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:41.986641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:41.986641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b030377-8a64-4525-8538-5077f607f91f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:42.038451 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2982/6013] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:42.508848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:42.510603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:42.515720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c482-1278-4fcb-8ddf-a2d224a0f077 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.516238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c482-1278-4fcb-8ddf-a2d224a0f077 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.516407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c482-1278-4fcb-8ddf-a2d224a0f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.527644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f7b0a-a01d-442b-b817-c0f7addfc25e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:42.534074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:42.535638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.535953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.536178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] PATH_INFO: `/v3/projects/5fb9b1e992144abaa71119f62af8cb11` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.537811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb9b1e992144abaa71119f62af8cb11)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:42.540689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:42.546876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cf55c482-1278-4fcb-8ddf-a2d224a0f077 None None] MFA Rules not processed for user `4611d01617d645579ae3529c8f8f9de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:42.548108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf55c482-1278-4fcb-8ddf-a2d224a0f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:42.611084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb9b1e992144abaa71119f62af8cb11', 'request_id': 'req-c993cc90-711f-4465-a014-5a03e5fc0785'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:42.619172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb9b1e992144abaa71119f62af8cb11', 'request_id': 'req-c993cc90-711f-4465-a014-5a03e5fc0785'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:42.636806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb9b1e992144abaa71119f62af8cb11', 'request_id': 'req-c993cc90-711f-4465-a014-5a03e5fc0785'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:42.649790 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:42.656484 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2983/6014] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:42.664451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] The token cache is being invalidate because project 5fb9b1e992144abaa71119f62af8cb11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:35:42.665247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:42.666973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c993cc90-711f-4465-a014-5a03e5fc0785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:35:42.676841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.677248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.677533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.678010 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3032/6015] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:35:42 2022] DELETE /identity/v3/projects/5fb9b1e992144abaa71119f62af8cb11 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:35:42.716694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:42.717956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:42.761486 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:42.799548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2984/6016] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:35:42.808042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.808940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.809834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.833845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:42.835676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:42.846689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3033/6017] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:42.850859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:42.871089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce825f-d990-43f4-89a2-ffc2d684b2f8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:42.876305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:42.877061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.877434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.877816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.880077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:35:42.880397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:42.883070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:42.908106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2985/6018] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:35:42.912327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:42.923162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d91ccf-6a48-4efd-a330-ea4901ca03dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:42.929550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:42.930450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:42.931064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:42.931527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:42.932686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:42.934872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:42.981525 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3034/6019] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:35:42 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:35:42.989200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:43.002065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257117b1-665a-4b86-b2da-7a9804a22e4c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:43.101215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:43.101960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.102251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.102732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.103431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:43.105375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:43.139207 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2986/6020] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:35:42 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:35:43.141706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:43.154402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c221c-f0d9-4b7f-8d86-01bad2607981 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:43.162835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:43.163740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.164194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.164650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.166218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:43.168129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:43.194853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3035/6021] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:43.198646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:43.217909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb67926-8345-4d87-b343-cc60cb65fb34 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:43.228494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:43.229472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.229794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.230075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.230819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:43.232825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2164eb2-0016-4bc7-8e91-24b052324494 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:43.245280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2987/6022] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:35:43.249069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:43.262423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2c22-b4ca-4fe3-b4dc-2bb053479ac7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:43.270176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:43.272448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.273120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.273833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] PATH_INFO: `/v3/projects/a1d25336d7fc4e6daf63a7c1aee9c2fe/users/c66306c0e2fe4f4a9946461572b4aa60/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.305490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d25336d7fc4e6daf63a7c1aee9c2fe, user_id=c66306c0e2fe4f4a9946461572b4aa60, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:43.309203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:43.329109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3036/6023] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:35:43 2022] PUT /identity/v3/projects/a1d25336d7fc4e6daf63a7c1aee9c2fe/users/c66306c0e2fe4f4a9946461572b4aa60/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:35:43.342182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a0c2-8e4d-445f-ab9f-1bdf466ed4fa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.342459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a0c2-8e4d-445f-ab9f-1bdf466ed4fa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.342755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2a0c2-8e4d-445f-ab9f-1bdf466ed4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.398949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-75d2a0c2-8e4d-445f-ab9f-1bdf466ed4fa None None] MFA Rules not processed for user `c66306c0e2fe4f4a9946461572b4aa60`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:35:43.400150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-75d2a0c2-8e4d-445f-ab9f-1bdf466ed4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:43.543589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2988/6024] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:35:43.562961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:35:43.564778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:35:43.694241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49943d-277c-497d-84e3-2e999fe82ed8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:35:43.704719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:35:43.705471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:35:43.705874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:35:43.706529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:35:43.734628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:35:43.739665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:35:43.797696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3037/6025] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:35:53.538640 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:35:53.768420 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:02.307789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ffe6-0884-47d6-8192-09ec58e18117 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:02.308236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ffe6-0884-47d6-8192-09ec58e18117 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:02.308355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6ffe6-0884-47d6-8192-09ec58e18117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:02.364356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-87b6ffe6-0884-47d6-8192-09ec58e18117 None None] MFA Rules not processed for user `81dad264129d487c88fb39d9356550b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:02.367771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-87b6ffe6-0884-47d6-8192-09ec58e18117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:02.574340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2989/6026] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:03.627233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:03.938480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7e105-e2be-4a83-9a5b-34ba5913e151 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:03.958062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:03.960315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:03.965799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:03.966250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] PATH_INFO: `/v3/users/c66306c0e2fe4f4a9946461572b4aa60` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:03.969852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66306c0e2fe4f4a9946461572b4aa60)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:03.975528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:04.131799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66306c0e2fe4f4a9946461572b4aa60'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:04.132729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66306c0e2fe4f4a9946461572b4aa60'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:04.149206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66306c0e2fe4f4a9946461572b4aa60'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:04.165908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66306c0e2fe4f4a9946461572b4aa60'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:04.193549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66306c0e2fe4f4a9946461572b4aa60'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:04.203601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3038/6027] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:03 2022] DELETE /identity/v3/users/c66306c0e2fe4f4a9946461572b4aa60 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:04.208499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973e3c-4f96-466d-a87e-2bb7bd422190 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:04.208923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973e3c-4f96-466d-a87e-2bb7bd422190 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:04.209030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973e3c-4f96-466d-a87e-2bb7bd422190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:04.271340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-97973e3c-4f96-466d-a87e-2bb7bd422190 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:04.274919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-97973e3c-4f96-466d-a87e-2bb7bd422190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:04.416732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2990/6028] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:04.427044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:04.428889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:04.572665 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:04.637713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72be2da-bcfc-4578-8991-1b7c226d7199 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:04.654319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:04.655791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:04.656134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:04.656366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:04.687773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:04.694826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:04.695271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:04.695568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:04.696101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:04.740144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3039/6029] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:36:04.818141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:04.819365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:05.030043 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:05.085406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2991/6030] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:36:05.142859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:05.145042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:05.365275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0bc5-89f8-4458-8476-f790b1b3af12 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:05.384029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:05.385257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:05.385549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:05.385872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:05.416125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:05.423856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe99e6-e0d7-4be8-9292-bf8158426b0f service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:05.458566 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3040/6031] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:36:05.884472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:05.886416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:05.929743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0893ff-b0a9-484d-9f98-3f2b6cdfb7df None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:05.947989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:05.948901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:05.949328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:05.949613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] PATH_INFO: `/v3/projects/a1d25336d7fc4e6daf63a7c1aee9c2fe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:05.952428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d25336d7fc4e6daf63a7c1aee9c2fe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:05.955214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:06.158679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d25336d7fc4e6daf63a7c1aee9c2fe', 'request_id': 'req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:06.190185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d25336d7fc4e6daf63a7c1aee9c2fe', 'request_id': 'req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:06.235638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d25336d7fc4e6daf63a7c1aee9c2fe', 'request_id': 'req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:06.297971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] The token cache is being invalidate because project a1d25336d7fc4e6daf63a7c1aee9c2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:06.305840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:06.308002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20d2e0a7-63f6-4a9e-b272-b0fd43bef352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:06.312985 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2992/6032] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:05 2022] DELETE /identity/v3/projects/a1d25336d7fc4e6daf63a7c1aee9c2fe => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:06.325189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:06.325773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:06.325863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:06.481552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:06.483529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:06.786278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:06.786692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:06.786979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:06.794868 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3041/6033] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:06.818952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:06.820220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:06.834339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:06.834984 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2993/6034] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:06.847079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea9054-b0e9-4ab2-8490-b013a62c9fee None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:06.860979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:06.861695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:06.862035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:06.862327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:06.864743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:36:06.865056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:06.868988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:06.919903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:06.930781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251d75-5c36-479f-a7e1-533d10dfce3e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:06.951786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3042/6035] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:36:06.974463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:06.975297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:06.975587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:06.975894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:06.976596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:06.984486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:07.069692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:07.079044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2994/6036] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:06 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:07.089778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc653b-2222-485b-8fd9-fc3ae2c2177b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:07.194023 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:07.245629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:07.246302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:07.246719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:07.247003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:07.247713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:07.254448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:07.305384 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3043/6037] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:07 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:07.317147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:07.347202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7880143-b892-4f3d-9cab-5ca5d99bd39e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:07.362327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:07.363450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:07.363801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:07.364082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:07.364876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:07.366942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:07.399205 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2995/6038] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:07.400845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:07.412287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177d7d1-8be2-48fa-8bce-39f8e107cc30 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:07.433714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:07.434406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:07.438960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:07.439279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:07.450781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:07.453791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af827c-3b3f-41f4-a143-0703b7bf9f0d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:07.493644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:07.499681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3044/6039] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:07.516134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34990d6-6393-4bd0-abbb-dab19e78912a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:07.546206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:07.547140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:07.547417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:07.547742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] PATH_INFO: `/v3/projects/392eaf37c53942d4adc5467680b1301a/users/5c7a944332ae4f55a3f43679b916ec0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:07.607753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] RBAC: Authorizing `identity:create_grant(project_id=392eaf37c53942d4adc5467680b1301a, user_id=5c7a944332ae4f55a3f43679b916ec0e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:07.619396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:07.655770 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2996/6040] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:07 2022] PUT /identity/v3/projects/392eaf37c53942d4adc5467680b1301a/users/5c7a944332ae4f55a3f43679b916ec0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:07.667183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:07.667479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:07.667768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:07.790663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] MFA Rules not processed for user `5c7a944332ae4f55a3f43679b916ec0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:07.798932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:08.017368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3045/6041] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:08.028394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:08.030207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:08.224243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e71a3-cc15-4c37-8eae-6312f95d797d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:08.232241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:08.233332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:08.233926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:08.234517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:08.250018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:08.251598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613513-7017-44f3-b5ce-9964efed47e8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:08.262610 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2997/6042] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:14.331944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:14.334204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:14.529937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561ed37-0f09-46c5-9e31-66b309c20f90 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:14.539111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:14.540305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:14.540592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:14.540869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] PATH_INFO: `/v3/users/7ad2e92264e14d32a4fd22f8a4b46c4e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:14.542163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad2e92264e14d32a4fd22f8a4b46c4e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:14.544114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:14.642312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad2e92264e14d32a4fd22f8a4b46c4e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:14.645020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad2e92264e14d32a4fd22f8a4b46c4e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:14.648180 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:14.664200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad2e92264e14d32a4fd22f8a4b46c4e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:14.682407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad2e92264e14d32a4fd22f8a4b46c4e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:14.704604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad2e92264e14d32a4fd22f8a4b46c4e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:14.720270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3046/6043] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:14 2022] DELETE /identity/v3/users/7ad2e92264e14d32a4fd22f8a4b46c4e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:14.722927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:14.723484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:14.723484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:14.742958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:14.744478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:14.754312 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:14.880509 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2998/6044] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:14.891800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:14.893329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:15.038873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12213-d50a-4daf-8032-693b29303bba admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:15.046750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:15.051545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:15.052166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:15.052677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:15.089617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:15.093514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b18ca3-9738-403f-818d-7ee9d57ecde1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:15.133449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3047/6045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:16.095011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:16.097125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:16.117977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7be56-0986-4ab3-9c48-b706b8ee0f76 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:16.123010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:16.124004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:16.124279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:16.124757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] PATH_INFO: `/v3/projects/0839ccf09534460f927a04a9bbb60800` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:16.126051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0839ccf09534460f927a04a9bbb60800)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:16.128968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:16.261485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0839ccf09534460f927a04a9bbb60800', 'request_id': 'req-a022c97f-7297-4555-95f0-4f060fabc982'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:16.286877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0839ccf09534460f927a04a9bbb60800', 'request_id': 'req-a022c97f-7297-4555-95f0-4f060fabc982'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:16.293958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0839ccf09534460f927a04a9bbb60800', 'request_id': 'req-a022c97f-7297-4555-95f0-4f060fabc982'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:16.331635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] The token cache is being invalidate because project 0839ccf09534460f927a04a9bbb60800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:16.332090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:16.333136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a022c97f-7297-4555-95f0-4f060fabc982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:16.335674 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 2999/6046] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:16 2022] DELETE /identity/v3/projects/0839ccf09534460f927a04a9bbb60800 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:16.340461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:16.340988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:16.341070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:16.379423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:16.380692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:16.528096 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3048/6047] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:16.536276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:16.536984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:16.537402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:16.587666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:16.591380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:16.618967 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3000/6048] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:16.620504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:16.637515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c033d3-e3d6-4f93-9ce9-2b96c5c1769e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:16.653045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:16.653765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:16.654055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:16.654343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:16.655412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:36:16.656215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:16.657663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:16.688320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3049/6049] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:36:16.693997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:16.716345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921c4fd-7485-4e71-91a5-94506fc74b64 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:16.735095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:16.736046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:16.737015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:16.737714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:16.738854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:16.742001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:16.811585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3001/6050] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:16 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:16.815988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:16.842840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce911f4-b269-4dfa-848a-64226e1a6865 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:17.056822 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:17.086749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:17.092571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.093845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.094243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.095569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:17.099286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:17.175554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:17.176067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3050/6051] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:16 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:17.196964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289410d8-a17a-4418-af7f-904cd4775385 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:17.218224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:17.219711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.220947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.222238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.224663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:17.228620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:17.263548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3002/6052] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:17.267742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:17.287917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336e0c3-767d-4708-877f-a645d18cc49e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:17.309021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:17.309635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.309963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.310235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.310982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:17.312617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec8cb1-9766-4483-9dcc-90d91ce32c08 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:17.351974 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3051/6053] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:36:17.352996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:17.374256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afcac9-94c7-4f1e-8da3-ee1a58efa4a4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:17.402449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:17.403599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.404079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.404356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] PATH_INFO: `/v3/projects/ee72f224c7bb489897c82000728f0e66/users/d24a24aab51e4ff69fbdb856d2b9d45b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.445732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee72f224c7bb489897c82000728f0e66, user_id=d24a24aab51e4ff69fbdb856d2b9d45b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:17.455473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:17.496879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3003/6054] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:17 2022] PUT /identity/v3/projects/ee72f224c7bb489897c82000728f0e66/users/d24a24aab51e4ff69fbdb856d2b9d45b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:17.509206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.509494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.509799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.597341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] MFA Rules not processed for user `d24a24aab51e4ff69fbdb856d2b9d45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:17.598484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:17.727555 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3052/6055] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:17.732632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:17.819078 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:17.896064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f920-93b1-406c-a515-239791c8dc4d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:17.906730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:17.909587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:17.912417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:17.913409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:17.915566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:17.918656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:17.967476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3004/6056] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:17 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:17.971854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:17.990714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0eb8-0d25-47cc-b55d-e24bd2b2066b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:18.149332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:18.150319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.150608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.150892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.152167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:18.155135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:18.191872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3053/6057] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:17 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:18.194840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:18.210376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e7c-8bf4-471e-bab7-a0fbd33457a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:18.228527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:18.229972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.230269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.230555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.231764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:18.235443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:18.274526 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3005/6058] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:18.275736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:18.290591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81eff-1dfc-480a-88bc-7aa8ca0d736c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:18.312810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:18.314030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.314318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.314689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] PATH_INFO: `/v3/projects/fda80e146afa42eab4f81a47c6b39346/users/660ac208dc654dccbe78d419b429dd09/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.386090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda80e146afa42eab4f81a47c6b39346, user_id=660ac208dc654dccbe78d419b429dd09, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:18.401421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:18.457508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3054/6059] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:18 2022] PUT /identity/v3/projects/fda80e146afa42eab4f81a47c6b39346/users/660ac208dc654dccbe78d419b429dd09/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:18.461234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:18.474289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef644c3-3f91-4029-8c34-48d496735629 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:18.576694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:18.578670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.578984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.579248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.582725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:18.588133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f979d-9a03-42e6-8c15-a66ed5ff3e1a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:18.635255 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3006/6060] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:18.637574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:18.667264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31366fee-5887-4a35-bc06-63d2ddf06166 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:18.703611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:18.704614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.704909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.706566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] PATH_INFO: `/v3/projects/fda80e146afa42eab4f81a47c6b39346/users/660ac208dc654dccbe78d419b429dd09/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.710848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda80e146afa42eab4f81a47c6b39346, user_id=660ac208dc654dccbe78d419b429dd09, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:18.718231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:18.748979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3055/6061] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:18 2022] PUT /identity/v3/projects/fda80e146afa42eab4f81a47c6b39346/users/660ac208dc654dccbe78d419b429dd09/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:18.763908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:18.764333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:18.764715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:18.823011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] MFA Rules not processed for user `660ac208dc654dccbe78d419b429dd09`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:18.824575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:18.970825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3007/6062] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:18.979175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:18.981052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:19.027302 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:19.136350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7904-7226-4161-a6fb-6ab4287c9521 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:19.140179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:19.140936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:19.141297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:19.142113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:19.274573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:19.276731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:19.291201 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3056/6063] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:20.697473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:20.701361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:20.775542 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:20.904045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d713-26cc-479e-8adc-b81a263e1c45 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:21.030485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:21.034210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:21.034210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:21.034553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:21.041534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:21.094192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:21.096692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455c5d0-95c7-454b-9d5d-a88623f738e7 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:21.132448 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3008/6064] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:27.067711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:27.198898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f56-645f-4c94-b486-6a119f65b348 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:27.205753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:27.206801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:27.207183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:27.207552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] PATH_INFO: `/v3/users/d24a24aab51e4ff69fbdb856d2b9d45b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:27.208901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24a24aab51e4ff69fbdb856d2b9d45b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:27.210985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:27.357624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24a24aab51e4ff69fbdb856d2b9d45b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:27.359192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24a24aab51e4ff69fbdb856d2b9d45b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:27.382504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24a24aab51e4ff69fbdb856d2b9d45b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:27.404670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24a24aab51e4ff69fbdb856d2b9d45b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:27.429767 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:27.449425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24a24aab51e4ff69fbdb856d2b9d45b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:27.473146 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3057/6065] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:27 2022] DELETE /identity/v3/users/d24a24aab51e4ff69fbdb856d2b9d45b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:27.478390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:27.478859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:27.479219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:27.513757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:27.516033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:27.672812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3009/6066] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:27.696087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:27.698299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:27.899057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726b1f-3ec7-4108-9d16-51144aad3249 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:27.913972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:27.917079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:27.917414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:27.917719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:27.947911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:27.954703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:28.006379 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3058/6067] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:29.212824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:29.214447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:29.250251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d86f5a-d011-45cc-bc21-7fc62e2e52cb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:29.265437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:29.266687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:29.266974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:29.268351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] PATH_INFO: `/v3/projects/ee72f224c7bb489897c82000728f0e66` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:29.272769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee72f224c7bb489897c82000728f0e66)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:29.277708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:29.408217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee72f224c7bb489897c82000728f0e66', 'request_id': 'req-b270280e-cbee-4ba2-bcdb-48c274ec8455'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.421194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee72f224c7bb489897c82000728f0e66', 'request_id': 'req-b270280e-cbee-4ba2-bcdb-48c274ec8455'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.445869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee72f224c7bb489897c82000728f0e66', 'request_id': 'req-b270280e-cbee-4ba2-bcdb-48c274ec8455'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.489508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] The token cache is being invalidate because project ee72f224c7bb489897c82000728f0e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:29.490179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.493431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.502169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3010/6068] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:29 2022] DELETE /identity/v3/projects/ee72f224c7bb489897c82000728f0e66 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:29.503099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:29.518421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5a23-3994-48b8-a1ec-1284714a1752 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:29.730442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:29.732455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:29.732818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:29.733308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] PATH_INFO: `/v3/users/660ac208dc654dccbe78d419b429dd09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:29.734832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=660ac208dc654dccbe78d419b429dd09)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:29.737633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:29.811949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660ac208dc654dccbe78d419b429dd09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.812832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660ac208dc654dccbe78d419b429dd09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.838762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660ac208dc654dccbe78d419b429dd09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.850662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:29.852417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:29.872681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660ac208dc654dccbe78d419b429dd09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.912842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660ac208dc654dccbe78d419b429dd09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:29.922342 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3059/6069] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:29 2022] DELETE /identity/v3/users/660ac208dc654dccbe78d419b429dd09 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:36:29.952776 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:30.077019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270280e-cbee-4ba2-bcdb-48c274ec8455 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:30.278981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:30.279707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:30.279948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:30.280246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:30.287241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:30.346935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:30.360266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7777b-ddc8-4baf-80ba-067605d6a078 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:30.393319 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3011/6070] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:31.001635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:31.003913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.032568 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:31.187484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff5a0-d0bb-44e1-a0a4-2ba715af61ff admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:31.194138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:31.195024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.195311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.195575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] PATH_INFO: `/v3/projects/fda80e146afa42eab4f81a47c6b39346` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.196819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda80e146afa42eab4f81a47c6b39346)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:31.198790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:31.308997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda80e146afa42eab4f81a47c6b39346', 'request_id': 'req-099d210c-c64a-4940-90d6-4bb0e314640c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.328212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda80e146afa42eab4f81a47c6b39346', 'request_id': 'req-099d210c-c64a-4940-90d6-4bb0e314640c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.353469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda80e146afa42eab4f81a47c6b39346', 'request_id': 'req-099d210c-c64a-4940-90d6-4bb0e314640c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.386297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] The token cache is being invalidate because project fda80e146afa42eab4f81a47c6b39346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:31.387877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.393423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.399218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3060/6071] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:31 2022] DELETE /identity/v3/projects/fda80e146afa42eab4f81a47c6b39346 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:31.405308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.405803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.405875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.459434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:31.460668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.532679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:31.534598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.683212 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3012/6072] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:31.684528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:31.693007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.719924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461bc30-6dfb-4c0f-98f4-5a4d4a814b59 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:31.731006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:31.732392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.732823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.733245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] PATH_INFO: `/v3/users/93af4655b28648d08cded0540173d2ac` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.734732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93af4655b28648d08cded0540173d2ac)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:31.739354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:31.756604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d210c-c64a-4940-90d6-4bb0e314640c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:31.765790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:31.766730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.767727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.768324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.774721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.799819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:31.801828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b407a-35e7-498c-965b-d09297aec3a3 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:31.833205 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3061/6073] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:36:31.845573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.847337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.847742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.859176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93af4655b28648d08cded0540173d2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.879630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93af4655b28648d08cded0540173d2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.890998 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:31.893335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:31.894705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:31.900839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93af4655b28648d08cded0540173d2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.912480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3062/6074] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:31.916782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:31.933279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93af4655b28648d08cded0540173d2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.935678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb729-02f8-4970-b4bc-b888d8f66b9e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:31.937326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93af4655b28648d08cded0540173d2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:31.951240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:31.954246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:31.955576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:31.957458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:31.959005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:36:31.960385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:31.961197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3013/6075] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:31 2022] DELETE /identity/v3/users/93af4655b28648d08cded0540173d2ac => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:31.963057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.018703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3063/6076] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:36:32.019371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.021035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:32.200535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807dfb4-5830-41fb-a92e-0d442f287392 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.212150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.217371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.217902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.218557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.219367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.222393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.279548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3014/6077] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:32 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:36:32.284534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.302706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c58d4-36f4-4157-b26d-21ad012f38a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.321281 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:32.359113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.362984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:32.436472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.437565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.437880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.438154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.440476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.444814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.469959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e468e0f-9ffe-4a47-a0dd-8be37da1dd64 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.476131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3064/6078] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:32 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:32.482318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.493457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.495039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b5bfd-9c01-4bb9-a3f3-94be000062f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.495659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.496174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.496646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] PATH_INFO: `/v3/projects/64b9be90c4164b669023b4a6a42df574` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.498129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b9be90c4164b669023b4a6a42df574)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.500410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.501323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.502397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.502816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.503472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.504277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.506559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.522590 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3065/6079] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:32.525949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.542957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3ddf-415d-45f1-84c0-b158c63fe98a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.548458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.549827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.550120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.550404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.551317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.553288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.574971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3066/6080] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:36:32.579467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.608476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b9be90c4164b669023b4a6a42df574', 'request_id': 'req-d0e8d6ac-16fa-4ec6-aced-1b4708715696'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:32.609379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd0d77-f61d-44e2-8eb1-58c968f31e23 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.629553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b9be90c4164b669023b4a6a42df574', 'request_id': 'req-d0e8d6ac-16fa-4ec6-aced-1b4708715696'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:32.636975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b9be90c4164b669023b4a6a42df574', 'request_id': 'req-d0e8d6ac-16fa-4ec6-aced-1b4708715696'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:32.639200 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:32.691284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] The token cache is being invalidate because project 64b9be90c4164b669023b4a6a42df574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:32.691756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:32.692677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:32.698563 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3015/6081] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:32 2022] DELETE /identity/v3/projects/64b9be90c4164b669023b4a6a42df574 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:32.703528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:32.707655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:32.755523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:32.756944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.757350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.757892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] PATH_INFO: `/v3/projects/7ea051af498c4a9c9970f51f662ca7ed/users/c29445985912408f81a8730ebaaa9b8b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.802215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea051af498c4a9c9970f51f662ca7ed, user_id=c29445985912408f81a8730ebaaa9b8b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:32.805460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4511de-4f93-4e7f-b2b7-5acf2545f79c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:32.850104 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3067/6082] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:32 2022] PUT /identity/v3/projects/7ea051af498c4a9c9970f51f662ca7ed/users/c29445985912408f81a8730ebaaa9b8b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:32.852449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:32.852746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:32.853026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:32.856839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d6ac-16fa-4ec6-aced-1b4708715696 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:32.929575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] MFA Rules not processed for user `c29445985912408f81a8730ebaaa9b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:32.932074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:33.023268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:33.025411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:33.026008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:33.027112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] PATH_INFO: `/v3/users/b5868f042aab4af78667da4af123f8d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:33.028559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5868f042aab4af78667da4af123f8d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:33.031154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:33.057210 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:33.081233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3068/6083] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:33.089134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:33.091358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:33.166919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5868f042aab4af78667da4af123f8d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:33.215374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5868f042aab4af78667da4af123f8d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:33.228358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5868f042aab4af78667da4af123f8d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:33.331763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5868f042aab4af78667da4af123f8d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:33.343876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5868f042aab4af78667da4af123f8d5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:33.354931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1c3b-9f1e-45e6-87a7-dc4b567366c6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:33.366055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3016/6084] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:32 2022] DELETE /identity/v3/users/b5868f042aab4af78667da4af123f8d5 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:33.541821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:33.543984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:33.545100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:33.546051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:33.552923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:33.694258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:33.697130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bf482-9f22-4b84-bc08-781608c1f531 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:33.728177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3069/6085] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:36:34.066765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:34.068815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:34.137120 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:34.217493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280c7c-ee12-446c-b7b1-33f070f3f8e7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:34.230894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:34.231979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:34.233729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:34.233729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] PATH_INFO: `/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:34.237757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f32ff6bc944c2399238fed43f1ed2d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:34.241352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:34.342456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f32ff6bc944c2399238fed43f1ed2d', 'request_id': 'req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:34.359676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f32ff6bc944c2399238fed43f1ed2d', 'request_id': 'req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:34.367663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f32ff6bc944c2399238fed43f1ed2d', 'request_id': 'req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:34.395904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] The token cache is being invalidate because project c9f32ff6bc944c2399238fed43f1ed2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:34.396218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:34.396877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6cc5f2e4-2d6c-45d1-b4c6-2269a97745e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:34.403892 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3017/6086] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:34 2022] DELETE /identity/v3/projects/c9f32ff6bc944c2399238fed43f1ed2d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:34.404819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:34.405926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:34.406356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:34.441930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:34.444304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:34.678981 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3070/6087] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:36:34.688914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:34.689204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:34.689571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:34.738828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:34.741040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:34.765499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3018/6088] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:34.769081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:34.777137 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:34.784860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3426b-d40e-4934-8ff5-b07aff31ac29 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:34.805617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:34.806558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:34.807004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:34.807575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:34.808662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:36:34.809120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:34.810939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:34.832305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3071/6089] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:36:34.833336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:34.844463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a691f9-2836-410d-8892-4a382c55d395 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:34.871040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:34.872090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:34.872487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:34.873008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:34.873990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:34.876028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:34.999476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3019/6090] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:34 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:36:35.001269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.018371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663cb7-d658-406e-bbaa-97a0ed617320 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.202110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.202829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.203317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.203615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.204316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.210705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.254558 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3072/6091] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:35 2022] POST /identity/v3/users => generated 295 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:35.258585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.274272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b084b8-6945-420a-950f-368789cddb1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.295301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.295301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.295667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.296746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.297571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.300926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.321757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3020/6092] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:35.322157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.334012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d201e0-1165-4853-81bc-cf82d2d3df3f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.347207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.348209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.348597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.348969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.350427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.352350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb14088-de69-47e0-a9c3-aed025546115 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.366828 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3073/6093] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:35.370670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.383864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecbd6b-5841-46a7-aec4-9d301241db16 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.403427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.405501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.405846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.406456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] PATH_INFO: `/v3/projects/f090fd22b51a49819e4efe8e5a6fd184/users/545a39e3583b41b1b9ba0cf41507754f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.433159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f090fd22b51a49819e4efe8e5a6fd184, user_id=545a39e3583b41b1b9ba0cf41507754f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.443508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.487835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3021/6094] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:35 2022] PUT /identity/v3/projects/f090fd22b51a49819e4efe8e5a6fd184/users/545a39e3583b41b1b9ba0cf41507754f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:35.488945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.489442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.489914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.556992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] MFA Rules not processed for user `545a39e3583b41b1b9ba0cf41507754f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:35.556992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:35.670216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3074/6095] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:35.672000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.749350 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:35.778894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098669f1-739e-4ee5-ad49-173c5fec742b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.786888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.787697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.788276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.789097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.789959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.802724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.846418 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3022/6096] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:35 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:35.851170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:35.870622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359d706-0dc0-4682-b072-41610fc97b04 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:35.973952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:35.974649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:35.974935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:35.975209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:35.976095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:35.978317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:35.986779 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:36.055105 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3075/6097] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:35 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:36:36.065862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:36.085895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecdb77-f10d-4439-bd2b-e0aeff67fcb9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:36.093174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:36.095508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.095929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.096316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.097417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:36.101810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:36.119333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3023/6098] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:36.130272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:36.140936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e305c62-fd05-4e7e-9691-9f64e8375437 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:36.146243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:36.147037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.147390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.147734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.148548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:36.150295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612195b-a997-4220-9115-c3f5bbd47c53 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:36.161602 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3076/6099] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:36.165750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:36.191030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10835b4-c805-418a-8d6c-7366d1662091 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:36.207588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:36.210928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.211226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.211513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] PATH_INFO: `/v3/projects/ad8b57ad4ab34ff29258f3f1cf91f440/users/862a417573a4464abca67495dad1618c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.247954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8b57ad4ab34ff29258f3f1cf91f440, user_id=862a417573a4464abca67495dad1618c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:36.251226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:36.296540 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3024/6100] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:36 2022] PUT /identity/v3/projects/ad8b57ad4ab34ff29258f3f1cf91f440/users/862a417573a4464abca67495dad1618c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:36.299849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.300327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.300672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.342461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] MFA Rules not processed for user `862a417573a4464abca67495dad1618c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:36.344680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:36.506261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3077/6101] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:36.509927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:36.676579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895733-eb03-4b9e-8c5c-402c3b6aeeed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:36.691133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:36.691822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.692120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.692385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.693119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:36.697045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:36.769083 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3025/6102] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:36 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:36.773271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:36.800242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4e0f-cb18-41a9-ba53-3292d3a9fcea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:36.945376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:36.946108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:36.946399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:36.946683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:36.948925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:36.955315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:36.994000 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3078/6103] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:36 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:36.997630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:37.010331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca1d90-f6d0-4260-85e8-69f7b569fd48 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:37.015091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:37.015768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.016052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.016355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:37.017770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:37.020286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:37.035543 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3026/6104] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:37.041074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:37.057018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c9f3-6295-41a1-b559-75dffdc120cd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:37.071190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:37.073786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.074080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.074457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] PATH_INFO: `/v3/projects/2aa4973385a644dba9f749b621e18978/users/8254c494fba340d28b630f5e30afd344/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:37.112243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa4973385a644dba9f749b621e18978, user_id=8254c494fba340d28b630f5e30afd344, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:37.115439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:37.150321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3079/6105] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:37 2022] PUT /identity/v3/projects/2aa4973385a644dba9f749b621e18978/users/8254c494fba340d28b630f5e30afd344/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:37.155154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:37.177593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0eed4-b2e8-437c-bdb6-6e5037957dce admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:37.261004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:37.262218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.262760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.263305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:37.264572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:37.267861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f466b-ddf4-4bfc-9376-a3eb783a473d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:37.289310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:37.299858 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3027/6106] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:37.305163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9daeb-1d5b-4f5f-9c2d-3310aeca2493 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:37.312800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:37.314966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.315689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.316879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] PATH_INFO: `/v3/projects/2aa4973385a644dba9f749b621e18978/users/8254c494fba340d28b630f5e30afd344/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:37.322301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa4973385a644dba9f749b621e18978, user_id=8254c494fba340d28b630f5e30afd344, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:37.326211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:37.369718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3080/6107] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:37 2022] PUT /identity/v3/projects/2aa4973385a644dba9f749b621e18978/users/8254c494fba340d28b630f5e30afd344/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:37.382469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.383311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.384305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:37.393616 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:37.435167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] MFA Rules not processed for user `8254c494fba340d28b630f5e30afd344`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:37.436698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:37.587663 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3028/6108] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:37.599957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:37.602257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:37.687823 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:37.924779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8e26-3f74-443f-b311-ffa487dbfad6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:37.933056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:37.933826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:37.934292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:37.934574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:38.128585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:38.131655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74805-07c7-4790-8fc0-593e99f3f8a8 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:38.154567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3081/6109] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:42.405555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:42.409423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:42.585387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab6f5-0376-46ef-ab7f-990045491ea8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:42.585387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:42.585387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:42.585387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:42.585875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:42.617930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:42.621334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:42.648303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3029/6110] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:48.116248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab354-8ae2-46a0-bbd2-065bc08cdb4f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:48.116769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab354-8ae2-46a0-bbd2-065bc08cdb4f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:48.116769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab354-8ae2-46a0-bbd2-065bc08cdb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:48.192348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5cbab354-8ae2-46a0-bbd2-065bc08cdb4f None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:48.194694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5cbab354-8ae2-46a0-bbd2-065bc08cdb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:48.321426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3082/6111] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:36:48.336467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:48.340078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:48.633764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5ab6-c5ec-448a-b3ca-cc8aa9e02923 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:48.645637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:48.646411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:48.646694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:48.646989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:48.668902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:48.670381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:48.707200 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3030/6112] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:36:49.915263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:49.916562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:49.916995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:49.958543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] MFA Rules not processed for user `545a39e3583b41b1b9ba0cf41507754f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:49.960149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:49.986062 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3083/6113] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:50.980038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:50.981889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:51.029905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58868ce-1924-4e64-a3da-7bd4c7d223f4 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:51.051336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:51.052213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:51.052656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:51.053077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:51.061077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:51.108001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:51.109416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:51.160735 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3031/6114] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:36:56.435370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:56.436890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:56.517006 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:56.547281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d81860-7d42-48fe-98ca-e62157a83fc3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:56.554872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:56.557004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:56.557400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:56.557854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] PATH_INFO: `/v3/users/280d6677ca794b7eab9fb6f4214f572e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:56.559204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280d6677ca794b7eab9fb6f4214f572e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:56.563793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:56.641170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280d6677ca794b7eab9fb6f4214f572e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:56.643202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280d6677ca794b7eab9fb6f4214f572e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:56.667579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280d6677ca794b7eab9fb6f4214f572e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:56.683280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280d6677ca794b7eab9fb6f4214f572e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:56.726599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-76ded3e6-543d-4270-902f-70c564ed6193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280d6677ca794b7eab9fb6f4214f572e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:56.758781 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3084/6115] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:36:56 2022] DELETE /identity/v3/users/280d6677ca794b7eab9fb6f4214f572e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:57.425954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:57.445809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2b138-8ea7-480a-93f1-cda6a4fe5ecd service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:57.452527 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:57.567231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:57.568208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:57.568486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:57.570380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] PATH_INFO: `/v3/projects/81e420896e8b4382b3441e63abf81c15` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:57.584495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e420896e8b4382b3441e63abf81c15)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:57.587393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:57.689012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e420896e8b4382b3441e63abf81c15', 'request_id': 'req-54a58277-9fef-46ba-a63b-ee9ced795334'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:57.706435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e420896e8b4382b3441e63abf81c15', 'request_id': 'req-54a58277-9fef-46ba-a63b-ee9ced795334'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:57.718913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e420896e8b4382b3441e63abf81c15', 'request_id': 'req-54a58277-9fef-46ba-a63b-ee9ced795334'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:57.743381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] The token cache is being invalidate because project 81e420896e8b4382b3441e63abf81c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:36:57.743679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:57.744380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-54a58277-9fef-46ba-a63b-ee9ced795334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:36:57.746561 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3032/6116] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:36:57 2022] DELETE /identity/v3/projects/81e420896e8b4382b3441e63abf81c15 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:57.751887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:57.752323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:57.752508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:57.788040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:57.789435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:57.882113 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3085/6117] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:36:57.889550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:57.889994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:57.890372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:57.926871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:57.928106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:57.951022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3033/6118] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:57.955007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:57.966993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b93222-89b9-484c-a2a2-2dbd202705ab None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:57.973157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:57.974199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:57.974677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:57.975801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:57.976929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:36:57.977554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:57.989393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.016836 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3086/6119] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:36:58.020986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.033886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd60b6-2ed4-487f-892e-0692561845ed None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.043740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.044788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.045280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.048612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.049634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:58.053300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.137308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3034/6120] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:36:58 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:58.141873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.153490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3495-e03c-4205-83e7-e88c1b3b24dd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.209516 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:58.251674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.252737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.253314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.253886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.255004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:58.257546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.286804 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3087/6121] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:36:58 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:36:58.290995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.306253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810fc8-ecc2-4e56-ae46-0e27fbc29377 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.311243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.312022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.322882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.323335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.326467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:58.328146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.368089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3035/6122] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:58.372474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.393521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d27882-5b0f-471b-acb5-5feadd2f0b53 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.405906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.406635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.407075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.407290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.408034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:58.409652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175eb2e3-d348-4404-aeb5-c26c290c5b92 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.437473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3088/6123] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:36:58.442528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.467240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b27a3-890a-4cce-ae6f-b35bd91125c3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.480315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.487221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.487955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.488800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] PATH_INFO: `/v3/projects/067f6fe185724ef0931a4cfb8680cfba/users/6e881888eab24d93b513f03556871677/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.550622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067f6fe185724ef0931a4cfb8680cfba, user_id=6e881888eab24d93b513f03556871677, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:58.553842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:58.585297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3036/6124] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:36:58 2022] PUT /identity/v3/projects/067f6fe185724ef0931a4cfb8680cfba/users/6e881888eab24d93b513f03556871677/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:36:58.589581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6fd2e-7afc-428e-b8c8-47e26e68110c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.589581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6fd2e-7afc-428e-b8c8-47e26e68110c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.589581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6fd2e-7afc-428e-b8c8-47e26e68110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:58.640657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b3d6fd2e-7afc-428e-b8c8-47e26e68110c None None] MFA Rules not processed for user `6e881888eab24d93b513f03556871677`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:36:58.642448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b3d6fd2e-7afc-428e-b8c8-47e26e68110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:58.797023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3089/6125] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:36:58.813902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:36:58.817490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:36:58.891224 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:36:58.955086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6811-a1eb-49a0-b971-986a89b552d3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:36:58.964125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:36:58.964807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:36:58.965103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:36:58.965374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:36:59.001826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:36:59.001826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:36:59.016971 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3037/6126] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:01.855650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:01.856337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:01.856453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:01.882293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] MFA Rules not processed for user `6e881888eab24d93b513f03556871677`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:01.884227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:01.896960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3090/6127] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:03.050125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:03.051956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:03.256170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c4a6-0dd7-4411-b076-a075c02176a5 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:03.286390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:03.288208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:03.288995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:03.289710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] PATH_INFO: `/v3/users/491186789eb04cf5bf6c16d9d9d7d043` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:03.291364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=491186789eb04cf5bf6c16d9d9d7d043)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:03.293976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:03.392246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491186789eb04cf5bf6c16d9d9d7d043'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:03.409386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491186789eb04cf5bf6c16d9d9d7d043'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:03.429359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491186789eb04cf5bf6c16d9d9d7d043'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:03.484564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491186789eb04cf5bf6c16d9d9d7d043'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:03.487741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b2e435d-b5b9-4bb5-83c8-bdb690d330fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491186789eb04cf5bf6c16d9d9d7d043'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:03.501334 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3038/6128] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:37:03 2022] DELETE /identity/v3/users/491186789eb04cf5bf6c16d9d9d7d043 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:03.983698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:04.004167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d46717-8825-43af-9cde-995e7157e0fe None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:04.166474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:04.167429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:04.167718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:04.167995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] PATH_INFO: `/v3/projects/3d222453d2a14232b467364e9d39ec72` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:04.172755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d222453d2a14232b467364e9d39ec72)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:04.176328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:04.269340 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:04.308270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d222453d2a14232b467364e9d39ec72', 'request_id': 'req-ef47d01e-f074-4d92-a6a3-623383d0574c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:04.336797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d222453d2a14232b467364e9d39ec72', 'request_id': 'req-ef47d01e-f074-4d92-a6a3-623383d0574c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:04.369289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d222453d2a14232b467364e9d39ec72', 'request_id': 'req-ef47d01e-f074-4d92-a6a3-623383d0574c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:04.391553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] The token cache is being invalidate because project 3d222453d2a14232b467364e9d39ec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:37:04.392016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:04.392978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef47d01e-f074-4d92-a6a3-623383d0574c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:04.395651 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3091/6129] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:37:03 2022] DELETE /identity/v3/projects/3d222453d2a14232b467364e9d39ec72 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:04.401922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:04.402775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:04.403212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:04.486806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:04.488250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:04.594979 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:04.671816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3039/6130] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:04.673000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:04.673299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:04.673580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:04.724275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:04.726614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:04.744280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:04.751841 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3092/6131] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:04.764096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b5d2-a3c2-4feb-8398-8b602b25e28b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:04.776783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:04.777787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:04.778228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:04.780675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:04.781709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:37:04.782186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:04.785536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:04.815045 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3040/6132] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:37:04.819212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:04.834671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59580d91-23e7-4397-9ffc-b347cc370b61 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:04.845033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:04.846239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:04.846528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:04.846806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:04.847938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:04.851754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:04.929654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:04.939479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3093/6133] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:04.944554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb490ad1-e708-4147-b348-8995406e0020 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:05.048820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:05.049609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.050293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.051044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.052887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:05.057216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:05.111491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:05.124258 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3041/6134] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:37:04 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:05.132800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13e76-b84d-4296-8182-6a193f257164 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:05.144473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:05.147269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.148433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.148951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.159091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:05.164124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:05.228227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:05.249217 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3094/6135] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:37:05.257806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97fc4-863f-430f-84a6-ed4cd673bd8b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:05.270986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:05.271739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.272034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.272376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.273295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:05.275476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9338da-fe5b-49d2-8405-4ca88cb837f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:05.322237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:05.336735 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3042/6136] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:05.339117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d90a-6c6d-4cf4-993e-98ab1b27eca7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:05.362092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:05.363085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.363360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.363817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] PATH_INFO: `/v3/projects/5d455f20d2734d0b8942981197e3a782/users/0f93ef61264a4d1292ed7700b89c22fd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.404339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d455f20d2734d0b8942981197e3a782, user_id=0f93ef61264a4d1292ed7700b89c22fd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:05.407471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:05.459091 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3095/6137] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:37:05 2022] PUT /identity/v3/projects/5d455f20d2734d0b8942981197e3a782/users/0f93ef61264a4d1292ed7700b89c22fd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:05.465920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.466809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.467638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.514358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:05.518674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:05.533469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:05.536818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:05.701532 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3043/6138] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:05.720394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:05.722828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:05.769006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1ca4d-3937-4833-a36f-1f67165e1f76 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:05.777602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:05.778621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:05.778907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:05.779188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] PATH_INFO: `/v3/users/5c7a944332ae4f55a3f43679b916ec0e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:05.781082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7a944332ae4f55a3f43679b916ec0e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:05.786287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:05.910876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7a944332ae4f55a3f43679b916ec0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:05.911591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7a944332ae4f55a3f43679b916ec0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:05.933707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7a944332ae4f55a3f43679b916ec0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:05.950215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7a944332ae4f55a3f43679b916ec0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:05.957492 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:05.959297 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:05.974623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c8c37f8-4361-46b8-be8c-410ee9242c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7a944332ae4f55a3f43679b916ec0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:05.984501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3096/6139] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:37:05 2022] DELETE /identity/v3/users/5c7a944332ae4f55a3f43679b916ec0e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:05.997848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5216f-a41f-4c4b-b6c4-f1b2c69fdf55 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:06.001389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:06.002466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:06.002898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:06.073504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:06.077718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:06.100092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:06.100759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:06.101271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:06.102117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:06.105353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:06.201840 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3097/6140] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:06.215879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:06.217722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:06.246328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d718d3-daa2-4960-a4fe-d0f63fe71263 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:06.255546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:06.256221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:06.256507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:06.256788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:06.281441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:06.284238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:06.292947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:06.294440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ff25f-8f12-46e4-a10b-957a9f3dc84c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:06.310697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3044/6141] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:06.312705 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3098/6142] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:06.935959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:06.938457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:06.972881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903349-bed4-4dcf-98d2-10a9818e51cb service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:06.984466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:06.988808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:06.989093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:06.990776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] PATH_INFO: `/v3/projects/392eaf37c53942d4adc5467680b1301a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:06.994208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] RBAC: Authorizing `identity:delete_project(project_id=392eaf37c53942d4adc5467680b1301a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:06.999034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.068493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392eaf37c53942d4adc5467680b1301a', 'request_id': 'req-dae448f0-2e22-42aa-b4e6-d0d5e035557b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:07.076838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392eaf37c53942d4adc5467680b1301a', 'request_id': 'req-dae448f0-2e22-42aa-b4e6-d0d5e035557b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:07.083568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392eaf37c53942d4adc5467680b1301a', 'request_id': 'req-dae448f0-2e22-42aa-b4e6-d0d5e035557b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:07.107229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] The token cache is being invalidate because project 392eaf37c53942d4adc5467680b1301a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:37:07.107535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:07.108262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dae448f0-2e22-42aa-b4e6-d0d5e035557b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:07.111105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3045/6143] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:37:06 2022] DELETE /identity/v3/projects/392eaf37c53942d4adc5467680b1301a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:07.115560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.116104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.116387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.147064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:07.148976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:07.289777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3099/6144] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:07.296574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.298011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.298625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.334059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:07.335403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:07.353890 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3046/6145] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:07.358290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.369700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20b0d7-853b-4dc0-bd62-818bf1bfd98d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.375893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.376806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.376969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.377218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.378107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:37:07.378416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.380151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.393488 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3100/6146] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:37:07.397803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.407625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bdc73-29dc-4648-9503-5b6e3f15c11f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.413491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.414234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.414465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.414737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.415429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.417956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.433647 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:07.454739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.463470 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3047/6147] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:37:07 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:07.468149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502634c-161c-491a-92d2-4381a4d39499 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.583069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.583945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.584923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.585305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.586137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.588656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.598601 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:07.626959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.645934 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3101/6148] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:37:07 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:07.659464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12fda-1d06-4e4e-8c18-79b4e12cf4b6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.670099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.671825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.672798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.673237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.674224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.676985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.691708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3048/6149] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:07.695466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.713720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d5b0-35bb-4400-bb1e-d3a0f882e035 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.730405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.732001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.732908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.733186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.736747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.744619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14844870-1c20-4535-b9df-04c9b2485f67 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.773311 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3102/6150] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:37:07.777759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:07.790660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5efb01-4631-4870-8b69-59db3c662561 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:07.797033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:07.798551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.799052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.799583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] PATH_INFO: `/v3/projects/0c5949ea02a14ba3a754fcfca65c480b/users/18ac26d5a2f147bebb69f2625c9616f4/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.817714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5949ea02a14ba3a754fcfca65c480b, user_id=18ac26d5a2f147bebb69f2625c9616f4, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:07.820933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:07.855340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3049/6151] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:37:07 2022] PUT /identity/v3/projects/0c5949ea02a14ba3a754fcfca65c480b/users/18ac26d5a2f147bebb69f2625c9616f4/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:07.857813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86457c-bf37-4b03-94aa-673ebd2f0762 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:07.858116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86457c-bf37-4b03-94aa-673ebd2f0762 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:07.858470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86457c-bf37-4b03-94aa-673ebd2f0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:07.923841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6e86457c-bf37-4b03-94aa-673ebd2f0762 None None] MFA Rules not processed for user `18ac26d5a2f147bebb69f2625c9616f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:07.926014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e86457c-bf37-4b03-94aa-673ebd2f0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:08.025531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3103/6152] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:08.039872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:08.042041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:08.159292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64390-4398-4596-832e-6d5e759b79c9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:08.175567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:08.176376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:08.176724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:08.177084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:08.194841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:08.196657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b568e-5d63-41f0-8233-45bdab98f2db service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:08.224042 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3050/6153] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:15.990660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bead98-b8af-45fa-9b6e-a119fe9100c3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:15.991526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bead98-b8af-45fa-9b6e-a119fe9100c3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:15.992069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bead98-b8af-45fa-9b6e-a119fe9100c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:16.015192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d7bead98-b8af-45fa-9b6e-a119fe9100c3 None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:16.017705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d7bead98-b8af-45fa-9b6e-a119fe9100c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:16.104454 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3104/6154] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:17.997396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:17.997910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:17.998003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:18.091501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] MFA Rules not processed for user `0f93ef61264a4d1292ed7700b89c22fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:18.095136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:18.389747 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3051/6155] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:18.395953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:18.396493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:18.396576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:18.459224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] MFA Rules not processed for user `0f93ef61264a4d1292ed7700b89c22fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:18.470563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:18.498515 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3105/6156] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:18.551680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:18.554346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:18.713055 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:18.801664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee92-b15d-440b-bdca-c8729c97e263 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:18.830528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:18.831350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:18.831642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:18.831925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:18.851803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:18.853924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0c360-dd77-4283-a799-e70b0cf02dfb service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:18.869834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3052/6157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:37:28.428723 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:SELECT=67 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:28.862138 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=15 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:32.795791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:32.882895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fe692-2803-4993-9e7e-e227cee52aec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:32.887757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:32.888822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:32.889268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:32.889734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] PATH_INFO: `/v3/users/18ac26d5a2f147bebb69f2625c9616f4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:32.892051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ac26d5a2f147bebb69f2625c9616f4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:32.894359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:32.947051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ac26d5a2f147bebb69f2625c9616f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:32.948401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ac26d5a2f147bebb69f2625c9616f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:32.958125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ac26d5a2f147bebb69f2625c9616f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:32.966823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ac26d5a2f147bebb69f2625c9616f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:32.980705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ac26d5a2f147bebb69f2625c9616f4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:32.987449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3106/6158] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:37:32 2022] DELETE /identity/v3/users/18ac26d5a2f147bebb69f2625c9616f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:32.991914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:32.992394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:32.992487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.011246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:33.012440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.071481 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3053/6159] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:37:33.081628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:33.083119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.149394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e16e8-3d89-4e86-819b-565cba8716a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:33.153258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:33.153950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.154234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.154511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.166346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:33.166899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:33.179028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3107/6160] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:33.404205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:33.406506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.487908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:33.489611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.518549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f7a4-1a19-47a0-999d-1de83dbbaa2e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:33.525026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e649-34c5-4bda-aac8-b099394c7f9f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:33.529353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:33.529849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.530137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.530957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.534176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.536920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:33.537817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.538102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.538379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] PATH_INFO: `/v3/projects/0c5949ea02a14ba3a754fcfca65c480b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.540024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5949ea02a14ba3a754fcfca65c480b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:33.541981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:33.584861 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:33.635075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5949ea02a14ba3a754fcfca65c480b', 'request_id': 'req-f0189229-ce30-42d1-ac6d-b89fb82e264a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:33.642846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5949ea02a14ba3a754fcfca65c480b', 'request_id': 'req-f0189229-ce30-42d1-ac6d-b89fb82e264a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:33.658243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5949ea02a14ba3a754fcfca65c480b', 'request_id': 'req-f0189229-ce30-42d1-ac6d-b89fb82e264a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:33.670602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:33.674604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019fde2-f712-448a-b8f4-047a584241c3 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:33.685627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] The token cache is being invalidate because project 0c5949ea02a14ba3a754fcfca65c480b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:37:33.687460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:33.689072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f0189229-ce30-42d1-ac6d-b89fb82e264a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:33.692585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3108/6161] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:37:33 2022] DELETE /identity/v3/projects/0c5949ea02a14ba3a754fcfca65c480b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:37:33.699282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.699486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3054/6162] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:33.699582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.699950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.755278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:33.756526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.870086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.870376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.870666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.874805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3109/6163] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:33.892804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:33.895122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:33.911560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:33.917915 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3055/6164] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:37:33.922994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f6b7-80a2-4497-aab5-b426346fbc45 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:33.927928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:33.928792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.929082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.929364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.930168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:37:33.930481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:33.932271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:33.950861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:33.964808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3110/6165] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:37:33.970612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6384f-2b02-42e5-ba73-902defccaa90 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:33.984521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:33.985571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:33.985908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:33.986197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:33.986927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:33.989050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.031048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:34.039285 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3056/6166] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:37:33 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:34.044466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914b10-16c2-4a1e-abfd-7dd325c8d7dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:34.149329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:34.150138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.150427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.150902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.153226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:34.155258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.232015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:34.232831 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3111/6167] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:37:34 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:37:34.250596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640379-61c3-414c-8db3-4110eaa7e234 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:34.269940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:34.270749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.271074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.271509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.281503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:34.281503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.303291 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3057/6168] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:34.304553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:34.318024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78d159-c286-4513-8ee8-5ac10a9042ae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:34.326682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:34.329478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.329856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.330205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.331018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:34.334082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337acc-5158-4bc6-b522-c4a9c281901a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.339456 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:34.366051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3112/6169] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:34.367211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:34.379873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63180-22ce-477a-9e1f-af753bfd0956 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:34.394116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:34.395387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.395859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.396331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] PATH_INFO: `/v3/projects/036b5e666e6847aa9f1662d3c8a8cf8f/users/5cf54cec4e9b4c6f8b7326c7daaaa703/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.433797 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:34.441014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036b5e666e6847aa9f1662d3c8a8cf8f, user_id=5cf54cec4e9b4c6f8b7326c7daaaa703, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:34.444801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.494190 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3058/6170] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:37:34 2022] PUT /identity/v3/projects/036b5e666e6847aa9f1662d3c8a8cf8f/users/5cf54cec4e9b4c6f8b7326c7daaaa703/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:34.499030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.500364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.500650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.579387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] MFA Rules not processed for user `5cf54cec4e9b4c6f8b7326c7daaaa703`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:34.580820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:34.769727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3113/6171] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:34.780162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:34.785724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:34.885344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a24de-28bf-4f0a-8352-1a046a4a5592 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:34.889278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:34.890189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:34.890476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:34.890755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:34.900884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:34.902686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2790c9c-0ba7-4c96-a01f-270ba919fdd7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:34.915136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3059/6172] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:35.349044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:35.440177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f52e8-fb67-4459-b3e9-4cdb9ce67e96 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:35.445220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:35.446141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:35.446432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:35.446696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] PATH_INFO: `/v3/users/5cf54cec4e9b4c6f8b7326c7daaaa703` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:35.447909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf54cec4e9b4c6f8b7326c7daaaa703)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:35.449915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:35.534736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf54cec4e9b4c6f8b7326c7daaaa703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:35.535445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf54cec4e9b4c6f8b7326c7daaaa703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:35.549284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf54cec4e9b4c6f8b7326c7daaaa703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:35.559806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf54cec4e9b4c6f8b7326c7daaaa703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:35.575021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf54cec4e9b4c6f8b7326c7daaaa703'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:35.583006 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3114/6173] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:37:35 2022] DELETE /identity/v3/users/5cf54cec4e9b4c6f8b7326c7daaaa703 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:35.587406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:35.587835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:35.588000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:35.622698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:35.626426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:35.711238 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3060/6174] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:35.721880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:35.723270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:35.731792 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:35.868423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9dd80-8130-4cb4-81bc-94fe160f8cf3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:35.879802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:35.880706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:35.881182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:35.881883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:35.898114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:35.903541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd2d85-a095-478a-8262-6ecc41d26c4d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:35.932904 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3115/6175] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:36.294713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.296289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:36.317495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3015151-ccd8-4215-91d2-de4ae6082aa3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.322800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.323980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.324544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.324891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] PATH_INFO: `/v3/projects/036b5e666e6847aa9f1662d3c8a8cf8f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.326304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036b5e666e6847aa9f1662d3c8a8cf8f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.328858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.391786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036b5e666e6847aa9f1662d3c8a8cf8f', 'request_id': 'req-bb3c7c37-67ae-4e97-8f6c-83b520eed823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:36.398465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036b5e666e6847aa9f1662d3c8a8cf8f', 'request_id': 'req-bb3c7c37-67ae-4e97-8f6c-83b520eed823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:36.404723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036b5e666e6847aa9f1662d3c8a8cf8f', 'request_id': 'req-bb3c7c37-67ae-4e97-8f6c-83b520eed823'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:36.419404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] The token cache is being invalidate because project 036b5e666e6847aa9f1662d3c8a8cf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:37:36.419718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:36.420324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-bb3c7c37-67ae-4e97-8f6c-83b520eed823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:36.422556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3061/6176] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:37:36 2022] DELETE /identity/v3/projects/036b5e666e6847aa9f1662d3c8a8cf8f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:36.427515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.427964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.428099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.446658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:36.447820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:36.511857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3116/6177] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:36.520477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.520907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.521256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.546871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:36.547944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:36.557835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3062/6178] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:36.560457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.571203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ad70c-ebd6-4778-b614-c2f68e250f6f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.576750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.578086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.578368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.578658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.579372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:37:36.579667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.581277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.594047 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3117/6179] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:37:36.598167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.608018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4ae-b810-4dfd-a15a-b886d9d14bd3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.613621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.614380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.614663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.614936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.615639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.617548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.627599 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:36.657332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3063/6180] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:37:36 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:36.658533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.668624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba84c9-6b10-4d96-be11-2bb3a818908a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.732147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.732943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.733229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.734301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.734918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.736909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.757069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3118/6181] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:37:36 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:37:36.761223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.772260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56aa2-0f27-4f96-9c50-90a5fc02899a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.776919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.777583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.777903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.778179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.778920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.781721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.791779 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3064/6182] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:36.795834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.807031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d540753-7521-4961-a245-d35ef049c6b7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.811815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.812881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.813161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.813437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.814208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.815802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413157-0f1b-4563-9343-98799c49a8fa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.826527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3119/6183] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:37:36.831241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:36.841508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b4a6-f651-4676-99b9-78d232cc3bee admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:36.846820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:36.847725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.848004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.848277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] PATH_INFO: `/v3/projects/a2cff9a5aee2498991389b6d376f3b95/users/b1f408048a184c63b8324f78faf4b0bd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.864269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cff9a5aee2498991389b6d376f3b95, user_id=b1f408048a184c63b8324f78faf4b0bd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:36.866956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:36.893760 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3065/6184] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:37:36 2022] PUT /identity/v3/projects/a2cff9a5aee2498991389b6d376f3b95/users/b1f408048a184c63b8324f78faf4b0bd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:36.896041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b350a1-3016-4b1d-8869-993be2687b6c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:36.896403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b350a1-3016-4b1d-8869-993be2687b6c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:36.896752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b350a1-3016-4b1d-8869-993be2687b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:36.927552 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:36.931289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a4b350a1-3016-4b1d-8869-993be2687b6c None None] MFA Rules not processed for user `b1f408048a184c63b8324f78faf4b0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:36.933289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4b350a1-3016-4b1d-8869-993be2687b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:37.037890 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3120/6185] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:37.044895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:37.047646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:37.147399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fe07a-a11b-4f35-926b-f82df0f101e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:37.151985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:37.152734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:37.153095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:37.153448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:37.166469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:37.170597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:37.193078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3066/6186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:37 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:44.068858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45c6f-e3fa-4c8c-8b1c-b7bf7146d0bf None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:44.069362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45c6f-e3fa-4c8c-8b1c-b7bf7146d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:44.069441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45c6f-e3fa-4c8c-8b1c-b7bf7146d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:44.102999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4b45c6f-e3fa-4c8c-8b1c-b7bf7146d0bf None None] MFA Rules not processed for user `f6a5e8716f324b53b51e8d34cb704321`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:44.126276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4b45c6f-e3fa-4c8c-8b1c-b7bf7146d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:44.320238 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3121/6187] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:47.178740 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:54.308402 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=51 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:57.629791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:57.744404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dfd97-a4b9-40f8-96ff-4443e1141a76 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:57.751197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:57.752099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:57.752381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:57.761207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] PATH_INFO: `/v3/users/b1f408048a184c63b8324f78faf4b0bd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:57.764230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f408048a184c63b8324f78faf4b0bd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:57.772054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:57.876024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f408048a184c63b8324f78faf4b0bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:57.898598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f408048a184c63b8324f78faf4b0bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:57.927184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f408048a184c63b8324f78faf4b0bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:57.966777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f408048a184c63b8324f78faf4b0bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:57.969278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f408048a184c63b8324f78faf4b0bd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:57.993022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3067/6188] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:37:57 2022] DELETE /identity/v3/users/b1f408048a184c63b8324f78faf4b0bd => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:57.996153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:57.997217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:57.998086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:58.031968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:58.033643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:58.220762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3122/6189] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:37:58.236043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:58.238523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:58.330409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26506777-5d37-4c96-8521-967b351a1643 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:58.336830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:58.353619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:58.359435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:58.364056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:58.381572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:58.383366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe60a-5a17-4f85-b774-dea95df815b1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:58.396548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3068/6190] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:37:58.807280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:58.808750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:58.848691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35145a-1871-4285-8775-c3edd5f06b98 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:58.872062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:58.878080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:58.878378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:58.878664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] PATH_INFO: `/v3/projects/a2cff9a5aee2498991389b6d376f3b95` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:58.880012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cff9a5aee2498991389b6d376f3b95)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:58.886218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:58.999564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cff9a5aee2498991389b6d376f3b95', 'request_id': 'req-4ae64251-2d79-4e36-98c6-88d14dae6023'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:59.023503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cff9a5aee2498991389b6d376f3b95', 'request_id': 'req-4ae64251-2d79-4e36-98c6-88d14dae6023'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:59.042998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cff9a5aee2498991389b6d376f3b95', 'request_id': 'req-4ae64251-2d79-4e36-98c6-88d14dae6023'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:59.067352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] The token cache is being invalidate because project a2cff9a5aee2498991389b6d376f3b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:37:59.067646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:59.068420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ae64251-2d79-4e36-98c6-88d14dae6023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:37:59.072249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3123/6191] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:37:58 2022] DELETE /identity/v3/projects/a2cff9a5aee2498991389b6d376f3b95 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:37:59.077703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.078634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.079206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.111941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:59.113418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:59.172872 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:37:59.263369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3069/6192] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:59.271557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.272216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.272654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.319636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:59.324652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:59.340877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3124/6193] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:37:59.346023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.359584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e847f-5eb9-43f8-9236-e7e6931cba63 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.372688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.372688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.372688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.372688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.373269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:37:59.373269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.373269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:59.390587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3070/6194] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:37:59.394941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.407609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a9eff-6b18-4158-afbd-d3bad9f8ebb5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.414748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.415439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.415726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.416012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.416793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.419191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:59.456049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3125/6195] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:37:59 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:37:59.462615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.484930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec0b35-9c65-4555-ad14-fce6ed6819b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.641115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.643499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.644094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.645014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.646419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.650469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77eeb-ebf0-4ed5-b1e7-10053b602253 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:59.688664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3071/6196] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:37:59 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:37:59.691728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.707273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893355cb-3a89-48e2-a310-ef5d2e5d869c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.707889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893355cb-3a89-48e2-a310-ef5d2e5d869c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.709071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893355cb-3a89-48e2-a310-ef5d2e5d869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.719547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c587-3b81-4ba7-bb29-fb4ed373c5b8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.724970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.726279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.726698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.727232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.728034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.730028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:59.752927 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3126/6197] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:59.752927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.761752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-893355cb-3a89-48e2-a310-ef5d2e5d869c None None] MFA Rules not processed for user `4611d01617d645579ae3529c8f8f9de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:37:59.763500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-893355cb-3a89-48e2-a310-ef5d2e5d869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:37:59.765486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762228-97a0-42b7-8f8b-2468717c602e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.789750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.790722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.791079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.791465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.805155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.809982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:37:59.856658 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3127/6198] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:37:59.858782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:37:59.875996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8128e4-ba3f-403c-9ea1-67a742825abf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:37:59.896001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:37:59.901902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:37:59.902459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:37:59.902970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] PATH_INFO: `/v3/projects/49fcf40bdce64185aec79a79ac9f1612/users/2475d4107ece492d83f7a48fc262bc55/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:37:59.924461 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3072/6199] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:37:59.950376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fcf40bdce64185aec79a79ac9f1612, user_id=2475d4107ece492d83f7a48fc262bc55, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:37:59.953848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.004854 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3128/6200] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:37:59 2022] PUT /identity/v3/projects/49fcf40bdce64185aec79a79ac9f1612/users/2475d4107ece492d83f7a48fc262bc55/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:00.005873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.006172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.006456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.078308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] MFA Rules not processed for user `2475d4107ece492d83f7a48fc262bc55`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:00.079465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:00.165018 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:00.166520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.170781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:00.200229 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:00.256585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3073/6201] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:00.261764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.303065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579c40-4a14-4f17-a670-c39eef43b099 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.312251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.313452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.313966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.314486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] PATH_INFO: `/v3/users/0f93ef61264a4d1292ed7700b89c22fd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.316794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f93ef61264a4d1292ed7700b89c22fd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.319848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.367718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e16690-a8da-404b-8df4-7fd07c1fe135 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.379565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.381530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.382241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.383202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.384493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.391185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.415875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f93ef61264a4d1292ed7700b89c22fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.416617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f93ef61264a4d1292ed7700b89c22fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.429293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f93ef61264a4d1292ed7700b89c22fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.441056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f93ef61264a4d1292ed7700b89c22fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.461080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f93ef61264a4d1292ed7700b89c22fd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.466067 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3074/6202] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:00 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:00.477953 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3129/6203] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:00 2022] DELETE /identity/v3/users/0f93ef61264a4d1292ed7700b89c22fd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:00.480165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.483787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:00.581275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fd953-af1a-4ee1-90e6-1faacb4b88c4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.749365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.750413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.750767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.751158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.751941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.757508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.776523 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:00.794162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.797433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:00.810136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3075/6204] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:00 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:00.813312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.823565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc87d-8a45-4234-9f54-c473203c1cfa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.826011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7a91e-fbf5-45b8-a55c-154f7aeedc84 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.832520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.833486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.834136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.834521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.835370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.837182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.853161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3076/6205] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:00.854528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.855311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.856741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.860638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.862148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] PATH_INFO: `/v3/projects/5d455f20d2734d0b8942981197e3a782` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.865324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d455f20d2734d0b8942981197e3a782)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.867513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.873368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8fcd8-3b0a-435e-9a5f-3492508ff420 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:00.891178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:00.892026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:00.892311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:00.892590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] PATH_INFO: `/v3/projects/4385247b47b74f39a6db6db2a4c56a32/users/57aae10ab09648ad86a0248b6ccef9d2/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:00.932078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4385247b47b74f39a6db6db2a4c56a32, user_id=57aae10ab09648ad86a0248b6ccef9d2, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:00.934810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:00.947733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d455f20d2734d0b8942981197e3a782', 'request_id': 'req-20958443-8d97-4c00-9d3e-8e0e662ec9bc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.956522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d455f20d2734d0b8942981197e3a782', 'request_id': 'req-20958443-8d97-4c00-9d3e-8e0e662ec9bc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.962956 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3077/6206] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:00 2022] PUT /identity/v3/projects/4385247b47b74f39a6db6db2a4c56a32/users/57aae10ab09648ad86a0248b6ccef9d2/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:00.967607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:00.968325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d455f20d2734d0b8942981197e3a782', 'request_id': 'req-20958443-8d97-4c00-9d3e-8e0e662ec9bc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.988968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] The token cache is being invalidate because project 5d455f20d2734d0b8942981197e3a782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:00.990533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.992247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-20958443-8d97-4c00-9d3e-8e0e662ec9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:00.995832 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3130/6207] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:00 2022] DELETE /identity/v3/projects/5d455f20d2734d0b8942981197e3a782 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:01.002935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ea5a3-8687-4ef4-beed-83a504da5adb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.003225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ea5a3-8687-4ef4-beed-83a504da5adb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.003505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ea5a3-8687-4ef4-beed-83a504da5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.039947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-457ea5a3-8687-4ef4-beed-83a504da5adb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:01.042489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-457ea5a3-8687-4ef4-beed-83a504da5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:01.049959 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:01.126863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35117-bdbe-432f-8df6-da32091436bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.143832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.144590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.144878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.145323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.146112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.147764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.176013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3078/6208] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:01.176885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.182052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:01.195767 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3131/6209] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:01.202835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301e31-a9f6-4977-9bad-a2b38cca0adc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.209172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.210421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.210715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.211016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] PATH_INFO: `/v3/projects/4385247b47b74f39a6db6db2a4c56a32/users/57aae10ab09648ad86a0248b6ccef9d2/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.214057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4385247b47b74f39a6db6db2a4c56a32, user_id=57aae10ab09648ad86a0248b6ccef9d2, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.217487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9293a7-9605-49a2-afea-a7985abc0834 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.248412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.248696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.248972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.249232 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3079/6210] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:01 2022] PUT /identity/v3/projects/4385247b47b74f39a6db6db2a4c56a32/users/57aae10ab09648ad86a0248b6ccef9d2/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:01.278832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.279109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.280055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.293612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] MFA Rules not processed for user `57aae10ab09648ad86a0248b6ccef9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:01.295588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:01.306443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:01.310490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:01.418986 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3132/6211] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:01.426293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.430978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:01.462280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3080/6212] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:01.463273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.475611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fa5c3-6a97-4d8b-b357-a91143559a59 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.487371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.488265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.488647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.490034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.491655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:01.492276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.494720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.518249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0fcc5-3de6-4c45-b9c1-7bbc99260aab None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.525002 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3081/6213] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:01.525942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.527780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.528888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.529430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.529953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.544749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d3c1c-d7e9-4b89-8228-5879bbe6d526 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.546822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.548459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.558479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.559413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.559868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.560297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.561846 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3133/6214] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:01.575592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.579831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.619671 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3082/6215] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:01 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:01.624546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.656825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c9d1-e1df-480e-b0ae-a5e1040151ac service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.747470 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:01.792461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.793394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.793693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.793989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.796020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.798049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.852274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3134/6216] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:01 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:01.853537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.870190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701eb18-17fd-45e7-bb9b-a5ae4483bb98 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.885087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.886156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.886447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.889830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.890707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.899161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.905446 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:01.923335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3083/6217] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:01.927259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:01.941049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96622a6-f557-4357-ac01-cb8f88190aab admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:01.947172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:01.947856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:01.950628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:01.950963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:01.952660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:01.954337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a497f-681a-4710-9f64-fcf48502f417 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:01.991001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3135/6218] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:01.995449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:02.012078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347951-e873-4f31-8441-69dc574f5c1f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:02.023242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:02.025189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:02.027501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:02.028635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] PATH_INFO: `/v3/projects/9dbf1905e76a4b4cafcf952a1ad55dc6/users/b00542fdb9aa4093bd57591b171f50ca/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:02.069205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbf1905e76a4b4cafcf952a1ad55dc6, user_id=b00542fdb9aa4093bd57591b171f50ca, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:02.072437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90476a-84b7-4e26-a7de-cfa70839e989 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:02.121903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3084/6219] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:01 2022] PUT /identity/v3/projects/9dbf1905e76a4b4cafcf952a1ad55dc6/users/b00542fdb9aa4093bd57591b171f50ca/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:02.135866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:02.136291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:02.136491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:02.189323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] MFA Rules not processed for user `b00542fdb9aa4093bd57591b171f50ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:02.191406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:02.319935 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3136/6220] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:02.332871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:02.332871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:02.333341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:02.378311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] MFA Rules not processed for user `b00542fdb9aa4093bd57591b171f50ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:02.378517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:02.405046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3085/6221] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:02.412046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:02.413472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:02.569787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f6636-016f-426a-8418-080cbe31db01 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:02.578400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:02.579223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:02.579555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:02.579829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:02.589176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:02.591055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958049-ccc0-4ea4-8c09-a9ccbbf21e1d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:02.606207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3137/6222] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:04.677208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:04.834712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2b4b-5090-4204-b1a3-d4666ba0b975 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:04.839654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:04.840873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:04.841238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:04.842679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] PATH_INFO: `/v3/users/2475d4107ece492d83f7a48fc262bc55` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:04.844145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2475d4107ece492d83f7a48fc262bc55)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:04.846924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:04.963006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2475d4107ece492d83f7a48fc262bc55'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:04.976605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2475d4107ece492d83f7a48fc262bc55'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:04.988550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2475d4107ece492d83f7a48fc262bc55'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.028061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2475d4107ece492d83f7a48fc262bc55'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.028935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2475d4107ece492d83f7a48fc262bc55'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.037724 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3086/6223] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:04 2022] DELETE /identity/v3/users/2475d4107ece492d83f7a48fc262bc55 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:05.040969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:05.041415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:05.041492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:05.074046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:05.075135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:05.150760 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:05.191829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3138/6224] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:05.202958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:05.204862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:05.294737 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:05.304140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44493a9-6305-4c9c-a656-43310af4ddd9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:05.322683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:05.323500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:05.324573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:05.328183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:05.344742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:05.346577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:05.361494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3087/6225] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:05.764598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:05.766405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:05.787282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff42f-7cb0-469b-9551-6a6c6b48e9b6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:05.800661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:05.804327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:05.805562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:05.806233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] PATH_INFO: `/v3/projects/49fcf40bdce64185aec79a79ac9f1612` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:05.808041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fcf40bdce64185aec79a79ac9f1612)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:05.815898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:05.944437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fcf40bdce64185aec79a79ac9f1612', 'request_id': 'req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.965623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fcf40bdce64185aec79a79ac9f1612', 'request_id': 'req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.977354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fcf40bdce64185aec79a79ac9f1612', 'request_id': 'req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.993601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] The token cache is being invalidate because project 49fcf40bdce64185aec79a79ac9f1612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:05.994016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:05.994904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.000629 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3139/6226] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:05 2022] DELETE /identity/v3/projects/49fcf40bdce64185aec79a79ac9f1612 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:06.001761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:06.021042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96353573-0737-4ed9-8ffb-f3e6ede5e559 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:06.134293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:06.137275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:06.137479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:06.139368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] PATH_INFO: `/v3/users/57aae10ab09648ad86a0248b6ccef9d2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:06.143102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57aae10ab09648ad86a0248b6ccef9d2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:06.145149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:06.246898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57aae10ab09648ad86a0248b6ccef9d2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.266265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57aae10ab09648ad86a0248b6ccef9d2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.301972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57aae10ab09648ad86a0248b6ccef9d2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.332403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57aae10ab09648ad86a0248b6ccef9d2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.333154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76f9f829-6917-473d-9d92-a7ec04c68906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57aae10ab09648ad86a0248b6ccef9d2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:06.364960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3088/6227] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:06 2022] DELETE /identity/v3/users/57aae10ab09648ad86a0248b6ccef9d2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:06.883790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:06.885629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:06.910107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcaf4d-7aa8-4fc5-af2e-e579d39cecdc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.011252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.012625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.013157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.014211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] PATH_INFO: `/v3/projects/4385247b47b74f39a6db6db2a4c56a32` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.015636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4385247b47b74f39a6db6db2a4c56a32)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.018047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:07.124366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4385247b47b74f39a6db6db2a4c56a32', 'request_id': 'req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:07.139828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4385247b47b74f39a6db6db2a4c56a32', 'request_id': 'req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:07.143424 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:07.159136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4385247b47b74f39a6db6db2a4c56a32', 'request_id': 'req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:07.181541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] The token cache is being invalidate because project 4385247b47b74f39a6db6db2a4c56a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:07.181922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:07.184392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7c3cac6b-c6f8-4e7b-9dde-a65cde80bbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:07.188803 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3140/6228] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:06 2022] DELETE /identity/v3/projects/4385247b47b74f39a6db6db2a4c56a32 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:07.194609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.195222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.195222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.229109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:07.230375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:07.373346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.373644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.373898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.375276 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3089/6229] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:07.418009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:07.419328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:07.441703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3141/6230] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:07.447457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:07.460337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83255a-9643-481b-a60e-622078f501e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.466138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.467959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.468947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.469374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.470332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:07.470783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.474027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:07.477728 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:07.502087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:07.502749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3090/6231] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:07.523164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757eb0f-a6e3-4bb4-9464-ec5f7ef21c4c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.536708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.537411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.537718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.538002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.538724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.540671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:07.594069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3142/6232] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:07 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:38:07.596094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:07.612823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb996-fb8b-4e3f-b84a-bfdbc4fa9a10 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.813417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.816999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.818513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.836067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.842590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.845417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:07.885757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3091/6233] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:07 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:07.890760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:07.906489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87e268-87ec-4759-abfd-7d4a3ce3b82c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.921070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.921712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.922001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.922342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.923108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.924766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:07.950840 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3143/6234] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:07.956863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:07.968145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c19eb-6200-4995-9236-825cd425bd33 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:07.979647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:07.980125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:07.980559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:07.980840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:07.982992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:07.986696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13e878-edb9-4b9e-96b0-53b0e86e162f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:08.020006 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3092/6235] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:38:08.020689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:08.032047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da430035-95d6-4ab4-ac7b-91c7ade08ded admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:08.051773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:08.052906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:08.053200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:08.053479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] PATH_INFO: `/v3/projects/a4cf7555007d46e19da0e24acb342678/users/afc677d2351042b8ab3d3f7e1e92e376/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:08.090223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4cf7555007d46e19da0e24acb342678, user_id=afc677d2351042b8ab3d3f7e1e92e376, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:08.093517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:08.116238 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3144/6236] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:08 2022] PUT /identity/v3/projects/a4cf7555007d46e19da0e24acb342678/users/afc677d2351042b8ab3d3f7e1e92e376/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:08.136259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:08.136542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:08.136923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:08.231502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] MFA Rules not processed for user `afc677d2351042b8ab3d3f7e1e92e376`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:08.237976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:08.450816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3093/6237] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:08.451004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:08.558709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a39af2-760d-4153-9d62-8b059ad67d8b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:08.573851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:08.575217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:08.584902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:08.585498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:08.586409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:08.588899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:08.643075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:08.666288 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3145/6238] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:08 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:08.690780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d2a7-b5cf-4d73-b636-d92f04bc4e7d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:08.899727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:08.903412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:08.903959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:08.906046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:08.909743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:08.914488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:08.928562 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:08.963472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3094/6239] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:08 2022] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:08.965178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:08.987279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f8d7-d75c-47ac-8114-dc90a26a73fc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:08.997361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:08.999077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.005160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.005811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.007531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:09.009462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:09.059967 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3146/6240] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:09.062074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:09.079071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f270-0133-406a-b79f-67c37d38c4ed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:09.097580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:09.098870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.099767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.101912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] PATH_INFO: `/v3/projects/67d3308dc4e14351a64de764a63b0f3c/users/0db632b7c9dc43ffba0a3fa928c8140a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.162858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d3308dc4e14351a64de764a63b0f3c, user_id=0db632b7c9dc43ffba0a3fa928c8140a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:09.165977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:09.196114 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3095/6241] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:09 2022] PUT /identity/v3/projects/67d3308dc4e14351a64de764a63b0f3c/users/0db632b7c9dc43ffba0a3fa928c8140a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:09.200098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:09.211977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187574-c874-4620-bb29-d24e31b9fe7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:09.339366 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:09.355914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:09.358103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.358394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.358633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.359380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:09.361161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ad0cf-dd03-45bd-89c4-eaceda5ca234 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:09.392203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:09.412168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3147/6242] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:09.415427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2a6-f7a7-4949-ab63-ea9cf5ddb4e3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:09.424933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:09.425883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.426444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.426444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] PATH_INFO: `/v3/projects/67d3308dc4e14351a64de764a63b0f3c/users/0db632b7c9dc43ffba0a3fa928c8140a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.434501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d3308dc4e14351a64de764a63b0f3c, user_id=0db632b7c9dc43ffba0a3fa928c8140a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:09.439765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:09.486980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.487316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.487603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.489435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3096/6243] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:09 2022] PUT /identity/v3/projects/67d3308dc4e14351a64de764a63b0f3c/users/0db632b7c9dc43ffba0a3fa928c8140a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:09.516844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] MFA Rules not processed for user `0db632b7c9dc43ffba0a3fa928c8140a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:09.518344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:09.660695 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3148/6244] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:09.681431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:09.685872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:09.846095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545201b-01b4-46e7-9a64-ae0a3b766f20 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:09.850489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:09.851162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:09.851444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:09.851717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:09.978159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:09.979453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:10.024228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3097/6245] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:12.911970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:12.930675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a475-e7d7-475b-a8a1-852e1d6cc8a3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:12.948355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:12.949161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:12.949430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:12.949738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:12.965117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:12.966689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7a78-e4ed-4fc6-b4d2-7f9e2b6c0909 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:12.979704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3149/6246] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:38:14.557573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:14.559036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:14.749530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418c7b-0f1e-4d9d-96cb-ae51f78491e8 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:14.772635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:14.781274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:14.782352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:14.783695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] PATH_INFO: `/v3/users/c29445985912408f81a8730ebaaa9b8b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:14.790264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29445985912408f81a8730ebaaa9b8b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:14.798423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:14.853217 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:14.968516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29445985912408f81a8730ebaaa9b8b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:14.992152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29445985912408f81a8730ebaaa9b8b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:15.024264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29445985912408f81a8730ebaaa9b8b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:15.068395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29445985912408f81a8730ebaaa9b8b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:15.070030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29445985912408f81a8730ebaaa9b8b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:15.094879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3098/6247] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:14 2022] DELETE /identity/v3/users/c29445985912408f81a8730ebaaa9b8b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:15.099696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:15.100719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:15.101176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:15.162526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:15.163900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:15.344758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3150/6248] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:15.355288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:15.358355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:15.461915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ffa1e-3a6c-4059-89dd-360874408988 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:15.465904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:15.467210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:15.467561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:15.467901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:15.488256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:15.490539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:15.540906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3099/6249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:15.687593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:15.691802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:15.896983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecaf92-ef59-4a82-a301-bad7f441395e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:15.912367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:15.913306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:15.913683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:15.914044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:15.919445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:15.933279 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:16.026962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:16.049192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:16.070023 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3151/6250] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:38:16.083002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:16.085153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:16.173148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cbe73-8b87-43ec-a5fc-f5c9ae58ebdc service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:16.199674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:16.201380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.201842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.202358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] PATH_INFO: `/v3/projects/7ea051af498c4a9c9970f51f662ca7ed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.208244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea051af498c4a9c9970f51f662ca7ed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:16.209920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:16.214755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:16.239467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8981-7c77-4789-9b65-98d518507d97 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:16.254124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:16.277235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.277535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.277861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.297165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:16.435854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea051af498c4a9c9970f51f662ca7ed', 'request_id': 'req-6ab90420-4490-4412-b71e-e1be928d58ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:16.455197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea051af498c4a9c9970f51f662ca7ed', 'request_id': 'req-6ab90420-4490-4412-b71e-e1be928d58ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:16.470916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea051af498c4a9c9970f51f662ca7ed', 'request_id': 'req-6ab90420-4490-4412-b71e-e1be928d58ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:16.498037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] The token cache is being invalidate because project 7ea051af498c4a9c9970f51f662ca7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:16.500102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:16.500942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab90420-4490-4412-b71e-e1be928d58ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:16.507648 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3100/6251] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:16 2022] DELETE /identity/v3/projects/7ea051af498c4a9c9970f51f662ca7ed => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:16.510205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.510496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.510774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.568374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:16.569615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:16.595071 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:16.665917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:16.667732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf5b5-eb0c-4ca8-83bd-8743815e83a3 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:16.720233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3152/6252] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:16.733819 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3101/6253] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:16.740234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe509-9288-4649-82d3-4061448b2ba8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.743059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe509-9288-4649-82d3-4061448b2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.747124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe509-9288-4649-82d3-4061448b2ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.841356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8affe509-9288-4649-82d3-4061448b2ba8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:16.843501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8affe509-9288-4649-82d3-4061448b2ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:16.881002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3153/6254] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:16.882537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:16.914921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d12e9-68d5-47ca-b6ae-101d8a49c629 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:16.925247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:16.925988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.934257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.934760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.962342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:16.964075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:16.971477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:16.984418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:16.985123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:16.985550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:16.993659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3102/6255] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:16.994558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.008281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a529-fcfb-458e-9130-8eb23a2328fc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.016331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.017274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.017571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.017920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.018684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.021916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.026538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:17.028006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:17.075124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3103/6256] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:16 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:17.079329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.221054 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3154/6257] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:17.278562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa7326-53f7-4355-9378-816d788732d7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.297453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.298675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:17.304535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.308771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.308931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.309164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.312239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.320081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.370469 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3104/6258] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:17 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:17.372288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.379452 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:17.418608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cacd3-7cc7-45f9-8ad7-4c97c8bbfbf3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.426778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.427748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.428070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.428422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.429285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.432044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.448995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3105/6259] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:17.450302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.463822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b554-3697-4a28-9a75-2b03a2867bce admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.469987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.471608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.474059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.474585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.475703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.477605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.480600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9591dd-e9c7-47ad-8304-96d541819f65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.495545 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3106/6260] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:17.498348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.512576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401202c-ab7e-4aa9-8d4b-fa41e1773710 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:17.519194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.520343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.520833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.521187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] PATH_INFO: `/v3/projects/bfb7452687b04c969b093c19ca262e24/users/13101a16293d42e3b9cb95968d1a4a17/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.572023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb7452687b04c969b093c19ca262e24, user_id=13101a16293d42e3b9cb95968d1a4a17, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.579501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464957-0d85-4738-9e4e-b4082ce43ed6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.620909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3107/6261] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:17 2022] PUT /identity/v3/projects/bfb7452687b04c969b093c19ca262e24/users/13101a16293d42e3b9cb95968d1a4a17/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:17.627217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.627614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.627990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.675800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:17.679086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:17.683005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:17.683743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:17.684032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:17.684318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:17.715547 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:17.809204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:17.811325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:17.813087 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3108/6262] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:17.824501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:17.828160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:17.839895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3155/6263] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:38:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:38:18.038005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76dfbf-29b7-47b4-82f0-aa17be17f449 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:18.044600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:18.045559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:18.045940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:18.046285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:18.086956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:18.089443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:18.113379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3109/6264] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:21.900884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:21.903309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:22.141806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4004d8-234e-4b03-8e59-e5fe5945eec9 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:22.156668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:22.157959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:22.159073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:22.159547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:22.166687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:22.216693 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:22.367933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:22.379329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a42b29-0143-41b4-9154-37bbc25edf54 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:22.429754 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3156/6265] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:28.106261 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=42 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:29.023080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:29.024210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:29.077059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12f1de-6a79-4a1b-91be-1824d53097c4 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:29.128511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:29.129520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:29.133393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:29.133393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] PATH_INFO: `/v3/users/afc677d2351042b8ab3d3f7e1e92e376` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:29.142741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc677d2351042b8ab3d3f7e1e92e376)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:29.145196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:29.298181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc677d2351042b8ab3d3f7e1e92e376'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:29.320550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc677d2351042b8ab3d3f7e1e92e376'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:29.338532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc677d2351042b8ab3d3f7e1e92e376'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:29.389786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc677d2351042b8ab3d3f7e1e92e376'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:29.390543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc677d2351042b8ab3d3f7e1e92e376'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:29.421219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3110/6266] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:29 2022] DELETE /identity/v3/users/afc677d2351042b8ab3d3f7e1e92e376 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:29.426004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:29.426409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:29.426515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:29.476770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:29.480535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:29.730041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3157/6267] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:29.738918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:29.740431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:29.912328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9082-6c76-4be6-8749-7a66db0516ed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:29.922217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:29.923443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:29.923925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:29.924300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:29.959824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:29.961402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:29.998521 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3111/6268] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:38:31.361182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:31.363062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:31.402601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1826914-65bf-486c-afec-cdb1b18e8411 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:31.419459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:31.420864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:31.421476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:31.423445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] PATH_INFO: `/v3/projects/a4cf7555007d46e19da0e24acb342678` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:31.425961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4cf7555007d46e19da0e24acb342678)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:31.427946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:31.626426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4cf7555007d46e19da0e24acb342678', 'request_id': 'req-3c0abedd-310d-4f13-842a-f02166fd43b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:31.657820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4cf7555007d46e19da0e24acb342678', 'request_id': 'req-3c0abedd-310d-4f13-842a-f02166fd43b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:31.678940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4cf7555007d46e19da0e24acb342678', 'request_id': 'req-3c0abedd-310d-4f13-842a-f02166fd43b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:31.708267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] The token cache is being invalidate because project a4cf7555007d46e19da0e24acb342678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:31.708579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:31.710731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:31.717521 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3158/6269] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:31 2022] DELETE /identity/v3/projects/a4cf7555007d46e19da0e24acb342678 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:31.718830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:31.735597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea742d-24fc-43e6-b47c-a5c9cd863747 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:32.066186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:32.072209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:32.072511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:32.072782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] PATH_INFO: `/v3/users/0db632b7c9dc43ffba0a3fa928c8140a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:32.083069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db632b7c9dc43ffba0a3fa928c8140a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:32.085099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:32.188306 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:32.385278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db632b7c9dc43ffba0a3fa928c8140a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:32.417955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db632b7c9dc43ffba0a3fa928c8140a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:32.456560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db632b7c9dc43ffba0a3fa928c8140a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:32.544195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db632b7c9dc43ffba0a3fa928c8140a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:32.544195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ae6861fc-34dc-47aa-ac08-566bcd69cd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db632b7c9dc43ffba0a3fa928c8140a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:32.547112 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3112/6270] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:31 2022] DELETE /identity/v3/users/0db632b7c9dc43ffba0a3fa928c8140a => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:34.854070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:34.855230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:34.896005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0abedd-310d-4f13-842a-f02166fd43b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:35.127402 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:35.184067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:35.185043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:35.185383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:35.185609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] PATH_INFO: `/v3/projects/67d3308dc4e14351a64de764a63b0f3c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:35.191236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d3308dc4e14351a64de764a63b0f3c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:35.196604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:35.378784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d3308dc4e14351a64de764a63b0f3c', 'request_id': 'req-4c0dabd0-694e-4ccf-84f9-db52f06f8782'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:35.402887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d3308dc4e14351a64de764a63b0f3c', 'request_id': 'req-4c0dabd0-694e-4ccf-84f9-db52f06f8782'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:35.418489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d3308dc4e14351a64de764a63b0f3c', 'request_id': 'req-4c0dabd0-694e-4ccf-84f9-db52f06f8782'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:35.461895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] The token cache is being invalidate because project 67d3308dc4e14351a64de764a63b0f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:35.462196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:35.472567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c0dabd0-694e-4ccf-84f9-db52f06f8782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:35.478364 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3159/6271] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:34 2022] DELETE /identity/v3/projects/67d3308dc4e14351a64de764a63b0f3c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:35.482165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:35.482645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:35.482774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:35.526421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:35.531764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:35.710153 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3113/6272] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:35.718364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:35.719749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:35.720123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:35.818784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:35.822309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:35.874169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:35.883487 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3160/6273] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:35.890999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1653cf-6ef8-46df-a9be-d120dfbed3b9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:35.917603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:35.918689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:35.923778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:35.924304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:35.925251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:35.930773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:35.948197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.000295 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3114/6274] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:36.004173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.036689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af732-2273-42f4-a78f-1a8b76eb9055 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.088605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.089311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.089603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.096105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.097158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.098967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.328862 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3161/6275] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:36 2022] POST /identity/v3/projects => generated 381 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:36.333286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.357972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d79e0-e4e0-4a40-a0b4-506729fb194b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.496919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.498111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.498651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.499035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.499854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.501990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.535513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3115/6276] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:36 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:36.536809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.555494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3545-46aa-4553-875c-d918c847f213 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.567516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.569984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.570580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.571336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.572366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.578324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.581990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.587087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:36.637000 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:36.640042 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3162/6277] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:36.653886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.684440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaec4d-6280-4eb1-988a-d7e590af50c1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.700641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.702444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.704559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.706067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.707559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.711097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.759523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3163/6278] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:36.762262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:36.808931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7f0a0-694e-454d-a475-7c64782a2f44 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.823181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63f9bf-a296-4cd3-b4b9-09c4b8a3fc2f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:36.828334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.832557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.834951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.836539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] PATH_INFO: `/v3/projects/0a6c2f69897e449185c18b58a50472c5/users/c6d1957cc9f740289556a56536115144/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.837397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:36.840023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.842720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.843097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:36.850416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:36.913580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6c2f69897e449185c18b58a50472c5, user_id=c6d1957cc9f740289556a56536115144, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.919051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:36.922512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aa36c-99fa-4783-ae38-641b039bf56b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.924506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e496e55-d685-4ddb-a72b-c40e487636de admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:36.956093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3164/6279] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:36 2022] PUT /identity/v3/projects/0a6c2f69897e449185c18b58a50472c5/users/c6d1957cc9f740289556a56536115144/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:36.956943 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3116/6280] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:36.973470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:36.974815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:36.976656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:37.099222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:37.099507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:37.099784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:37.110015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] MFA Rules not processed for user `c6d1957cc9f740289556a56536115144`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:37.111321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:37.181551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] MFA Rules not processed for user `13101a16293d42e3b9cb95968d1a4a17`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:37.187249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:37.281287 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:37.383474 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3165/6281] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:37.384639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:37.429115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3117/6282] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:37.430975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:37.432491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:37.517945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7953a11-f3c6-4827-af7a-fcac236ddd2f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:37.525204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:37.526849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:37.527295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:37.527776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:37.529579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:37.532151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:37.574624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994d4c2-ab0b-4502-87f6-de7c4e5bc14d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:37.582496 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3166/6283] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:37.586444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:37.586444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:37.586444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:37.586444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:37.586857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:37.588490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:37.589236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:37.659034 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3118/6284] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:37 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:37.661711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:37.795816 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:37.876353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064600a1-87fc-48ac-ba17-2214204560c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.021800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723e6a-6033-4a38-821c-aefb6fdf0ae7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.054295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.055784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.056229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.056696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.057569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.060523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.064932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.072204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.072709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.074675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.076338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.085615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.134794 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:38.145420 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3167/6285] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:37 2022] POST /identity/v3/users => generated 298 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:38.146213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.164200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3f1c-9b65-4257-80f9-d4adc784b777 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.185611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.186328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.186615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.186899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.187976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.189584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.215875 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3168/6286] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:38.216787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.224338 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3119/6287] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:37 2022] POST /identity/v3/users => generated 297 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:38.225447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.241547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e52d5-ec97-4a76-af59-139a5849ede2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.259152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.259873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.260161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.260442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.261192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.263973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.284807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb819-8fd5-49be-8b9c-79ad31d640dd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.291085 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3169/6288] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:38.295384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.310756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.311684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.312711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.312711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] PATH_INFO: `/v3/projects/a54443acd478400eb597ad7ca484c8d1/users/5b9ffe54dda6479dbd42ce5fcc2682c5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.330455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d218713-7aa3-4c69-ae4e-475ce4ea3cf5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.347353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.349943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.349943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.349943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] PATH_INFO: `/v3/projects/05cb5260170e48e1b6117a51f6c7897d/users/d3bf816a329942a8a4f1e0d65b90eb36/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.352047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54443acd478400eb597ad7ca484c8d1, user_id=5b9ffe54dda6479dbd42ce5fcc2682c5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.354173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.386365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3120/6289] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:38 2022] PUT /identity/v3/projects/a54443acd478400eb597ad7ca484c8d1/users/5b9ffe54dda6479dbd42ce5fcc2682c5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:38.388073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.446287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cb5260170e48e1b6117a51f6c7897d, user_id=d3bf816a329942a8a4f1e0d65b90eb36, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.449635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.503881 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3170/6290] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:38 2022] PUT /identity/v3/projects/05cb5260170e48e1b6117a51f6c7897d/users/d3bf816a329942a8a4f1e0d65b90eb36/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:38.508742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.545137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabaee-9b67-4f26-930b-335048650d30 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.686669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbf5bb-93fa-4004-8182-85e9ab0bf3cb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.698570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.699515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.700026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.700473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.701376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.703228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.741436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3171/6291] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:38.756088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.795133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.796351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.796835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.797163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb6f8-a4f9-4649-86c2-4fc2741b868d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:38.797282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.808794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.810548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.820318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:38.821517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:38.821998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:38.822430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] PATH_INFO: `/v3/projects/05cb5260170e48e1b6117a51f6c7897d/users/d3bf816a329942a8a4f1e0d65b90eb36/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:38.830234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3121/6292] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:38.831436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cb5260170e48e1b6117a51f6c7897d, user_id=d3bf816a329942a8a4f1e0d65b90eb36, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:38.835005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:38.838550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25c078-06b2-4229-aad6-5090c97c17d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:38.869121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3172/6293] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:38 2022] PUT /identity/v3/projects/05cb5260170e48e1b6117a51f6c7897d/users/d3bf816a329942a8a4f1e0d65b90eb36/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:38.873242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a51f4-4f55-41a5-bf00-83c35a2c5639 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:39.053102 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:39.235639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:39.236588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:39.236878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:39.237178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] PATH_INFO: `/v3/projects/a54443acd478400eb597ad7ca484c8d1/users/5b9ffe54dda6479dbd42ce5fcc2682c5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:39.243442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54443acd478400eb597ad7ca484c8d1, user_id=5b9ffe54dda6479dbd42ce5fcc2682c5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:39.255850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:39.293308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3122/6294] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:38 2022] PUT /identity/v3/projects/a54443acd478400eb597ad7ca484c8d1/users/5b9ffe54dda6479dbd42ce5fcc2682c5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:39.304313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:39.304873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:39.304873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:39.384433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] MFA Rules not processed for user `5b9ffe54dda6479dbd42ce5fcc2682c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:39.392565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:39.569837 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3173/6295] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:39.594639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:39.596545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:39.766225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404bf25-9565-4979-82ce-c48bc2277494 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:39.788119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:39.788811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:39.789059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:39.789460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:39.847561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:39.862057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:39.909282 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3123/6296] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:40.067438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:40.069363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:40.101119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfddfc8-109b-4d77-bf17-44a7d525e328 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:40.112248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:40.113253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:40.136837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:40.137339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:40.194171 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:40.307135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:40.308784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca854-7b3c-45f1-806f-4f2c1345cc71 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:40.332287 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3174/6297] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:40.944225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:41.207753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44a04c-33ab-4826-a9ae-7773886fa733 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:41.225921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:41.230112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:41.233821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:41.234288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] PATH_INFO: `/v3/users/c6d1957cc9f740289556a56536115144` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:41.239964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d1957cc9f740289556a56536115144)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:41.245606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:41.398462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d1957cc9f740289556a56536115144'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:41.431958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d1957cc9f740289556a56536115144'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:41.446512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d1957cc9f740289556a56536115144'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:41.482517 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:41.509927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d1957cc9f740289556a56536115144'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:41.527523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d1957cc9f740289556a56536115144'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:41.571186 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3124/6298] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:40 2022] DELETE /identity/v3/users/c6d1957cc9f740289556a56536115144 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:41.586676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899a49-0593-44d6-8eae-e80198cd3e7f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:41.587200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899a49-0593-44d6-8eae-e80198cd3e7f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:41.587200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899a49-0593-44d6-8eae-e80198cd3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:41.657500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ea899a49-0593-44d6-8eae-e80198cd3e7f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:41.658783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ea899a49-0593-44d6-8eae-e80198cd3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:41.870858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3175/6299] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:41.902530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:41.904811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:42.088876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8e06-f36e-4aab-8112-c62fcb1e9507 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:42.112295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:42.113168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:42.113606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:42.114560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:42.148747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:42.151877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:42.189354 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3125/6300] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:42.319391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:42.320164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:42.320661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:42.363243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] MFA Rules not processed for user `545a39e3583b41b1b9ba0cf41507754f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:42.365168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:42.432789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:42.435932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:42.503389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a764e-eada-4931-8110-2c10a94e1219 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:42.531310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:42.531510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:42.531765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:42.532416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:42.534175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3176/6301] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:42.539786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:42.567615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:42.572687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:42.608040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3126/6302] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:38:46.153449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:46.163013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:46.211807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146b430-df09-4317-82dc-9938651e0eb0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:46.233809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:46.234687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:46.234975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:46.239185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] PATH_INFO: `/v3/projects/0a6c2f69897e449185c18b58a50472c5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:46.240891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6c2f69897e449185c18b58a50472c5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:46.245990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:46.555868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6c2f69897e449185c18b58a50472c5', 'request_id': 'req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:46.601518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6c2f69897e449185c18b58a50472c5', 'request_id': 'req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:46.607781 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:46.625972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6c2f69897e449185c18b58a50472c5', 'request_id': 'req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:46.700692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] The token cache is being invalidate because project 0a6c2f69897e449185c18b58a50472c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:46.700997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:46.716339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:46.727029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3177/6303] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:46 2022] DELETE /identity/v3/projects/0a6c2f69897e449185c18b58a50472c5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:46.731544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:46.762463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094965-9688-428a-bb28-30078906bf0d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:47.028654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:47.029972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:47.030367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:47.030749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] PATH_INFO: `/v3/users/5b9ffe54dda6479dbd42ce5fcc2682c5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:47.034437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9ffe54dda6479dbd42ce5fcc2682c5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:47.037893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:47.285992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9ffe54dda6479dbd42ce5fcc2682c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:47.322905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9ffe54dda6479dbd42ce5fcc2682c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:47.344838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9ffe54dda6479dbd42ce5fcc2682c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:47.373317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9ffe54dda6479dbd42ce5fcc2682c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:47.374617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d68bcadd-31c7-46e9-bf46-ddab8a3391ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9ffe54dda6479dbd42ce5fcc2682c5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:47.393099 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3127/6304] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:46 2022] DELETE /identity/v3/users/5b9ffe54dda6479dbd42ce5fcc2682c5 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:49.930024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:49.933175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:49.960617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef71ef-4d17-4ce1-aedf-8c998b647bf8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:50.298862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:50.299767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:50.300064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:50.300325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] PATH_INFO: `/v3/projects/a54443acd478400eb597ad7ca484c8d1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:50.308244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54443acd478400eb597ad7ca484c8d1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:50.310084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:50.533291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54443acd478400eb597ad7ca484c8d1', 'request_id': 'req-7cf3abbc-cb8c-4202-bb76-28e08e67781c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:50.550790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54443acd478400eb597ad7ca484c8d1', 'request_id': 'req-7cf3abbc-cb8c-4202-bb76-28e08e67781c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:50.623528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54443acd478400eb597ad7ca484c8d1', 'request_id': 'req-7cf3abbc-cb8c-4202-bb76-28e08e67781c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:50.667040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] The token cache is being invalidate because project a54443acd478400eb597ad7ca484c8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:50.668920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:50.681538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7cf3abbc-cb8c-4202-bb76-28e08e67781c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:50.691122 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3178/6305] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:49 2022] DELETE /identity/v3/projects/a54443acd478400eb597ad7ca484c8d1 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:50.696696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:50.697563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:50.697563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:50.705833 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:50.768020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:50.769359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:51.006454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3128/6306] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:51.014934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:51.015820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:51.016252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:51.048863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:51.050527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:51.060699 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3179/6307] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:51.064563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:51.083430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37979-51ad-4baa-8102-c24fddcbf951 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:51.112940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:51.118133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:51.118674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:51.125106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:51.128073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:51.128584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:51.134711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:51.210130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:51.225525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57f524-ec03-4f02-aea1-d1149b4c6d27 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:51.227093 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3129/6308] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:51.254275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:51.254965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:51.255246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:51.259570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:51.260415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:51.275985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:51.342932 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3180/6309] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:51 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:38:51.344108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:51.366833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d289-e03b-4050-91d3-a5176ebd1917 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:51.750872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:51.754421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:51.756989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:51.758744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:51.771775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:51.778064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:51.861488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:51.868432 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3130/6310] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:51 2022] POST /identity/v3/users => generated 293 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:38:51.879215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ee25b-abde-4678-a2e3-bd9c8b6663fb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:51.906404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:51.907275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:51.907555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:51.913149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:51.914188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:51.917524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:51.965929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:51.982519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3181/6311] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:51.988846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa0a1-d082-4040-8923-83a7664a8fc2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:52.006404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:52.007154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.010656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.010995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.012344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:52.014064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cbbcb-531a-48a3-a187-e99e62d35a66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:52.048754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:52.055093 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3131/6312] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:52.061154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4e71d-59ce-4f38-9f66-e043ae20a041 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:52.078407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:52.079620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.080076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.080518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] PATH_INFO: `/v3/projects/3b6d75e392b04f8e9520b50663a5e6c3/users/071710669a8c48fbb94463bbd5f4e9c2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.123704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6d75e392b04f8e9520b50663a5e6c3, user_id=071710669a8c48fbb94463bbd5f4e9c2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:52.127185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:52.182847 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3182/6313] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:52 2022] PUT /identity/v3/projects/3b6d75e392b04f8e9520b50663a5e6c3/users/071710669a8c48fbb94463bbd5f4e9c2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:52.184824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.185526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.186001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.238503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] MFA Rules not processed for user `071710669a8c48fbb94463bbd5f4e9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:52.239932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:52.372280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:52.374628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:52.402927 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:52.419718 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:52.420806 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3132/6314] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:52.435213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:52.442158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:52.578888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f2f52-f241-4a47-9f98-8c045c4a2ded admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:52.593021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:52.597074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.597432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.598730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] PATH_INFO: `/v3/users/b00542fdb9aa4093bd57591b171f50ca` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.603215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb268b2-f114-4b3a-a6e9-b8757be2c87f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:52.604494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00542fdb9aa4093bd57591b171f50ca)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:52.609374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:52.613589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:52.614560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.615297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.615667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.655343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:52.657019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79b31-3a3f-41cc-a05e-93c60f569c1c service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:52.723162 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3133/6315] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:52.726519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00542fdb9aa4093bd57591b171f50ca'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:52.728316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00542fdb9aa4093bd57591b171f50ca'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:52.765842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00542fdb9aa4093bd57591b171f50ca'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:52.792849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00542fdb9aa4093bd57591b171f50ca'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:52.832956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00542fdb9aa4093bd57591b171f50ca'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:52.854676 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3183/6316] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:52 2022] DELETE /identity/v3/users/b00542fdb9aa4093bd57591b171f50ca => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:52.857701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:52.858627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:52.859147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:52.888630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:52.899642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:53.083508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3134/6317] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:53.155541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:53.157891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:53.250864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d60cd-254b-425e-af11-a48da0be9123 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:53.256233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:53.257284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:53.257849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:53.258429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:53.273924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:53.275594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:53.317292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3184/6318] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:54.243361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:54.249376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:54.276448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd6247-2900-46ab-9a5e-330ee5f6c13c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:54.292842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:54.295055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:54.295645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:54.296103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] PATH_INFO: `/v3/users/81dad264129d487c88fb39d9356550b1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:54.300486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dad264129d487c88fb39d9356550b1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:54.303240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:54.530700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dad264129d487c88fb39d9356550b1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:54.563243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dad264129d487c88fb39d9356550b1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:54.588733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dad264129d487c88fb39d9356550b1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:54.622531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dad264129d487c88fb39d9356550b1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:54.623488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dad264129d487c88fb39d9356550b1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:54.642268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3135/6319] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:38:54 2022] DELETE /identity/v3/users/81dad264129d487c88fb39d9356550b1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:54.990359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:54.991992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:55.098804 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:55.177047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dae4d-42c5-4e75-b42f-641e3e009fa1 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:55.244874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:55.247097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:55.270716 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:55.388791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:55.390270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:55.390557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:55.392472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:55.396356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:55.457337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f4d77-cebb-442d-a6dc-021626562db3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:55.473511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:55.476535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:55.476834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:55.477118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] PATH_INFO: `/v3/projects/9dbf1905e76a4b4cafcf952a1ad55dc6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:55.481314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbf1905e76a4b4cafcf952a1ad55dc6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:55.490089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:55.562437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:55.578647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173804de-c06d-4c44-8423-25606ff31684 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:55.611243 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3185/6320] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:55.629695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'request_id': 'req-410a9fdd-1e84-45c9-9bfe-212dccec052d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:55.644886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'request_id': 'req-410a9fdd-1e84-45c9-9bfe-212dccec052d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:55.659645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbf1905e76a4b4cafcf952a1ad55dc6', 'request_id': 'req-410a9fdd-1e84-45c9-9bfe-212dccec052d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:55.678721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] The token cache is being invalidate because project 9dbf1905e76a4b4cafcf952a1ad55dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:55.679065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:55.680475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-410a9fdd-1e84-45c9-9bfe-212dccec052d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:55.684815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3136/6321] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:55 2022] DELETE /identity/v3/projects/9dbf1905e76a4b4cafcf952a1ad55dc6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:55.686955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:55.687942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:55.696323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:55.742514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:55.743762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:56.038801 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3186/6322] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:56.045249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.045541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.045884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.080968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:56.082246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:56.099160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3137/6323] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:38:56.103595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:56.138102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bbcd-114b-4c9c-abe9-563463d2e78e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:56.170281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:56.171250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.171701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.172134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.173159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:56.173660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:56.176294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:56.193420 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:56.212452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:56.227245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bda7e-8d14-4a9e-952f-05ecbf112707 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:56.227954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3187/6324] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:38:56.241451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:56.242580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.242580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.242822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.243452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:56.260235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:56.322387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:56.325286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:56.369095 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3138/6325] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:56 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:38:56.374642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:56.391250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e2fb-4aa3-4358-9373-96232ea18254 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:56.673696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991e13-a929-48df-90f6-31fc83debbeb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:56.675032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:56.675915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.676220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.676498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] PATH_INFO: `/v3/projects/9c2f15d0580547d2a83c6b39381873fb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.678494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2f15d0580547d2a83c6b39381873fb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:56.680313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:56.698788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:56.699523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.702074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.702689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.703602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:56.710072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:56.782388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3139/6326] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:56 2022] POST /identity/v3/users => generated 303 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:56.786814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:56.804915 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:56.806504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2f15d0580547d2a83c6b39381873fb', 'request_id': 'req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:56.811310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242ff6-01a8-4708-94cd-d004e88bed70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:56.818723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2f15d0580547d2a83c6b39381873fb', 'request_id': 'req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:56.834638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2f15d0580547d2a83c6b39381873fb', 'request_id': 'req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:56.872875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] The token cache is being invalidate because project 9c2f15d0580547d2a83c6b39381873fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:38:56.874078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:56.875210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f760bf8a-4920-4bdf-8d2a-53bcfe247e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:38:56.883820 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3188/6327] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:38:56 2022] DELETE /identity/v3/projects/9c2f15d0580547d2a83c6b39381873fb => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:56.885522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7c8d-07cf-45ca-9027-46ebf7221b18 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:56.886426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7c8d-07cf-45ca-9027-46ebf7221b18 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:56.887202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7c8d-07cf-45ca-9027-46ebf7221b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:56.953188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-27eb7c8d-07cf-45ca-9027-46ebf7221b18 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:56.956236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-27eb7c8d-07cf-45ca-9027-46ebf7221b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:57.046835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.047742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.048176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.048616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.049531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.053437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.081513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3140/6328] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:57.083029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.088399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:57.121920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddd6a6-22eb-42b5-bb30-3323fbbb91c3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.134603 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3189/6329] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:57.138563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.139499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.139943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.140371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.140871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.141167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.141448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.141783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.143565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.165586 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3141/6330] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:57.166736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.189759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898bad-5005-4a8e-84f5-d321da4459be admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.191789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:57.195303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:57.200458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.201642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.202089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.202530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] PATH_INFO: `/v3/projects/a0193195c3004cca93fa3f343b4b4f1e/users/a6cea44a68f04b52972b770230b5130a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.223727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3190/6331] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:57.227713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.238508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0193195c3004cca93fa3f343b4b4f1e, user_id=a6cea44a68f04b52972b770230b5130a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.241120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08562631-dbbc-4217-9281-9c8ba8c8a6be None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.241761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3389d54-3d93-4530-8083-25c216735b99 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.258505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.259451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.259916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.260280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.261154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:38:57.261693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.263842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.272906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3142/6332] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:57 2022] PUT /identity/v3/projects/a0193195c3004cca93fa3f343b4b4f1e/users/a6cea44a68f04b52972b770230b5130a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:38:57.278338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.278868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.279315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.298070 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3191/6333] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:38:57.299117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.323069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa861b-ae7d-4295-94c5-7c120a04e750 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.323539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:57.325336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:57.335597 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:57.486295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.487198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.487598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.487985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.488593 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3143/6334] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:57.492438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.494600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.502626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.504201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:57.583041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3192/6335] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:38:57 2022] POST /identity/v3/projects => generated 381 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:57.583898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.623151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2958e9-1c2a-44aa-8cd7-44219c203313 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.735060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2de33-3891-49cd-b716-d60df62fa7fe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.739553 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:57.751084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.751904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.752303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.752711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.753591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.763046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.801622 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3193/6336] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:38:57 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:38:57.805723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.829542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57c0f-7582-4424-a0a5-64c7d656b062 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.850589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.851347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.851963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.852085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.852969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.855187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.873999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3194/6337] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:57.878129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.901278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42803-3558-48a6-8949-4859d021c17a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.914850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.915578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.915864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.916142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.916885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.921107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.921584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.922097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.922373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.922684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:57.942344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:57.943340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3195/6338] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:38:57.946230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d8fa1-e824-426a-adaf-0680f8101aa3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:57.947072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:57.980557 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3144/6339] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:57.986459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aef90-3ac7-4d78-ace2-844fa7699b11 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:57.992909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:57.994151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:57.994771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:57.995259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] PATH_INFO: `/v3/projects/20694f1b7f424331b1ee37960c73be1d/users/345afddf00964ab392563c44803f3f8a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:58.015102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20694f1b7f424331b1ee37960c73be1d, user_id=345afddf00964ab392563c44803f3f8a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:58.018571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:58.039389 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3196/6340] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:38:57 2022] PUT /identity/v3/projects/20694f1b7f424331b1ee37960c73be1d/users/345afddf00964ab392563c44803f3f8a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:38:58.050412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f2e14-6f06-48d7-8122-235edca46577 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:58.050792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f2e14-6f06-48d7-8122-235edca46577 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:58.050967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f2e14-6f06-48d7-8122-235edca46577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:58.104323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b25f2e14-6f06-48d7-8122-235edca46577 None None] MFA Rules not processed for user `345afddf00964ab392563c44803f3f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:58.117468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b25f2e14-6f06-48d7-8122-235edca46577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:58.351534 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3145/6341] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:58.369161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:58.371870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:58.510549 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:38:58.516875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:58.517333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:58.517795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:58.615878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] MFA Rules not processed for user `d3bf816a329942a8a4f1e0d65b90eb36`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:38:58.617483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:58.622898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676deb-98eb-455b-90b7-2cc02b60a41a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:58.665801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:58.666591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:58.666877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:58.667156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:58.716223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:58.723837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:58.793461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3197/6342] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:38:58.839200 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3146/6343] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:38:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:38:58.851717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:38:58.853344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:38:58.890317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78abd8-6306-4a94-8014-08e358bf4d08 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:38:58.897862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:38:58.898705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:38:58.899203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:38:58.899605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:38:58.954009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:38:58.958946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:38:59.010658 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3198/6344] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:38:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:00.102910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:00.109858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:00.366257 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:00.446734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdeb83-adb7-4551-8e38-a5d18674884d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:00.458595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:00.462047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:00.462421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:00.462770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:00.483288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:00.519534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:00.529224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a306ce-efe9-4f2d-a32e-7b7d9ef31d7d service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:00.599986 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3147/6345] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:01.527345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:01.529521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:01.560498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab865f9-d07a-48ae-ba27-ea81a2f24888 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:01.573265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:01.574967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:01.575258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:01.575543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:01.580108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:01.615678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:01.616976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:01.654116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3199/6346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:10.560072 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=14 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:11.636797 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=29 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:13.811109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:13.811641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:13.811884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:13.894316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] MFA Rules not processed for user `a6cea44a68f04b52972b770230b5130a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:13.897910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:14.168874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3148/6347] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:14.177061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:14.408667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:14.412991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:14.473013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d7ffb-261b-4880-9a39-58329552b02f service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:14.489115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:14.490110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:14.490557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:14.491291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:14.496647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:14.498862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:14.584245 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3200/6348] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:14 2022] POST /identity/v3/projects => generated 403 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:14.585510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:14.636208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376de2f7-df37-4bda-a6b0-2eca6481d0c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:14.835610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:14.837346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:14.837933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:14.839705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] PATH_INFO: `/v3/users/071710669a8c48fbb94463bbd5f4e9c2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:14.843822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071710669a8c48fbb94463bbd5f4e9c2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:14.863577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:14.922772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1209dc-66f3-4640-bd6e-ab8ab54bbc50 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:14.944201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:14.946539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:14.949387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:14.956293 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:14.958137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:14.960506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:14.972410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:15.038975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071710669a8c48fbb94463bbd5f4e9c2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:15.041391 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3201/6349] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:14 2022] POST /identity/v3/users => generated 302 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:15.047526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:15.065016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071710669a8c48fbb94463bbd5f4e9c2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:15.081273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df3507-3050-4589-a400-b1418dd85417 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:15.094761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071710669a8c48fbb94463bbd5f4e9c2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:15.104031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:15.105782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:15.106473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:15.106905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:15.107909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:15.110544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641db74-c66f-4b1c-91e4-27af0bfd287d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:15.135565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071710669a8c48fbb94463bbd5f4e9c2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:15.142212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071710669a8c48fbb94463bbd5f4e9c2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:15.158332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3149/6350] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:14 2022] DELETE /identity/v3/users/071710669a8c48fbb94463bbd5f4e9c2 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:15.160628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:15.164729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3202/6351] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:15.164916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:15.177192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:15.181610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:15.183542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:15.232076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:15.239794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:15.374015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a560b04-a3b5-440e-90b9-e51e18438249 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:15.395182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:15.396303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:15.396962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:15.397458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:15.399796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:15.406111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:15.441561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3203/6352] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:15.453453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:15.457540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:15.467360 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:15.477080 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3150/6353] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:15.478672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:15.509167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24cab-8d94-431e-bd81-ab9ec7abadc3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:15.534974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:15.535899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:15.536178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:15.536454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] PATH_INFO: `/v3/projects/99fa4a8655d946dcbbbafdda043b2a57/users/9943ea411696482b8d288153ac2e8bbb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:15.612284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fa4a8655d946dcbbbafdda043b2a57, user_id=9943ea411696482b8d288153ac2e8bbb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:15.615057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:15.678200 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3151/6354] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:15 2022] PUT /identity/v3/projects/99fa4a8655d946dcbbbafdda043b2a57/users/9943ea411696482b8d288153ac2e8bbb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:15.704199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e74e1-7f12-4763-85e5-cf60587d4082 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:15.875787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:15.876655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:15.877106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:15.877540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:16.053917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:16.053917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b54bce-e0bd-4947-b071-77cd71c596dd service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:16.093193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3204/6355] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:39:17.807633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:17.809831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:17.838366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982c3a-0f84-4c78-a5ed-a049810b56fb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:17.856215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:17.857290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:17.857591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:17.857886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] PATH_INFO: `/v3/projects/3b6d75e392b04f8e9520b50663a5e6c3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:17.860616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6d75e392b04f8e9520b50663a5e6c3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:17.864791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:18.125550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6d75e392b04f8e9520b50663a5e6c3', 'request_id': 'req-834e1199-29fb-42fb-b759-8c411363a578'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.143731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6d75e392b04f8e9520b50663a5e6c3', 'request_id': 'req-834e1199-29fb-42fb-b759-8c411363a578'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.161696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6d75e392b04f8e9520b50663a5e6c3', 'request_id': 'req-834e1199-29fb-42fb-b759-8c411363a578'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.189224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] The token cache is being invalidate because project 3b6d75e392b04f8e9520b50663a5e6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:18.206496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.207906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.209636 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3152/6356] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:17 2022] DELETE /identity/v3/projects/3b6d75e392b04f8e9520b50663a5e6c3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:18.215437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809b82-4ad5-48a1-9a4f-cbfd9710dcdc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.216340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809b82-4ad5-48a1-9a4f-cbfd9710dcdc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.216769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809b82-4ad5-48a1-9a4f-cbfd9710dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.284098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ee809b82-4ad5-48a1-9a4f-cbfd9710dcdc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:18.287765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee809b82-4ad5-48a1-9a4f-cbfd9710dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:18.482654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:18.484214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:18.511613 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:18.546440 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3205/6357] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:18.552387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.552864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.553399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.615791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:18.624991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:18.653286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3206/6358] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:18.657826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:18.699161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3afc9-50b8-48ed-9e12-8b8de191408d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:18.707596 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:18.723968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:18.724824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.725220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.725435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1199-29fb-42fb-b759-8c411363a578 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:18.727493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.727493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:18.727493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:18.731565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:18.735262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:18.736766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.737367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.737849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] PATH_INFO: `/v3/users/345afddf00964ab392563c44803f3f8a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.740884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=345afddf00964ab392563c44803f3f8a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:18.743543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:18.764500 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3207/6359] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:18.766840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:18.784744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941abb9-6d3a-4c59-8278-671dc06e2e46 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:18.801228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:18.802111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.802626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.803030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.803851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:18.805945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:18.833369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345afddf00964ab392563c44803f3f8a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.853265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345afddf00964ab392563c44803f3f8a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.874201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345afddf00964ab392563c44803f3f8a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.878992 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3208/6360] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:18 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:18.880192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:18.904664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345afddf00964ab392563c44803f3f8a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.905393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d0e9b8b4-e651-4f7d-8573-e7bea99bfe4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345afddf00964ab392563c44803f3f8a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:18.919474 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3153/6361] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:18 2022] DELETE /identity/v3/users/345afddf00964ab392563c44803f3f8a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:18.923554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:18.923849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:18.924280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:18.969171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:18.974534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a272c9-b2d3-42e7-98ac-a0269cd6c317 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:18.975653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:19.135123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.135979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.136360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.136720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.137503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.139929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:19.177442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3154/6362] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:19.184246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:19.186000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:19.217859 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3209/6363] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:18 2022] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:19.218910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:19.227357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:19.252123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987aad-dbaa-4a2e-bd00-dcca0c4c1d27 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:19.271337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.272035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.272328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.272824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.273589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.278325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:19.278569 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:19.307209 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3210/6364] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:19.312471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:19.337996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e820e0b-9346-49e8-a355-6fec451ee625 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:19.349738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcc7bf-bbe7-49da-8f20-64cf218aa211 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:19.358861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.360358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.366245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.367143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.368223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.370821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:19.372359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.373704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.374386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.374694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.387706 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3211/6365] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:19.395539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:19.436301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fd1a6-900b-4f7a-ba47-fa47888b6e29 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:19.443613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.448207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c029aac-acc7-4ff2-b4ab-1084b5cc6895 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:19.448726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f866-1683-403d-b619-32638838675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.450507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f866-1683-403d-b619-32638838675d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.452360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f866-1683-403d-b619-32638838675d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.453759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f866-1683-403d-b619-32638838675d admin admin] PATH_INFO: `/v3/projects/c1ea27ee187741f59225b2f2b0b94226/users/5f4ef1bf26ac43f9bda95774f39779f9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.497077 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3155/6366] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:39:19.498235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f866-1683-403d-b619-32638838675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea27ee187741f59225b2f2b0b94226, user_id=5f4ef1bf26ac43f9bda95774f39779f9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.505693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f866-1683-403d-b619-32638838675d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:19.545968 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3212/6367] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:19 2022] PUT /identity/v3/projects/c1ea27ee187741f59225b2f2b0b94226/users/5f4ef1bf26ac43f9bda95774f39779f9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:19.556857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.557297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.558394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.661946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] MFA Rules not processed for user `5f4ef1bf26ac43f9bda95774f39779f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:19.662674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:19.820105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3156/6368] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:19.831696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f866-1683-403d-b619-32638838675d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:19.833505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8a91f866-1683-403d-b619-32638838675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:19.875591 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:19.959599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f866-1683-403d-b619-32638838675d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:19.969733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:19.970737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:19.970737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:19.970966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:19.989995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:19.991449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:20.013451 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3213/6369] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:21.111604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:21.371173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c47ec-f87d-4f5a-9e29-12f0a16ee6e7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:21.383483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:21.385315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:21.387722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:21.388255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:21.414569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:21.464588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:21.466650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35651b3-80e9-41d9-81df-d37d78b73a28 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:21.513323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3157/6370] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:22.888673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:22.890282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:23.136959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4cea-2921-4e99-b551-2fe5f8ca2365 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:23.153151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:23.154076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:23.154473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:23.154657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] PATH_INFO: `/v3/projects/20694f1b7f424331b1ee37960c73be1d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:23.160179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20694f1b7f424331b1ee37960c73be1d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:23.162160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:23.291410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20694f1b7f424331b1ee37960c73be1d', 'request_id': 'req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:23.302751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20694f1b7f424331b1ee37960c73be1d', 'request_id': 'req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:23.322857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20694f1b7f424331b1ee37960c73be1d', 'request_id': 'req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:23.347794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] The token cache is being invalidate because project 20694f1b7f424331b1ee37960c73be1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:23.348087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:23.348949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6bc20d36-9c6b-4393-8f0a-90f9f9e09281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:23.353100 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3214/6371] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:22 2022] DELETE /identity/v3/projects/20694f1b7f424331b1ee37960c73be1d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:23.358699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:23.359248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:23.359248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:23.413998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:23.415402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:23.643649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3158/6372] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:23.645013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:23.645304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:23.645585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:23.690897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:23.694991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:23.728432 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3215/6373] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:23.732259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:23.744790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfa148-cd5c-4a6c-b0b4-efc98993406a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:23.761095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:23.762260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:23.762780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:23.763276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:23.764249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:23.764799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:23.766662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:23.768831 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:23.799340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3159/6374] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:23.803643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:23.820455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e45af9-2c1a-4696-9bb0-98cb0848084d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:23.830769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:23.831564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:23.831911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:23.832254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:23.833132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:23.835157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:23.900080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:23.900660 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3216/6375] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:23 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:23.920102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021239c7-d3d0-4637-9ff4-24c291a8d1c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.055115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.055824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.056175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.056542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.057340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.060180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.109398 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3160/6376] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:23 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:24.120514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.147124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4fce-af9f-462c-aa38-0637c41c7b41 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.163693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.164397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.164677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.164950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.165752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.167582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.201986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.202213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3217/6377] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:24.212184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcce2-1f57-496b-bdec-2bfa2478126a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.219087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.219767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.220049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.220325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.221071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.222744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00360d-cba4-41e4-a61d-3e68a8fe7082 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.241211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.250738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3161/6378] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:24.251745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d42e3-a9d3-4b71-b7b5-77983aa1d8b2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.259000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.259904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.260181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.260972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] PATH_INFO: `/v3/projects/83e37d7e7d5943d88e954178feced764/users/3d602acf9412400c88b4bd4eddad4d0a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.273335 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:24.284612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e37d7e7d5943d88e954178feced764, user_id=3d602acf9412400c88b4bd4eddad4d0a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.287727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.332971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3218/6379] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:24 2022] PUT /identity/v3/projects/83e37d7e7d5943d88e954178feced764/users/3d602acf9412400c88b4bd4eddad4d0a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:24.334594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.334885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.335163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.399589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] MFA Rules not processed for user `3d602acf9412400c88b4bd4eddad4d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:24.400829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:24.556453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.557192 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3162/6380] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:24.636696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7243877-3d45-4f98-a0c6-73477c1ac8b4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.642224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.643128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.643584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.644011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.644877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.647663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.691288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.701699 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3219/6381] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:24 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:24.706647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b55a91-d804-4a07-adc6-56f2c6be8a9c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.827942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.828573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.828860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.829139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.829867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.833443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.861744 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:24.909482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.922639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa62b9-0932-4bdb-b626-5a074cf906b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:24.923785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3163/6382] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:24 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:24.941170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:24.941973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:24.942263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:24.942539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:24.943287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:24.945088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:24.967641 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3220/6383] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:24.972140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:24.989052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34288ea-ab39-49b7-85e3-dcff1880db7d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:25.006493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:25.007419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.007698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.007973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] PATH_INFO: `/v3/projects/2813ccacca754f04bd198188166819d5/users/6f673ed090634d229e71a97eacf4e1ae/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.054551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813ccacca754f04bd198188166819d5, user_id=6f673ed090634d229e71a97eacf4e1ae, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:25.067698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:25.092616 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3164/6384] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:24 2022] PUT /identity/v3/projects/2813ccacca754f04bd198188166819d5/users/6f673ed090634d229e71a97eacf4e1ae/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:25.097178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:25.144073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c37415-ac61-40e1-b27d-6d23a7b51a2b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:25.309085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:25.310237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.310573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.310849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.311657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:25.313299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f59c88-d978-40f4-8239-0e77b4874810 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:25.370326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:25.384722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3221/6385] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:25.389717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0e179-1676-4dfc-94e4-493902ad93af admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:25.404379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:25.405334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.408499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.409120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] PATH_INFO: `/v3/projects/2813ccacca754f04bd198188166819d5/users/6f673ed090634d229e71a97eacf4e1ae/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.416036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813ccacca754f04bd198188166819d5, user_id=6f673ed090634d229e71a97eacf4e1ae, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:25.424498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:25.467368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.467727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.468702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.469894 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3165/6386] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:25 2022] PUT /identity/v3/projects/2813ccacca754f04bd198188166819d5/users/6f673ed090634d229e71a97eacf4e1ae/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:25.539549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:25.542915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:25.564797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] MFA Rules not processed for user `6f673ed090634d229e71a97eacf4e1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:25.568943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:25.727032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae19775-510c-4dac-9cd8-7e624e1bd622 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:25.747623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:25.748391 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:25.749240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.750228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.750228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] PATH_INFO: `/v3/users/13101a16293d42e3b9cb95968d1a4a17` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.754455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13101a16293d42e3b9cb95968d1a4a17)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:25.756684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:25.864444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13101a16293d42e3b9cb95968d1a4a17'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:25.899343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13101a16293d42e3b9cb95968d1a4a17'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:25.900365 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3222/6387] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:25.908613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:25.931288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13101a16293d42e3b9cb95968d1a4a17'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:25.943842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d001d-4aed-446b-acfd-ee360c5f0d29 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:25.963331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:25.964474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:25.964972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:25.965446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:25.966292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13101a16293d42e3b9cb95968d1a4a17'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:25.966762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:25.967822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13101a16293d42e3b9cb95968d1a4a17'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:25.973095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:25.991339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3166/6388] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:25 2022] DELETE /identity/v3/users/13101a16293d42e3b9cb95968d1a4a17 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:26.037078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:26.037402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3223/6389] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:25 2022] POST /identity/v3/domains => generated 245 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:26.040018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:26.165318 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:26.239537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b17cc0-7f5f-4620-b3c1-47ea4caf95dc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:26.470710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:26.471397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:26.471679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:26.471953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:26.472670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:26.474900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:26.535089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3167/6390] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:26 2022] POST /identity/v3/projects => generated 410 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:26.536686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:26.549537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e776ab7-d1e3-48ba-ad40-b9497b43435f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:26.673413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:26.674341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:26.674902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:26.676628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:26.677600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:26.680091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:26.714718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3224/6391] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:26 2022] POST /identity/v3/users => generated 348 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:26.715731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:26.732350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc209e89-6b29-48e2-987a-1297e79c4ff5 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:26.739841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:26.741042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:26.741488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:26.741987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:26.743564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:26.748324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:26.769237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:26.781738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3168/6392] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:26.785924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097a017-9800-413d-a49d-1c2c316d8e06 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:26.795980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:26.797433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:26.797952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:26.798393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/projects/d979a616e6c040afb3035637426e7beb/users/7e7533fab4bb429cb08b4e04420693c3/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:26.802274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:26.805519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:26.858816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d979a616e6c040afb3035637426e7beb, user_id=7e7533fab4bb429cb08b4e04420693c3, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:26.867864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5137-bf68-4367-aab0-0bfa35b49a72 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:26.935178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3225/6393] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:26 2022] PUT /identity/v3/projects/d979a616e6c040afb3035637426e7beb/users/7e7533fab4bb429cb08b4e04420693c3/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:26.943964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ca8-46ff-4092-bbdc-1959f7cbf466 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:26.944581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ca8-46ff-4092-bbdc-1959f7cbf466 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:26.944581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac5ca8-46ff-4092-bbdc-1959f7cbf466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.069206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420bd92-1c97-4c35-8179-a5fee7939673 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:27.202043 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:27.221797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:27.222599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:27.222880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:27.224094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] PATH_INFO: `/v3/projects/bfb7452687b04c969b093c19ca262e24` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.225594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb7452687b04c969b093c19ca262e24)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:27.227586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:27.251990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-00ac5ca8-46ff-4092-bbdc-1959f7cbf466 None None] MFA Rules not processed for user `7e7533fab4bb429cb08b4e04420693c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:27.253232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-00ac5ca8-46ff-4092-bbdc-1959f7cbf466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:27.326486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3226/6394] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:27.331221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:27.331732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:27.333352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.365079 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:27.366702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb7452687b04c969b093c19ca262e24', 'request_id': 'req-a71483fd-aa8d-4771-80da-9db74eb69ad6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.391169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb7452687b04c969b093c19ca262e24', 'request_id': 'req-a71483fd-aa8d-4771-80da-9db74eb69ad6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.435313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb7452687b04c969b093c19ca262e24', 'request_id': 'req-a71483fd-aa8d-4771-80da-9db74eb69ad6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.472198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] The token cache is being invalidate because project bfb7452687b04c969b093c19ca262e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:27.472864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.475647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.484206 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3169/6395] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:26 2022] DELETE /identity/v3/projects/bfb7452687b04c969b093c19ca262e24 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:27.487717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:27.490366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:27.520883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] MFA Rules not processed for user `7e7533fab4bb429cb08b4e04420693c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:27.524381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:27.546667 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3227/6396] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:27.547668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:27.586750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0060498-f095-4572-852d-7b2bdda2234a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:27.599990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e7533fab4bb429cb08b4e04420693c3', 'user_domain_id': '00a1d104b1ee44829e399c7f45b6bab0', 'system_scope': None, 'project_id': 'd979a616e6c040afb3035637426e7beb', 'project_domain_id': '00a1d104b1ee44829e399c7f45b6bab0', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:27.603891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:27.603891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:27.603891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.630719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:27.656637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:27.688124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71483fd-aa8d-4771-80da-9db74eb69ad6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:27.704424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:27.705110 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3228/6397] 10.222.0.27 () {56 vars in 1283 bytes} [Sun Jul 24 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:27.710626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:27.710930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:27.711213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] PATH_INFO: `/v3/users/d3bf816a329942a8a4f1e0d65b90eb36` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.712800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:27.716894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:27.719797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bf816a329942a8a4f1e0d65b90eb36)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:27.721809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:27.877888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bf816a329942a8a4f1e0d65b90eb36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.919660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bf816a329942a8a4f1e0d65b90eb36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.945691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bf816a329942a8a4f1e0d65b90eb36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.968445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb788ef-022d-4feb-bbb1-d187142c0692 tempest-test_project-1120530040 tempest-user-1544214639] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:27.976082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bf816a329942a8a4f1e0d65b90eb36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.977859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bf816a329942a8a4f1e0d65b90eb36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:27.981231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:27.982089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:27.982484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:27.982874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/users/7e7533fab4bb429cb08b4e04420693c3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:27.986373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e7533fab4bb429cb08b4e04420693c3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:27.990586 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3170/6398] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:27 2022] DELETE /identity/v3/users/d3bf816a329942a8a4f1e0d65b90eb36 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:27.990737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:28.111319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7533fab4bb429cb08b4e04420693c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.114267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7533fab4bb429cb08b4e04420693c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.132455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7533fab4bb429cb08b4e04420693c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.148200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7533fab4bb429cb08b4e04420693c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.177467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7533fab4bb429cb08b4e04420693c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.194681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3229/6399] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:27 2022] DELETE /identity/v3/users/7e7533fab4bb429cb08b4e04420693c3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:28.200107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:28.202255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:28.218220 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:28.358898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1043357-4af4-4b7b-a709-619de81d06aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:28.492844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:28.494783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:28.495558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:28.496139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/projects/d979a616e6c040afb3035637426e7beb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:28.498558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d979a616e6c040afb3035637426e7beb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:28.501015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:28.615705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd979a616e6c040afb3035637426e7beb', 'request_id': 'req-a33daac0-6f0a-4bd9-8784-286d21833c00'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.630845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd979a616e6c040afb3035637426e7beb', 'request_id': 'req-a33daac0-6f0a-4bd9-8784-286d21833c00'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.647439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd979a616e6c040afb3035637426e7beb', 'request_id': 'req-a33daac0-6f0a-4bd9-8784-286d21833c00'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.672226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] The token cache is being invalidate because project d979a616e6c040afb3035637426e7beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:28.672226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.672848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.678982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:28.679517 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3171/6400] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:28 2022] DELETE /identity/v3/projects/d979a616e6c040afb3035637426e7beb => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:28.680640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:28.711468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393178-fe37-4780-b54e-49a0c06b151f tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:28.754835 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:28.890886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:28.891779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:28.892061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:28.892339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/domains/00a1d104b1ee44829e399c7f45b6bab0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:28.897043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=00a1d104b1ee44829e399c7f45b6bab0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:28.898726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:28.941299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:28.942083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.007618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.009056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.016761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3230/6401] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:39:28 2022] PATCH /identity/v3/domains/00a1d104b1ee44829e399c7f45b6bab0 => generated 246 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:39:29.019413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:29.022233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:29.053638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33daac0-6f0a-4bd9-8784-286d21833c00 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:29.157825 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:29.192395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f673ed090634d229e71a97eacf4e1ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2813ccacca754f04bd198188166819d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:29.193701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:29.194454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:29.195040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] PATH_INFO: `/v3/domains/00a1d104b1ee44829e399c7f45b6bab0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:29.209887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=00a1d104b1ee44829e399c7f45b6bab0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:29.212020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:29.258096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.270048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.328590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.339205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.347305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.356116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:29.358733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:29.371643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] The token cache is being invalidate because project 00a1d104b1ee44829e399c7f45b6bab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:29.372008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.372824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.386394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.387297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.391759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '00a1d104b1ee44829e399c7f45b6bab0', 'request_id': 'req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.406231 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3172/6402] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:29 2022] DELETE /identity/v3/domains/00a1d104b1ee44829e399c7f45b6bab0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:29.407679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:29.410508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:29.624228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70ad-82f2-4cdc-8131-cc13e1f77651 tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:29.700091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a48d-d446-4f1c-a7d9-c3e913d5a02e tempest-TestDefaultProjectId-277388127 tempest-TestDefaultProjectId-277388127-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:29.707757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:29.708722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:29.709007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:29.709734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] PATH_INFO: `/v3/users/3d602acf9412400c88b4bd4eddad4d0a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:29.710622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d602acf9412400c88b4bd4eddad4d0a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:29.726560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:29.767825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:29.772437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:29.772658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:29.772944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] PATH_INFO: `/v3/projects/05cb5260170e48e1b6117a51f6c7897d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:29.773829 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:29.777943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cb5260170e48e1b6117a51f6c7897d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:29.782064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:29.853632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d602acf9412400c88b4bd4eddad4d0a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.859379 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:29.875296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d602acf9412400c88b4bd4eddad4d0a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.888404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d602acf9412400c88b4bd4eddad4d0a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.889269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cb5260170e48e1b6117a51f6c7897d', 'request_id': 'req-cc738b50-f098-4f1c-99f3-462b0698a59d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.906792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d602acf9412400c88b4bd4eddad4d0a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.908106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-783b71a6-66d0-4934-8218-688b8d2b68af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d602acf9412400c88b4bd4eddad4d0a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.915612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cb5260170e48e1b6117a51f6c7897d', 'request_id': 'req-cc738b50-f098-4f1c-99f3-462b0698a59d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.921008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3173/6403] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:29 2022] DELETE /identity/v3/users/3d602acf9412400c88b4bd4eddad4d0a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:29.922658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:29.922951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:29.923230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:29.931222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cb5260170e48e1b6117a51f6c7897d', 'request_id': 'req-cc738b50-f098-4f1c-99f3-462b0698a59d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.946222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:29.948196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:29.964328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] The token cache is being invalidate because project 05cb5260170e48e1b6117a51f6c7897d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:29.965046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.970178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cc738b50-f098-4f1c-99f3-462b0698a59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:29.972585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3231/6404] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:29 2022] DELETE /identity/v3/projects/05cb5260170e48e1b6117a51f6c7897d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:29.977223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0680c-7bc9-4cfb-9deb-d2f711f3dc8b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:29.977893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0680c-7bc9-4cfb-9deb-d2f711f3dc8b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:29.978404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0680c-7bc9-4cfb-9deb-d2f711f3dc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.061501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f6c0680c-7bc9-4cfb-9deb-d2f711f3dc8b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:30.066436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6c0680c-7bc9-4cfb-9deb-d2f711f3dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:30.149404 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3174/6405] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:30.162570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.165543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:30.317286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3232/6406] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:30.319973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.324610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.325523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.363361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7b75b-ab9e-418b-9d0f-eab8c3384169 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:30.373019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:30.373760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.374184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.374480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.390529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:30.391786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:30.397339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:30.398891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:30.417499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3175/6407] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:30.456969 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3233/6408] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:30.458387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.483871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d901-d94e-4e67-96fb-04990d6c80a9 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:30.490298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:30.491452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.491979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.492456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.493477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:30.494250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:30.496941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:30.518412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3176/6409] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:30.522582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.535305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800ff80-7500-434d-b129-ff2b6dc4b228 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:30.551146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:30.551841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.552125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.552404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.558857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:30.569767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:30.646971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.647623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3234/6410] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:30 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:30.665014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e756f-98b2-4eb2-9f09-b46da3b98df1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:30.732025 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:30.848424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:30.850270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.851274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.859920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.861026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:30.864862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:30.902925 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3177/6411] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:30 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:30.903041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.920305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f448-8487-4b24-99ed-306573b409a1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:30.935480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:30.936227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:30.936516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:30.936795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:30.937535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:30.939196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:30.972456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3235/6412] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:39:30.977086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:30.997165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0ba7f-22fd-4650-a8c0-ec455d6db9ab admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:31.009885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:31.015032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:31.015401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:31.015689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:31.016725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:31.021515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feebf2-5293-447e-bf22-9e9ad0139bc7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:31.045026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3178/6413] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:31.045571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:31.064645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2196a99-4ce5-4855-8fda-84636b14abfd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:31.083640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:31.084994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:31.085145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:31.085429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] PATH_INFO: `/v3/projects/a373807910a0427bb9ae0955d13bf1fa/users/a4242cf259f9480b87435fdd16e04610/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:31.122622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a373807910a0427bb9ae0955d13bf1fa, user_id=a4242cf259f9480b87435fdd16e04610, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:31.125389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:31.164053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3236/6414] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:31 2022] PUT /identity/v3/projects/a373807910a0427bb9ae0955d13bf1fa/users/a4242cf259f9480b87435fdd16e04610/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:31.169431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6062e-8654-4d77-97c5-28900e0c2bb5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:31.169990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6062e-8654-4d77-97c5-28900e0c2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:31.170283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6062e-8654-4d77-97c5-28900e0c2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:31.210240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8ee6062e-8654-4d77-97c5-28900e0c2bb5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:31.214229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ee6062e-8654-4d77-97c5-28900e0c2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:31.432812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3179/6415] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:31.502793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:31.504991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:31.639902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05a66-c4dc-4c8a-9966-04ff6a690e6b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:31.644759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:31.645553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:31.645776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:31.646114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:31.657917 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:31.675930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:31.677629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45760569-55b3-4c8a-ab13-bd9058c4fc11 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:31.693627 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3237/6416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:31.930581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:31.931479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:31.933251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:31.972274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] MFA Rules not processed for user `9943ea411696482b8d288153ac2e8bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:31.973873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.150366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:32.151436 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3180/6417] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:32.151526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:32.151744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:32.183990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] MFA Rules not processed for user `a6cea44a68f04b52972b770230b5130a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:32.186652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.351145 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3238/6418] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:32.364919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:32.366325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.462525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:32.464563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.468866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:32.515006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b9347-e7b1-4c73-9732-445ba25dc389 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:32.543024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:32.546043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:32.548208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:32.550198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] PATH_INFO: `/v3/projects/83e37d7e7d5943d88e954178feced764` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:32.552860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e37d7e7d5943d88e954178feced764)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:32.556388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:32.634122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde005-2e7b-459b-b298-9c1574cecdff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:32.662316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:32.663156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:32.663538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:32.663782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:32.669434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.711659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:32.712903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:32.740294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e37d7e7d5943d88e954178feced764', 'request_id': 'req-269589ac-d327-49ce-b44b-8bdcaf022eee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:32.770962 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3181/6419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:32.774509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:32.780254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e37d7e7d5943d88e954178feced764', 'request_id': 'req-269589ac-d327-49ce-b44b-8bdcaf022eee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:32.785511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:32.803168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e37d7e7d5943d88e954178feced764', 'request_id': 'req-269589ac-d327-49ce-b44b-8bdcaf022eee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:32.832111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] The token cache is being invalidate because project 83e37d7e7d5943d88e954178feced764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:32.832406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:32.836711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade892-e040-49d3-8bbc-3b46ec908401 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:32.838047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:32.844627 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3239/6420] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:32 2022] DELETE /identity/v3/projects/83e37d7e7d5943d88e954178feced764 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:32.847493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:32.850195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.045269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:33.047823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:33.048161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:33.048453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:33.051426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269589ac-d327-49ce-b44b-8bdcaf022eee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:33.053565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.069344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:33.070364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:33.070671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:33.070914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] PATH_INFO: `/v3/users/6f673ed090634d229e71a97eacf4e1ae` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:33.074348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f673ed090634d229e71a97eacf4e1ae)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:33.076373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:33.165075 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:33.207788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f673ed090634d229e71a97eacf4e1ae'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:33.215307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f673ed090634d229e71a97eacf4e1ae'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:33.238768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f673ed090634d229e71a97eacf4e1ae'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:33.262192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f673ed090634d229e71a97eacf4e1ae'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:33.279735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:33.281505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:33.290133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c656709f-c96e-4f8d-a46d-940666537f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f673ed090634d229e71a97eacf4e1ae'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:33.308192 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3240/6422] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:32 2022] DELETE /identity/v3/users/6f673ed090634d229e71a97eacf4e1ae => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:33.312993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:33.312993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:33.313227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:33.319799 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3182/6422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:33.377978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] MFA Rules not processed for user `a4242cf259f9480b87435fdd16e04610`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:33.379258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.533486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3241/6423] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:33.538709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:33.541988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.575740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727e788-8f03-4349-93db-98b102eab9fb service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:33.692143 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:33.726197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:33.727853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:33.728649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:33.729182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:33.730289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:33.733033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:33.782389 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3183/6424] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:33 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:33.783623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:33.785309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.804247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ffcbd-620d-4a6b-ae8b-143bf8b233ca None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:33.851492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:33.853612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:33.925480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:33.926405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:33.926682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:33.928130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:33.928906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:33.930933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:33.991312 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3242/6425] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:33 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:33.996105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.011557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d278e-6888-4fba-b1ad-a42948260de2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.015063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf7096-0ace-47e6-9df4-29c03f8d32bf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.021661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.022553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.022830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.023102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] PATH_INFO: `/v3/projects/2813ccacca754f04bd198188166819d5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.028866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.029557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.030690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2813ccacca754f04bd198188166819d5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.031481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.031786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.033794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.034318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.049132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.080924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3243/6426] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:34.083362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.097487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3ac1d-2af5-49c8-80ad-45797463bec4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.106473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.108084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.108529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.109009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] PATH_INFO: `/v3/projects/93929029e5fe4d0b831b831339f4203d/users/d677b15439644342b2ae1a2bac230d68/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.130098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2813ccacca754f04bd198188166819d5', 'request_id': 'req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:34.147649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2813ccacca754f04bd198188166819d5', 'request_id': 'req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:34.158103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2813ccacca754f04bd198188166819d5', 'request_id': 'req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:34.166205 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:34.186079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] The token cache is being invalidate because project 2813ccacca754f04bd198188166819d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:34.186616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:34.187785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a44a03e-f068-43dc-9d7a-a424b4c0b30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:34.190056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93929029e5fe4d0b831b831339f4203d, user_id=d677b15439644342b2ae1a2bac230d68, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.190510 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3184/6427] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:33 2022] DELETE /identity/v3/projects/2813ccacca754f04bd198188166819d5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:34.195283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87e79-0a7c-418a-8904-fcf6fb1c06ec None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.195811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87e79-0a7c-418a-8904-fcf6fb1c06ec None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.196269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87e79-0a7c-418a-8904-fcf6fb1c06ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.204424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.217692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-85b87e79-0a7c-418a-8904-fcf6fb1c06ec None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:34.219455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-85b87e79-0a7c-418a-8904-fcf6fb1c06ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:34.238087 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3244/6428] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:34 2022] PUT /identity/v3/projects/93929029e5fe4d0b831b831339f4203d/users/d677b15439644342b2ae1a2bac230d68/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:34.242885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.246533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:34.285323 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:34.306692 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3185/6429] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:34.315657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.330059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.332083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.384646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:34.387522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:34.423105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f7bf0-dcc3-4ed3-84de-f19459780932 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.428537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.429343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.429701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.430075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.431028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.433424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.445570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3245/6430] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:34.451145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.488607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6cc46-8fa6-4cf0-bc88-98c52dee4b48 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.512116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.513498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.515334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.515919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] PATH_INFO: `/v3/projects/93929029e5fe4d0b831b831339f4203d/users/d677b15439644342b2ae1a2bac230d68/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.520018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93929029e5fe4d0b831b831339f4203d, user_id=d677b15439644342b2ae1a2bac230d68, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.524737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.575709 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3246/6431] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:34 2022] PUT /identity/v3/projects/93929029e5fe4d0b831b831339f4203d/users/d677b15439644342b2ae1a2bac230d68/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:34.623530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3186/6432] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:34.627939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.765006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad90b-5d03-4dfd-a6d4-b44d746d1655 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.771044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.772714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.772714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.772906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.773604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:34.773956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.776593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.795834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3247/6433] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:34.796925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.811229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b779f66-2687-4c50-b5da-f06ef3ca3d32 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:34.834220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:34.838164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:34.838482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:34.843147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:34.844250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:34.850624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:34.942733 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3187/6434] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:34 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:34.945506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:34.959394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b0fb-99ed-4aaa-bb07-daa6cac51520 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:35.014107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:35.016160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:35.178393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:35.179111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.179423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.179761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.180536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:35.191512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:35.223311 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:35.247765 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3248/6435] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:34 2022] POST /identity/v3/users => generated 286 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:35.251576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:35.262969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33979f5-4175-42be-99fc-7b506d2ec7e9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:35.268333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950843d-5ee0-4b19-8c5d-1b0e0cac8ea4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:35.274919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:35.277399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.277835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.278250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.280728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:35.285854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:35.286543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.286822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.287097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.287953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:35.290542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:35.309991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3249/6436] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:35.314176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:35.319861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:35.328977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:35.346839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ef03-02ec-4764-9d4b-0b1b08bddd75 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:35.363092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:35.364100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.368049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.368952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.372338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:35.374460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5598b-6a8f-41d2-b003-e477ff0513e3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:35.385256 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3188/6437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:35.412235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3250/6438] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:35.414023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:35.444488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2e461-28be-474f-a9f8-095c88800a78 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:35.471392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:35.472346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.472611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.472947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] PATH_INFO: `/v3/projects/b2c25080d2c14fb697c5a616409cd982/users/8f47ec9034604ea293a458b7dfa8ffc5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.508296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c25080d2c14fb697c5a616409cd982, user_id=8f47ec9034604ea293a458b7dfa8ffc5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:35.511004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:35.539688 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3189/6439] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:35 2022] PUT /identity/v3/projects/b2c25080d2c14fb697c5a616409cd982/users/8f47ec9034604ea293a458b7dfa8ffc5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:35.555065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:35.555495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:35.555872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:35.645325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] MFA Rules not processed for user `8f47ec9034604ea293a458b7dfa8ffc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:35.649040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:35.840387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3251/6440] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:35.844945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:35.955794 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:36.043559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17698a-5d7c-488f-8ec3-ea5ca624f56c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.054330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.055096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.055645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.056028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.056805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.059642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.143092 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3190/6441] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:35 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:36.143954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:36.158204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dce6f-1bb0-4523-9904-b58f5fa60d62 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.268833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.270509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.271030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.271525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.272430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.277659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.310023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:36.321454 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3252/6442] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:36 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:36.325075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5833f-25d7-4806-bc0e-7ba676266b21 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.330793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.331868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.332342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.332809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.333808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.336003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.356900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:36.367236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3191/6443] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:36.369133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69744de3-d3bb-4e47-ad70-299da660c8a0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.376322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.377876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.378483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.378946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] PATH_INFO: `/v3/projects/af367d0e169b417f932fd1cb8ce854d2/users/98204d4ab7ef4610b1a120f1f75e3efe/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.405150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af367d0e169b417f932fd1cb8ce854d2, user_id=98204d4ab7ef4610b1a120f1f75e3efe, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.408423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.435498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3253/6444] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:36 2022] PUT /identity/v3/projects/af367d0e169b417f932fd1cb8ce854d2/users/98204d4ab7ef4610b1a120f1f75e3efe/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:36.437623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:36.454844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192de07-3b1d-472d-a2c3-9727df89976a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.613589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.614323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.614616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.614961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.615721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.620441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922864a0-49e6-4967-a3a3-0cc04f3aafc1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.646979 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3192/6445] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:36.652326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:36.674181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75b214-a374-432b-87bf-3acde43e2c0c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:36.686109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:36.691295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.692214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.692717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] PATH_INFO: `/v3/projects/af367d0e169b417f932fd1cb8ce854d2/users/98204d4ab7ef4610b1a120f1f75e3efe/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.696381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af367d0e169b417f932fd1cb8ce854d2, user_id=98204d4ab7ef4610b1a120f1f75e3efe, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:36.705634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:36.737013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3254/6446] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:36 2022] PUT /identity/v3/projects/af367d0e169b417f932fd1cb8ce854d2/users/98204d4ab7ef4610b1a120f1f75e3efe/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:36.747752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581a40-7e25-43fc-8147-c718267af59e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:36.748449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581a40-7e25-43fc-8147-c718267af59e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:36.748927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581a40-7e25-43fc-8147-c718267af59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:36.812040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-36581a40-7e25-43fc-8147-c718267af59e None None] MFA Rules not processed for user `98204d4ab7ef4610b1a120f1f75e3efe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:36.817412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36581a40-7e25-43fc-8147-c718267af59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:37.057586 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3193/6447] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:37.061890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.079562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33251bd-87f5-4d53-9c55-e40a11e879fd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.095271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.095962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.096398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.096693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.097458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.099118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.112391 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:37.155551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3255/6448] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:37 2022] POST /identity/v3/services => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:37.158131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36581a40-7e25-43fc-8147-c718267af59e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.173528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36581a40-7e25-43fc-8147-c718267af59e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.200003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.200878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.201249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.201609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.202463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.203741 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:37.203741 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:39:37.203741 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:39:37.204991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.236993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3194/6449] 10.222.0.27 () {60 vars in 1212 bytes} [Sun Jul 24 01:39:37 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:37.238650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.258997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f05c0-72f0-40a6-b59c-86a6f6da6353 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.270593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.271145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.271254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.271531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.272271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.273901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.304748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3256/6450] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:37 2022] POST /identity/v3/services => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:37.306678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.324963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e389-37b1-4981-8843-f4cdf7305c0a tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.355348 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:37.371942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.378813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.380316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.380628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.381411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.389857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.422141 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3195/6451] 10.222.0.27 () {60 vars in 1212 bytes} [Sun Jul 24 01:39:37 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:37.426766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.465892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfd9e-8143-45b7-a8e5-9c2382906f10 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.483227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.489959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.490520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.490924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.493431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.497650 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:37.497650 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:37.497650 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:37.502385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.535913 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3257/6452] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:39:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:37.538302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.555966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520fd0-8df1-4b7f-b187-35a12a449d49 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.575527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.577890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.578434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.578897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.579756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=2fa079dc42ba46c883414299bd87b28c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.581000 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:37.581000 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:39:37.581000 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:39:37.582627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.592499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3196/6453] 10.222.0.27 () {58 vars in 1289 bytes} [Sun Jul 24 01:39:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:37.597002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.614932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e10b2-20bc-45bf-bef8-794ce2597342 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.627659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.628539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.628809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.629092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.629804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=2fa079dc42ba46c883414299bd87b28c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.631496 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:37.631496 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:37.631496 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:37.632666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.650059 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3258/6454] 10.222.0.27 () {58 vars in 1290 bytes} [Sun Jul 24 01:39:37 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c => generated 0 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 24 01:39:37.652639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.685180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd4688-80f1-4b6c-9395-210068c71c42 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.697036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.703943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.704239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.707413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.709505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2fa079dc42ba46c883414299bd87b28c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.710679 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:37.710679 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:39:37.710679 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:39:37.719897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.756688 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3197/6455] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:39:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:37.762797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.780601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b27a1b-3e40-4e78-a34c-2c7068e70f95 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.797999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.799094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.799771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.800354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.801415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.804852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.821980 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3259/6456] 10.222.0.27 () {58 vars in 1190 bytes} [Sun Jul 24 01:39:37 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:37.826841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.845737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1221-3022-4350-b744-6e2a5b98d9d3 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.860282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.861309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.861687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.862044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.866454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=2fa079dc42ba46c883414299bd87b28c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.868242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Could not find Endpoint Group: 2fa079dc42ba46c883414299bd87b28c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 2fa079dc42ba46c883414299bd87b28c. Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 24 01:39:37.889814 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 2fa079dc42ba46c883414299bd87b28c. Jul 24 01:39:37.890937 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:39:37.892146 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3198/6457] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:39:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/2fa079dc42ba46c883414299bd87b28c => generated 120 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:39:37.897243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:37.911713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff04d3-9016-4cdd-b7fc-b3212170951c tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:37.936483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:37.938242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:37.939154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:37.939528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services/40cb5c8be0494b1da7c78cc439580d6d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:37.940353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_service(service_id=40cb5c8be0494b1da7c78cc439580d6d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:37.942155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.013098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3260/6458] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:37 2022] DELETE /identity/v3/services/40cb5c8be0494b1da7c78cc439580d6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:38.015362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.042586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879697a-0695-43db-a9f7-abf80a0be8cb tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.079499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.080500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.080972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.081430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.082446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.084400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.109179 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3199/6459] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:38 2022] POST /identity/v3/services => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:38.113720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.133438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c849b-0ef4-4f08-ab77-86b8f5d0354f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.170664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.171602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.172011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.172443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.173273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.174670 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:38.174670 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:38.174670 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:38.175881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.209008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3261/6460] 10.222.0.27 () {60 vars in 1212 bytes} [Sun Jul 24 01:39:38 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:38.210447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.230254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17212732-02ee-4a43-90b8-253e6886e24f tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.252198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.252881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.253166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.253442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.254203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.255819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.306311 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3200/6461] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:38 2022] POST /identity/v3/services => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:38.308087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.326585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5411c8-332a-4228-9331-b6a808884688 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.426759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.428578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.428874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.429156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d9dbae7f40214bd8a3993a07227aeb93` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.441281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=d9dbae7f40214bd8a3993a07227aeb93)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.446289 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:38.446289 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:38.446289 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:38.447323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.471866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3262/6462] 10.222.0.27 () {60 vars in 1312 bytes} [Sun Jul 24 01:39:38 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/d9dbae7f40214bd8a3993a07227aeb93 => generated 335 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:39:38.477410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.496541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b1136-5d61-48c2-bd5e-d5380a4869d2 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.508691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.512093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.512462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.512742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services/1ce63873c7a54cd197d049e371ba34ef` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.513440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1ce63873c7a54cd197d049e371ba34ef)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.515102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378f76f-15a9-495d-a411-c854fc045343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.576540 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3201/6463] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:38 2022] DELETE /identity/v3/services/1ce63873c7a54cd197d049e371ba34ef => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:38.578542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.596414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425968d-71f5-4083-af75-f1fed1f250b4 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.613041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.613397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.613877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.664476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:38.669103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.670538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.670825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.671105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d9dbae7f40214bd8a3993a07227aeb93` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.671779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d9dbae7f40214bd8a3993a07227aeb93)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.672798 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:38.672798 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:38.672798 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:38.673705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d78037-b3eb-49f0-92fc-e5a833789664 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.678671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:38.723989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3263/6464] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:39:38 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d9dbae7f40214bd8a3993a07227aeb93 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:38.723989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.723989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.723989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.865115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] MFA Rules not processed for user `d677b15439644342b2ae1a2bac230d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:38.866479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:38.870454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3202/6465] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:38.872422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.890197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7e336-565e-405f-b27e-01ddd9269c3c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:38.897091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:38.898305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:38.899397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:38.899397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services/f30355ec4d1c4300b087903d831077fa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:38.901190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f30355ec4d1c4300b087903d831077fa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:38.904827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:38.955306 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3203/6466] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:38 2022] DELETE /identity/v3/services/f30355ec4d1c4300b087903d831077fa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:38.957281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:38.964166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:39.013554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3264/6467] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3442 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:39.014557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:39.052055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d63e-3895-4d90-9010-fa7a9fd0416a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:39.060934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:39.062150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.062499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.062895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5b1dc09075c94e029263a131123dec9b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.063690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5b1dc09075c94e029263a131123dec9b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:39.065498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bae397-6716-4edb-91ff-0a1e10d0ac13 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:39.067209 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:39.074882 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:39.082815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3265/6468] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:39:39 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5b1dc09075c94e029263a131123dec9b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:39.105317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341745-7510-4315-8f30-303fceaf66d6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.106945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341745-7510-4315-8f30-303fceaf66d6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.106945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe341745-7510-4315-8f30-303fceaf66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.161321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fe341745-7510-4315-8f30-303fceaf66d6 None None] MFA Rules not processed for user `a4242cf259f9480b87435fdd16e04610`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:39.162956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fe341745-7510-4315-8f30-303fceaf66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:39.171023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2dd28-d1ce-40c4-bd9c-3c223b9ea343 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:39.194401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:39.195124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.195409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.195687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.211789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:39.214129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:39.235581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3204/6469] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:39.236307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:39.254564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b98a55-39ea-4056-a268-7faf5543d573 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:39.263264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98204d4ab7ef4610b1a120f1f75e3efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af367d0e169b417f932fd1cb8ce854d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:39.265277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.268769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.269402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] PATH_INFO: `/v3/services/3cba5635bc3d40d5b2562112f67f7d42` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.270498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3cba5635bc3d40d5b2562112f67f7d42)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:39.273803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:39.313193 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3205/6470] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:39 2022] DELETE /identity/v3/services/3cba5635bc3d40d5b2562112f67f7d42 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:39.313505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:39.342154 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3266/6471] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:39.451116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c17-b1d1-4b0e-b9d4-f2cdc6eaf361 tempest-EndPointGroupsTest-1622142257 tempest-EndPointGroupsTest-1622142257-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:39.473339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:39.476107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.477985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.478915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] PATH_INFO: `/v3/users/8f47ec9034604ea293a458b7dfa8ffc5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.482549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f47ec9034604ea293a458b7dfa8ffc5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:39.485042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:39.589614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f47ec9034604ea293a458b7dfa8ffc5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:39.613534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f47ec9034604ea293a458b7dfa8ffc5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:39.644217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f47ec9034604ea293a458b7dfa8ffc5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:39.660442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f47ec9034604ea293a458b7dfa8ffc5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:39.661443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f47ec9034604ea293a458b7dfa8ffc5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:39.675844 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3206/6472] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:39 2022] DELETE /identity/v3/users/8f47ec9034604ea293a458b7dfa8ffc5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:39.680362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:39.681069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:39.681497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:39.716315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:39.719277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:39.834604 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3267/6473] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:39.872871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:39.877700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:39.882280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:39.883938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:39.884238 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:40.063610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7a68c-9a8b-4081-b034-855a449d3f89 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:40.072118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:40.072845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:40.073124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:40.073394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:40.110544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:40.112009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:40.129999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fd31d-1a79-47a1-a54e-9de88c658122 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:40.137769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3207/6474] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:40.148024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:40.149269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:40.149914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:40.150418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:40.152639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:40.204327 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:40.288084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:40.290787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:40.331203 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3268/6475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:41.363244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:41.367484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:41.394024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946de99-1428-4772-bd6e-456be87d2a9c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:41.410243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:41.411528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:41.411816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:41.412338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] PATH_INFO: `/v3/projects/b2c25080d2c14fb697c5a616409cd982` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:41.414428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c25080d2c14fb697c5a616409cd982)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:41.419175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:41.529085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c25080d2c14fb697c5a616409cd982', 'request_id': 'req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.537272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c25080d2c14fb697c5a616409cd982', 'request_id': 'req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.546985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c25080d2c14fb697c5a616409cd982', 'request_id': 'req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.566307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] The token cache is being invalidate because project b2c25080d2c14fb697c5a616409cd982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:41.567007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.567845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.569978 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3208/6476] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:41 2022] DELETE /identity/v3/projects/b2c25080d2c14fb697c5a616409cd982 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:41.574932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:41.590770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c06360-0823-40fd-8b28-d64a8110b8ff service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:41.712084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:41.713993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:41.714478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:41.715075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] PATH_INFO: `/v3/users/98204d4ab7ef4610b1a120f1f75e3efe` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:41.716703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98204d4ab7ef4610b1a120f1f75e3efe)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:41.735191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:41.847549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98204d4ab7ef4610b1a120f1f75e3efe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.850029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98204d4ab7ef4610b1a120f1f75e3efe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.870751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98204d4ab7ef4610b1a120f1f75e3efe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.879711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98204d4ab7ef4610b1a120f1f75e3efe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.923582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98204d4ab7ef4610b1a120f1f75e3efe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:41.934165 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3269/6477] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:41 2022] DELETE /identity/v3/users/98204d4ab7ef4610b1a120f1f75e3efe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:42.559587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:42.561166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:42.828702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac1c9-414a-4f9f-b9f4-2e8dbc98de43 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:42.853315 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:42.992079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:42.993056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:42.993537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:42.994014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.002741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:43.034927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.034927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ac01c-368c-47d9-a8df-b47cf57b9597 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:43.035342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:43.037933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:43.061035 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3209/6478] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:43.147640 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:43.197630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d8d1-1758-4975-b9a1-bba3929bbb59 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:43.204876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:43.205790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.206004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.206285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] PATH_INFO: `/v3/projects/af367d0e169b417f932fd1cb8ce854d2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.207842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af367d0e169b417f932fd1cb8ce854d2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.210458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:43.296319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af367d0e169b417f932fd1cb8ce854d2', 'request_id': 'req-5084dcd9-9e9a-4e24-bf13-847d81bac129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:43.313998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af367d0e169b417f932fd1cb8ce854d2', 'request_id': 'req-5084dcd9-9e9a-4e24-bf13-847d81bac129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:43.324261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af367d0e169b417f932fd1cb8ce854d2', 'request_id': 'req-5084dcd9-9e9a-4e24-bf13-847d81bac129'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:43.339818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] The token cache is being invalidate because project af367d0e169b417f932fd1cb8ce854d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:43.340260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:43.341482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5084dcd9-9e9a-4e24-bf13-847d81bac129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:43.343375 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3270/6479] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:43 2022] DELETE /identity/v3/projects/af367d0e169b417f932fd1cb8ce854d2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:43.348240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.348534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.348812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.370436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:43.371751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:43.496793 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3210/6480] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:43.601995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.602374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.602578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.624716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:43.626108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:43.640506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:43.648838 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3271/6481] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:43.653390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa6ed-6a89-4e51-a720-ac6ecdc610ac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:43.661395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:43.662835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.663365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.663860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.664839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:43.665384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.668158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:43.693008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:43.703929 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3211/6482] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:43.709278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b68a2-578f-4eb3-a3ce-f57ac3cc5733 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:43.717085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:43.718032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.718467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.718896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.719658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.722322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:43.766403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3272/6483] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:43 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:43.771552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:43.791947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d1f5b-4af6-4ff1-a021-3242e7655c2c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:43.903196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:43.903882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.904164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.904444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.905815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.909501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:43.943836 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3212/6484] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:43 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:43.949112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:43.962450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d6b58-3be4-4c3c-86bf-39da5ddb7797 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:43.968318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:43.969878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:43.970527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:43.970837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:43.971805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:43.973969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.000013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3273/6485] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:44.004048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.022968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3afc11-a56a-4758-820b-f6e388b8d8f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.039220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.039220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.039220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.039220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.039949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.042110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e86b-7d65-467e-a5e6-d09055c4149b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.074059 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3213/6486] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:44.079507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.094544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabebbd-f8bc-461d-819e-8424a4bc47de admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.112212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.113440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.113854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.114232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] PATH_INFO: `/v3/projects/ae7cdbdb7bcf465aa16c8fd5a77912b2/users/ffda60baa20a49a982644723eed80032/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.152665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7cdbdb7bcf465aa16c8fd5a77912b2, user_id=ffda60baa20a49a982644723eed80032, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.156137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.191284 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3274/6487] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:44 2022] PUT /identity/v3/projects/ae7cdbdb7bcf465aa16c8fd5a77912b2/users/ffda60baa20a49a982644723eed80032/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:44.193388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.193810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.194207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.242417 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:44.264055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] MFA Rules not processed for user `ffda60baa20a49a982644723eed80032`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:44.265660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:44.396453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3214/6488] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:44.401055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.536915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b25c1-31dc-47d8-b761-74ab9da54ef2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.543151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.543821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.544106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.544385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.545533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.548569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.559761 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:44.598097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3275/6489] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:44 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:44.599935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.618378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e45deb-4d75-4c94-95e6-2e83ea6ebc8b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.754827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.755989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.756634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.757753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.758895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.764482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.799687 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3215/6490] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:44 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:44.800918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.816338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff04fe-7489-4137-a89e-28b6fcac3fc4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.832216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.832997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.833356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.833721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.834556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.836776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.854661 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3276/6491] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:44.856679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.867880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bbb5d-3fd2-41a7-af73-5f5358f79dc5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:44.873264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:44.874241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:44.874525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:44.874804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] PATH_INFO: `/v3/projects/a729295dadbc4cacabacc14892904d02/users/5a8bfa88e20045c08d6ef979a16e92b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:44.894828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a729295dadbc4cacabacc14892904d02, user_id=5a8bfa88e20045c08d6ef979a16e92b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:44.897884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:44.919975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3216/6492] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:44 2022] PUT /identity/v3/projects/a729295dadbc4cacabacc14892904d02/users/5a8bfa88e20045c08d6ef979a16e92b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:44.921922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:44.936700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf075f2f-07cb-401b-8d0d-728447398073 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.077565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.078321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.078610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.078948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.079699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.083583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9a831-76f9-4938-a9b7-29b160d99ce7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:45.097248 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3277/6493] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:45.101174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:45.113651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d4d6-b7fd-4446-8e89-78aed4398e1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.126548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.129561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.130812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.132239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] PATH_INFO: `/v3/projects/a729295dadbc4cacabacc14892904d02/users/5a8bfa88e20045c08d6ef979a16e92b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.139373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a729295dadbc4cacabacc14892904d02, user_id=5a8bfa88e20045c08d6ef979a16e92b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.146972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:45.163716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3217/6494] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:45 2022] PUT /identity/v3/projects/a729295dadbc4cacabacc14892904d02/users/5a8bfa88e20045c08d6ef979a16e92b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:45.175081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.175710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.175997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.238946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] MFA Rules not processed for user `5a8bfa88e20045c08d6ef979a16e92b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:45.241578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:45.392550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:45.401685 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3278/6495] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:45.409071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8f6a2-0db0-4775-9a38-17eb993a21aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.421378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.422412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.424628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.425642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.427081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.428200 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:45.428200 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:39:45.428200 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:39:45.429142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:45.468006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:45.485739 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3218/6496] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:45 2022] POST /identity/v3/regions => generated 224 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:45.489317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bab57-9720-4c6c-80d9-0ab3b0f24f0c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.520353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.522176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.522534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.522827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.524083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.525334 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:45.525334 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:45.525334 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:45.527017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:45.574668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:45.588450 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3279/6497] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:45 2022] POST /identity/v3/regions => generated 224 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:45.595181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad5da-8b05-44e9-9d3e-d245e3bc95e2 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.621562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.622574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.622874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.623242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/ddfaad85-4f28-4ebe-9c6e-b22e052565ef` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.624006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:create_region(region_id=ddfaad85-4f28-4ebe-9c6e-b22e052565ef)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.625808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:45.677068 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3219/6498] 10.222.0.27 () {60 vars in 1258 bytes} [Sun Jul 24 01:39:45 2022] PUT /identity/v3/regions/ddfaad85-4f28-4ebe-9c6e-b22e052565ef => generated 231 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:45.687512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:45.776020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c47f68-9d75-4092-9948-62aa1acb5b81 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:45.924780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:45.926206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:45.926206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:45.926393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/ddfaad85-4f28-4ebe-9c6e-b22e052565ef` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:45.927738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ddfaad85-4f28-4ebe-9c6e-b22e052565ef)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:45.929165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.002264 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:46.027623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3280/6499] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:39:45 2022] DELETE /identity/v3/regions/ddfaad85-4f28-4ebe-9c6e-b22e052565ef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:46.033491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.076109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bff8-6d1a-403d-ac6c-fddcb6dfe0e0 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.116906 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:46.133550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.135273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.135722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.136201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.137920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.139770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.219824 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3220/6500] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:39:46 2022] POST /identity/v3/regions => generated 252 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:46.223832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.254648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae48e-7fe6-4a78-a932-b4551490b7c8 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.303026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.306186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.307668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.308139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.311015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:update_region(region_id=aa9e1c4db0ab4aeea262c12d0fd5c702)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.312298 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:46.312298 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:39:46.312298 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:39:46.332440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.387900 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3281/6501] 10.222.0.27 () {60 vars in 1249 bytes} [Sun Jul 24 01:39:46 2022] PATCH /identity/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702 => generated 253 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:39:46.392137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.420736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ce0e3-8d79-41f9-bb8a-491118ffe139 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.449257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.450696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.452491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.452855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.454352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:get_region(region_id=aa9e1c4db0ab4aeea262c12d0fd5c702)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.457067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.470274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3221/6502] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:39:46 2022] GET /identity/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702 => generated 253 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:46.474076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.493863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa886-7603-4354-a865-4731f31c3825 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.503390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.504464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.504695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.505130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.505784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=aa9e1c4db0ab4aeea262c12d0fd5c702)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.507344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.544784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3282/6503] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:46 2022] DELETE /identity/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:46.549816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.578764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125bfb-25ca-42f6-81fc-dd3e05e0db17 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.606872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.607786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.608181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.608600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.609538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.611191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.620254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3222/6504] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:39:46 2022] GET /identity/v3/regions => generated 670 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:46.624172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.639590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0b9a4-e023-41c8-911b-e8a096f099a7 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.651759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.655902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.657057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.657537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.658572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=aa9e1c4db0ab4aeea262c12d0fd5c702)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.660698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Could not find region: aa9e1c4db0ab4aeea262c12d0fd5c702.: keystone.exception.RegionNotFound: Could not find region: aa9e1c4db0ab4aeea262c12d0fd5c702. Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: aa9e1c4db0ab4aeea262c12d0fd5c702. Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:39:46.701740 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: aa9e1c4db0ab4aeea262c12d0fd5c702. Jul 24 01:39:46.703062 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:39:46.710188 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3283/6505] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:46 2022] DELETE /identity/v3/regions/aa9e1c4db0ab4aeea262c12d0fd5c702 => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:39:46.710445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.725882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c38a1-615d-476f-a428-5ea5003408d6 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.742184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.742896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.743189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.743470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.746371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.747861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.774680 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3223/6506] 10.222.0.27 () {58 vars in 1127 bytes} [Sun Jul 24 01:39:46 2022] GET /identity/v3/regions => generated 670 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:46.776634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.791745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770825e0-c2f6-42c6-bd49-08a2ab27ef18 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.803946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.804640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.805074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.805348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.806006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.809893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.878333 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3284/6507] 10.222.0.27 () {60 vars in 1149 bytes} [Sun Jul 24 01:39:46 2022] POST /identity/v3/regions => generated 254 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:46.882608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:46.902338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe93c38-486d-453e-a533-8a0b58043abb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:46.941885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:46.941885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:46.941885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:46.942732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:46.942732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Adding query filter params (parent_region_id=774c0c19db334adabf149b87c3adbac6) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:46.942732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:46.942732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:46.948764 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3224/6508] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:39:46 2022] GET /identity/v3/regions?parent_region_id=774c0c19db334adabf149b87c3adbac6 => generated 400 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:46.960379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:47.004861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331adb95-8a72-433f-a532-8f006457f7a4 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:47.027495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:47.030901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:47.031948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:47.032320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/ae21663602004b91b82b0c80a5f6aa06` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:47.033111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ae21663602004b91b82b0c80a5f6aa06)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:47.044688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:47.086311 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3285/6509] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:46 2022] DELETE /identity/v3/regions/ae21663602004b91b82b0c80a5f6aa06 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:47.093329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:47.110557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f5b99-32c9-4f4c-8982-1ad9c02b24bb tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:47.170234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:47.171232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:47.171529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:47.171814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/68776330ad404689ad9ee848a3cad885` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:47.172477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=68776330ad404689ad9ee848a3cad885)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:47.178163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:47.237775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3225/6510] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:47 2022] DELETE /identity/v3/regions/68776330ad404689ad9ee848a3cad885 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:47.239590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:47.266309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0316c-ec21-44b5-8d84-e1480864d266 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:47.324740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8bfa88e20045c08d6ef979a16e92b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729295dadbc4cacabacc14892904d02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:47.325923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:47.326440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:47.326986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] PATH_INFO: `/v3/regions/774c0c19db334adabf149b87c3adbac6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:47.327911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorizing `identity:delete_region(region_id=774c0c19db334adabf149b87c3adbac6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:47.332342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6410b2f-9dea-4cb8-8da8-010eacf25804 tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:47.377468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3286/6511] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:39:47 2022] DELETE /identity/v3/regions/774c0c19db334adabf149b87c3adbac6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:47.382172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:47.630644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9bfa6-f2e1-4a26-8328-9c46c43e613d tempest-RegionsTestJSON-464660788 tempest-RegionsTestJSON-464660788-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:47.674570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:47.675648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:47.675944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:47.676228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] PATH_INFO: `/v3/users/ffda60baa20a49a982644723eed80032` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:47.685511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffda60baa20a49a982644723eed80032)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:47.689207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:47.817777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:47.843804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffda60baa20a49a982644723eed80032'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:47.856614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffda60baa20a49a982644723eed80032'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:47.868486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffda60baa20a49a982644723eed80032'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:47.891674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffda60baa20a49a982644723eed80032'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:47.893646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffda60baa20a49a982644723eed80032'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:47.905051 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3226/6512] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:47 2022] DELETE /identity/v3/users/ffda60baa20a49a982644723eed80032 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:47.909922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:47.910457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:47.910941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:47.945494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:47.953684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:48.087104 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3287/6513] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:48.099909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:48.101784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:48.258963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a377e1-7cf7-4cd7-9f30-a0cc6e012ec6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:48.263638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:48.264465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:48.264746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:48.265194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:48.279061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:48.280818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:48.294736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3227/6514] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:50.002921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:50.005112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:50.044985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d852ae-bf1d-4317-a6f7-8a412feb6e0e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:50.109662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:50.127965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:50.128272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:50.128632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] PATH_INFO: `/v3/projects/ae7cdbdb7bcf465aa16c8fd5a77912b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:50.134465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7cdbdb7bcf465aa16c8fd5a77912b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:50.147287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:50.293763 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:50.355451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7cdbdb7bcf465aa16c8fd5a77912b2', 'request_id': 'req-3aaf8c03-2258-4572-b4e3-bca9f631345d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.377883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7cdbdb7bcf465aa16c8fd5a77912b2', 'request_id': 'req-3aaf8c03-2258-4572-b4e3-bca9f631345d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.407643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7cdbdb7bcf465aa16c8fd5a77912b2', 'request_id': 'req-3aaf8c03-2258-4572-b4e3-bca9f631345d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.437225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] The token cache is being invalidate because project ae7cdbdb7bcf465aa16c8fd5a77912b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:50.437534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.443883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.445876 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3288/6515] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:50 2022] DELETE /identity/v3/projects/ae7cdbdb7bcf465aa16c8fd5a77912b2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:50.450653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:50.484979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbc7b1-8332-455d-a1f1-4a7cc54ce7e6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:50.657915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:50.665586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:50.666429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:50.666711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] PATH_INFO: `/v3/users/5a8bfa88e20045c08d6ef979a16e92b6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:50.673743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8bfa88e20045c08d6ef979a16e92b6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:50.676122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:50.820129 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:50.834808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8bfa88e20045c08d6ef979a16e92b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.860006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8bfa88e20045c08d6ef979a16e92b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.874690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8bfa88e20045c08d6ef979a16e92b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.919307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8bfa88e20045c08d6ef979a16e92b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.920278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8bfa88e20045c08d6ef979a16e92b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:50.935428 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3228/6516] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:50 2022] DELETE /identity/v3/users/5a8bfa88e20045c08d6ef979a16e92b6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:51.644177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:51.646331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:51.894982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8c03-2258-4572-b4e3-bca9f631345d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:52.055414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:52.056102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:52.056940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:52.057230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:52.063068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:52.132701 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:52.161829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:52.167635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca419ad-f2cd-4107-9cb4-ba4f303703ce service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:52.192476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3289/6517] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:39:52.638381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:52.639954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:52.856468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2888c3-455c-4f51-8d37-c2adb20e6ee3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:52.875615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:52.876733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:52.877138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:52.877519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] PATH_INFO: `/v3/projects/a729295dadbc4cacabacc14892904d02` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:52.880208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a729295dadbc4cacabacc14892904d02)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:52.886517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:53.054548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a729295dadbc4cacabacc14892904d02', 'request_id': 'req-41e38bf5-dc01-481d-bdf3-2c77362051f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.075831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a729295dadbc4cacabacc14892904d02', 'request_id': 'req-41e38bf5-dc01-481d-bdf3-2c77362051f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.113072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a729295dadbc4cacabacc14892904d02', 'request_id': 'req-41e38bf5-dc01-481d-bdf3-2c77362051f1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.143080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] The token cache is being invalidate because project a729295dadbc4cacabacc14892904d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:53.143383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.146628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-41e38bf5-dc01-481d-bdf3-2c77362051f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.148953 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3229/6518] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:52 2022] DELETE /identity/v3/projects/a729295dadbc4cacabacc14892904d02 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:53.154885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:53.155883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:53.156468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:53.216339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:53.219498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:53.449251 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3290/6519] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:53.454167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:53.454459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:53.454936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:53.491170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:53.492468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:53.513069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3230/6520] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:53.517323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:53.538306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddb41b-bcda-4afc-a84e-a122f1ff6c8e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:53.549515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:53.550250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:53.550535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:53.550835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:53.551560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:39:53.551870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:53.553493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:53.577783 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3291/6521] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:39:53.582292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:53.599495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c91ff-d41e-443d-b43c-191a8d4e3fe9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:53.607313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:53.607997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:53.608281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:53.608753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:53.609859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:53.612133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:53.642401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:53.644626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:53.677496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f645-db00-4438-aa3b-fa35fd1918c2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:53.693942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:53.700182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:53.700793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:53.702434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3231/6522] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:53 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:53.703923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:53.704393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] PATH_INFO: `/v3/users/545a39e3583b41b1b9ba0cf41507754f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:53.706198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] RBAC: Authorizing `identity:delete_user(user_id=545a39e3583b41b1b9ba0cf41507754f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:53.711203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:53.711507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:53.785692 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:53.816900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545a39e3583b41b1b9ba0cf41507754f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.818813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545a39e3583b41b1b9ba0cf41507754f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.847173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545a39e3583b41b1b9ba0cf41507754f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.868125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545a39e3583b41b1b9ba0cf41507754f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.889136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545a39e3583b41b1b9ba0cf41507754f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:53.902382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3292/6523] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:53 2022] DELETE /identity/v3/users/545a39e3583b41b1b9ba0cf41507754f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:53.903640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:53.909639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:53.951673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e535ae-9f56-45f7-86d5-b1be079d62ef admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.029620 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:54.061403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a0674-a826-4be0-8d66-e0ff6f46017b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.075709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.076454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.076744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.077024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.077762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.079716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214d7b-0db9-4f07-a351-dc526ab506ae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.122818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3293/6524] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:53 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:54.124240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.124525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.124966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.163855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:54.168109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:54.194188 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3294/6525] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:54.195135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:54.237750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404c79-fe6f-452f-bd68-55d89220d700 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.242761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.243868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.245556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.247174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.254926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:54.258345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.258890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.259178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.260184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.261048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.262759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.294504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.294992 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3295/6526] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:54.296142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.299587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:54.314628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:54.331736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3232/6527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:54.332611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:54.372357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc0154-6d3a-464a-bc8b-a4761e311f98 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.383029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.383720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.384109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.389997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.390758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.416177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.445191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99543b81-dd0c-4b5b-ab5a-de69cd35bc0d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.451006 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3233/6528] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:54.452848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:54.472253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac1a0f-a92e-4e67-871f-8da2c808c50d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:54.475739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.476438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.476742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.477010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.488373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:54.493277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.494199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.494604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] PATH_INFO: `/v3/projects/ad636792583a41c3a6b52754f779172e/users/eb96c2ca89af40ee9afbaac3cb0d8d08/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.512184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.514750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0d2a-9510-4c5e-96d0-7e9ded267d1e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.538466 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3296/6529] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:39:54.574352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad636792583a41c3a6b52754f779172e, user_id=eb96c2ca89af40ee9afbaac3cb0d8d08, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:54.586327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:54.635191 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3234/6530] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:54 2022] PUT /identity/v3/projects/ad636792583a41c3a6b52754f779172e/users/eb96c2ca89af40ee9afbaac3cb0d8d08/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:54.652940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:54.653228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:54.653513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:54.737903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] MFA Rules not processed for user `eb96c2ca89af40ee9afbaac3cb0d8d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:54.739149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:54.875098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3297/6531] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:54.879338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.036676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba38ef-add4-4454-b27b-30cfe9a1c356 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.051823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.052991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.053500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.054066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.055080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.058672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.070849 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:55.126027 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3235/6532] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:54 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:55.127347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.146523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35ab40-f047-4c4d-9e90-4353edc6c6ba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.271490 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:55.293480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.294198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.294481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.294758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.295629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.297566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.339304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3298/6533] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:55 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:55.343002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.383716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865055f-7c30-49b2-83ed-d863b887bab6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.392483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.393187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.393470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.393770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.394685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.396323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.429635 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3236/6534] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:55.434338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.454559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c702-dc34-4bdf-8e0c-6c9c944d0bae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.469799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.470812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.471343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.471949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] PATH_INFO: `/v3/projects/0687338502474d2382bad7d8c505cf5e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.510984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0687338502474d2382bad7d8c505cf5e, user_id=3541b25895454cba9503d24774248597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.514974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.538877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3299/6535] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:55 2022] PUT /identity/v3/projects/0687338502474d2382bad7d8c505cf5e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:55.542656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.553655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8f50-80f6-49e0-9cb3-22e56a6d98c3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.662215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.663253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.663920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.664364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.665401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.669435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.687635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.691013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3237/6536] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:55.702686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.703805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50be0b-434d-460f-8d02-2c2026730e87 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.704584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:55.725614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.726876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.727275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.727651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] PATH_INFO: `/v3/projects/0687338502474d2382bad7d8c505cf5e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.731283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0687338502474d2382bad7d8c505cf5e, user_id=3541b25895454cba9503d24774248597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.732223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2b582-5402-40ac-9a6d-45612b97ab69 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:55.741444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e0ce-218c-4d41-844f-b15373deb66a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.744581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:55.745652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.747558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.749717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] PATH_INFO: `/v3/projects/f090fd22b51a49819e4efe8e5a6fd184` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.750957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f090fd22b51a49819e4efe8e5a6fd184)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:55.755582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:55.786668 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3300/6537] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:55 2022] PUT /identity/v3/projects/0687338502474d2382bad7d8c505cf5e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:55.789227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:55.789710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:55.790086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:55.828158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] MFA Rules not processed for user `3541b25895454cba9503d24774248597`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:55.830596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:55.864903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f090fd22b51a49819e4efe8e5a6fd184', 'request_id': 'req-3c032624-3cc2-484e-ba5d-1269d34ee975'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:55.878655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f090fd22b51a49819e4efe8e5a6fd184', 'request_id': 'req-3c032624-3cc2-484e-ba5d-1269d34ee975'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:55.894565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f090fd22b51a49819e4efe8e5a6fd184', 'request_id': 'req-3c032624-3cc2-484e-ba5d-1269d34ee975'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:55.922537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] The token cache is being invalidate because project f090fd22b51a49819e4efe8e5a6fd184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:55.923100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:55.924875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:55.927785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3238/6538] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:55 2022] DELETE /identity/v3/projects/f090fd22b51a49819e4efe8e5a6fd184 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:55.933036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:55.940690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:56.022696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3301/6539] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:39:56.027386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:56.032969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:56.098959 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:56.117420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c032624-3cc2-484e-ba5d-1269d34ee975 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.146547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.147478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.147807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.148085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] PATH_INFO: `/v3/users/862a417573a4464abca67495dad1618c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.152420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=862a417573a4464abca67495dad1618c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.154405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.251560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e226b8-1ea0-4c7b-bd14-9a08989f42ec None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.254181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862a417573a4464abca67495dad1618c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:56.266242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.267512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.267512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.267905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.268753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.271174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f372-74a0-4aa3-8de1-06f44067de19 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.280108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862a417573a4464abca67495dad1618c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:56.300547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862a417573a4464abca67495dad1618c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:56.325493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862a417573a4464abca67495dad1618c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:56.326419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862a417573a4464abca67495dad1618c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:56.328601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3302/6540] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:39:56 2022] POST /identity/v3/projects => generated 369 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:56.330631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.331206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.331729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.336845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3239/6541] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:55 2022] DELETE /identity/v3/users/862a417573a4464abca67495dad1618c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:56.338430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:56.364443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] MFA Rules not processed for user `4611d01617d645579ae3529c8f8f9de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:56.368324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:56.376239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:56.405881 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:56.563786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3303/6542] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:56.594973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65311a-fbb4-4836-8eaa-337590f1af67 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.615155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.615858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.616146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.616410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.617111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.619130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.688453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:56.689891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3240/6543] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:39:56 2022] POST /identity/v3/users => generated 285 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:56.707272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe640cde-2799-4b2e-a7c6-539b19e9bb82 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.723753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.725223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.725636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.726036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.726922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.728865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.763248 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3304/6544] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:56.763499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:56.824557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd71901-8250-4e2a-8dd6-37f8e76801c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.847051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.847870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.848258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.848642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.849528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.851277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64997706-1ef3-42bb-8bee-fbb87f6bcadb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.877246 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3241/6545] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:39:56.881284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:56.895497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac6cc5-0a98-418f-a005-72b31788890f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:56.909016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:56.910111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:56.910463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:56.910822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] PATH_INFO: `/v3/projects/a929c6e254814a4e8bf693cbc4559212/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:56.945409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a929c6e254814a4e8bf693cbc4559212, user_id=d9d96ab18bf84772ab2c1d56f886cb83, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:56.949191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:56.995538 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3305/6546] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:56 2022] PUT /identity/v3/projects/a929c6e254814a4e8bf693cbc4559212/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:57.006254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.006787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.007003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.077818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] MFA Rules not processed for user `d9d96ab18bf84772ab2c1d56f886cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:39:57.079781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:57.168994 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:57.213785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3242/6547] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:39:57.218794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.221516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:57.310727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153d7d6-77ae-4c36-9f50-2c642ee27688 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.316831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.317660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.318217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.318599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.319551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.322442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.350697 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3306/6548] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:57 2022] POST /identity/v3/domains => generated 276 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:57.355090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.372664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2737-c9c4-4da7-beaa-869a3c8d0dd5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.457548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.459764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:57.548306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.550439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.550696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.550981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.553924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.560017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.601726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3243/6549] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:39:57 2022] POST /identity/v3/roles => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:57.606610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.633728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaca4c-8c0f-46c4-a72f-ee8c1934f02e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.645133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9cca-865a-4dc5-8556-5f87eb16b115 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.648811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.650931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.651225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.652219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3398801f056b4dd68e3fa82c6f548b6c/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/5e89826abf774ceeb8d8e055e72d2e30` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.653717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.655494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.656117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.656680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] PATH_INFO: `/v3/projects/ad8b57ad4ab34ff29258f3f1cf91f440` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.658691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8b57ad4ab34ff29258f3f1cf91f440)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.661413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.679278 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:57.686020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3398801f056b4dd68e3fa82c6f548b6c, user_id=d9d96ab18bf84772ab2c1d56f886cb83, role_id=5e89826abf774ceeb8d8e055e72d2e30)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.691680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.725774 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3244/6550] 10.222.0.27 () {60 vars in 1479 bytes} [Sun Jul 24 01:39:57 2022] PUT /identity/v3/domains/3398801f056b4dd68e3fa82c6f548b6c/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/5e89826abf774ceeb8d8e055e72d2e30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:57.729919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.736479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8b57ad4ab34ff29258f3f1cf91f440', 'request_id': 'req-660abac7-6b74-4be7-ba43-a89541ab9e21'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:57.745188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8b57ad4ab34ff29258f3f1cf91f440', 'request_id': 'req-660abac7-6b74-4be7-ba43-a89541ab9e21'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:57.756160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8b57ad4ab34ff29258f3f1cf91f440', 'request_id': 'req-660abac7-6b74-4be7-ba43-a89541ab9e21'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:57.773310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] The token cache is being invalidate because project ad8b57ad4ab34ff29258f3f1cf91f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:57.773602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:57.774527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:57.777844 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3307/6551] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:57 2022] DELETE /identity/v3/projects/ad8b57ad4ab34ff29258f3f1cf91f440 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:57.781405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.783190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:57.821240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2cfb-87c8-4cde-9212-8b6d64eca0d5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.878568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660abac7-6b74-4be7-ba43-a89541ab9e21 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:57.884508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.886021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.886413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.886912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] PATH_INFO: `/v3/users/8254c494fba340d28b630f5e30afd344` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.888983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8254c494fba340d28b630f5e30afd344)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.891629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.948079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:57.948792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:57.949038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:57.949318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:57.950126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:57.952387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:57.957722 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:57.981851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3245/6552] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:57 2022] POST /identity/v3/domains => generated 276 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:57.983208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:57.996861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:58.037157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8254c494fba340d28b630f5e30afd344'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:58.038308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8254c494fba340d28b630f5e30afd344'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:58.052906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8254c494fba340d28b630f5e30afd344'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:58.067650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8254c494fba340d28b630f5e30afd344'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:58.096388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8254c494fba340d28b630f5e30afd344'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:58.111548 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3308/6553] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:39:57 2022] DELETE /identity/v3/users/8254c494fba340d28b630f5e30afd344 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:58.172233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8a110-5536-401d-9836-0de026066111 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:58.329796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:58.330725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:58.331214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:58.331587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:58.332672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:58.334768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:58.356851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3246/6554] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:39:57 2022] POST /identity/v3/roles => generated 239 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:58.361014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:58.362752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:58.390185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9fdb-0988-4a77-831a-289f29e76a41 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:58.398714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:58.399508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:58.400415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:58.400928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:58.401931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:58.406620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:58.447478 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:58.482480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3309/6555] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:39:58 2022] POST /identity/v3/groups => generated 326 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:58.486690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:58.511268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927506e-3efa-41f0-bf68-ea7b3965448b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:58.515995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:58.516907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:58.517195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:58.517471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/59b605575187414ab1c59dd7ff6d3bd0/users/d9d96ab18bf84772ab2c1d56f886cb83` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:58.523743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:58.526895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:58.552549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=59b605575187414ab1c59dd7ff6d3bd0, user_id=d9d96ab18bf84772ab2c1d56f886cb83)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:58.554045 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:39:58.554045 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:39:58.554045 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:39:58.557485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:58.668161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3247/6556] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:39:58 2022] PUT /identity/v3/groups/59b605575187414ab1c59dd7ff6d3bd0/users/d9d96ab18bf84772ab2c1d56f886cb83 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:58.682644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:58.771138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c640b-0a24-4611-96a4-8a89560f3aba tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:58.862824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:58.863785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:58.864222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:58.864382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] PATH_INFO: `/v3/projects/2aa4973385a644dba9f749b621e18978` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:58.865833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa4973385a644dba9f749b621e18978)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:58.867940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:58.879732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755ee3b-f40c-4690-b648-a8fb7f61bac5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:58.895382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:58.898200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:58.898495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:58.898781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3be51178a221418085ee518a21e5c7bb/groups/59b605575187414ab1c59dd7ff6d3bd0/roles/e8d63d5cb1464a229bfb69dcb4d33250` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:58.920503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3be51178a221418085ee518a21e5c7bb, group_id=59b605575187414ab1c59dd7ff6d3bd0, role_id=e8d63d5cb1464a229bfb69dcb4d33250)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:58.925255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:58.965785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3248/6557] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:39:58 2022] PUT /identity/v3/domains/3be51178a221418085ee518a21e5c7bb/groups/59b605575187414ab1c59dd7ff6d3bd0/roles/e8d63d5cb1464a229bfb69dcb4d33250 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:58.972010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:58.986077 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:59.037015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa4973385a644dba9f749b621e18978', 'request_id': 'req-f7b1660a-8325-4491-9b6a-0449b5fe96fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:59.062494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa4973385a644dba9f749b621e18978', 'request_id': 'req-f7b1660a-8325-4491-9b6a-0449b5fe96fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:59.083629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa4973385a644dba9f749b621e18978', 'request_id': 'req-f7b1660a-8325-4491-9b6a-0449b5fe96fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:59.087748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50350ee-ae7d-4477-93d9-ecb25fdfced5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.127910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] The token cache is being invalidate because project 2aa4973385a644dba9f749b621e18978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:39:59.129023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:59.131159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:39:59.140735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3310/6558] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:39:58 2022] DELETE /identity/v3/projects/2aa4973385a644dba9f749b621e18978 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:39:59.223802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.225753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.226784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.227713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.235265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.241591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.277665 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3249/6559] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:58 2022] POST /identity/v3/domains => generated 277 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:59.281890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.283578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:39:59.303567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1660a-8325-4491-9b6a-0449b5fe96fe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.352313 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:39:59.400424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.401878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.402971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.406065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.406065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.406065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.437827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.445942 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3311/6560] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:39:59 2022] POST /identity/v3/roles => generated 239 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:59.456880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f298c87-bc9b-442b-b484-eb36a6d5a814 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.462377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.463837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.464115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.464391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/cee39db8c7e548a1a94429645c816a80/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/3dd35749ef2f42fdbbbc0db5cefaf389` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.480647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cee39db8c7e548a1a94429645c816a80, user_id=d9d96ab18bf84772ab2c1d56f886cb83, role_id=3dd35749ef2f42fdbbbc0db5cefaf389)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.484117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.505861 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3250/6561] 10.222.0.27 () {60 vars in 1479 bytes} [Sun Jul 24 01:39:59 2022] PUT /identity/v3/domains/cee39db8c7e548a1a94429645c816a80/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/3dd35749ef2f42fdbbbc0db5cefaf389 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:39:59.507403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.525621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd206b-cdfd-44fa-a519-6af56089fb08 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.616164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.617484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.617936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.618223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.619900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.621550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.656597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.669916 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3312/6562] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:39:59 2022] POST /identity/v3/domains => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:39:59.682183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d8d36-91dc-4cfc-aead-53ef329f1791 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.795018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.795775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.797077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.797652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.798632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.803788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.845918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3251/6563] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:39:59 2022] POST /identity/v3/roles => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:59.846930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.874524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269d878-faff-46dc-ae3e-8503868f0214 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.885706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.886943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.886943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.887396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.888353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.890732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.923873 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3313/6564] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:39:59 2022] POST /identity/v3/groups => generated 327 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:39:59.925033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:39:59.937704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7939-3a9a-46c1-a601-122bd241db75 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:39:59.943113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:39:59.944216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:39:59.944510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:39:59.944782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/06e0a5b24c43455c92f3beea9634a76e/users/d9d96ab18bf84772ab2c1d56f886cb83` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:39:59.952212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=06e0a5b24c43455c92f3beea9634a76e, user_id=d9d96ab18bf84772ab2c1d56f886cb83)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:39:59.955596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:39:59.966522 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:00.007616 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3252/6565] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:39:59 2022] PUT /identity/v3/groups/06e0a5b24c43455c92f3beea9634a76e/users/d9d96ab18bf84772ab2c1d56f886cb83 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:00.013299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:00.030202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c3935-5242-49e6-9e2e-540c38869ec5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:00.108973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:00.110253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:00.110835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:00.111275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81/groups/06e0a5b24c43455c92f3beea9634a76e/roles/ad27f4eeb18e478bb2efd715eb4d8e1e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:00.113976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b13bb2b2c7b04bd8b2fe11fd41c7ff81, group_id=06e0a5b24c43455c92f3beea9634a76e, role_id=ad27f4eeb18e478bb2efd715eb4d8e1e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:00.119921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:00.152629 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3314/6566] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:00 2022] PUT /identity/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81/groups/06e0a5b24c43455c92f3beea9634a76e/roles/ad27f4eeb18e478bb2efd715eb4d8e1e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:00.153829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:00.156206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:00.376784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aad962-64d9-441c-baac-429f69aea407 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:00.559911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d96ab18bf84772ab2c1d56f886cb83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a929c6e254814a4e8bf693cbc4559212', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:00.560624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:00.561310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:00.561310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] PATH_INFO: `/v3/auth/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:00.561917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:00.563018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:00.702855 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:00.730596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:00.733131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:00.747960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3253/6567] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:40:00 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:40:00.748909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:00.795621 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:00.836048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32888-2f10-4504-b9b1-fce33fa55b48 tempest-TokensV3TestJSON-1867315840 tempest-TokensV3TestJSON-1867315840-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:00.841361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:00.842558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:00.842984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:00.843635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81/groups/06e0a5b24c43455c92f3beea9634a76e/roles/ad27f4eeb18e478bb2efd715eb4d8e1e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:00.846756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b13bb2b2c7b04bd8b2fe11fd41c7ff81, group_id=06e0a5b24c43455c92f3beea9634a76e, role_id=ad27f4eeb18e478bb2efd715eb4d8e1e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:00.849725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:00.863149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role ad27f4eeb18e478bb2efd715eb4d8e1e was removed from group 06e0a5b24c43455c92f3beea9634a76e on domain b13bb2b2c7b04bd8b2fe11fd41c7ff81. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:00.863149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:00.863149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:00.887374 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3254/6568] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:40:00 2022] DELETE /identity/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81/groups/06e0a5b24c43455c92f3beea9634a76e/roles/ad27f4eeb18e478bb2efd715eb4d8e1e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:00.888248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a927-9d73-4118-9656-7b47e96ea960 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:00.891929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:00.894170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:00.999672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64b7a-caca-4bc5-8ec5-67ef84f8f46f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:01.005318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:01.006278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:01.006703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:01.006986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/06e0a5b24c43455c92f3beea9634a76e/users/d9d96ab18bf84772ab2c1d56f886cb83` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:01.009088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=06e0a5b24c43455c92f3beea9634a76e, user_id=d9d96ab18bf84772ab2c1d56f886cb83)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:01.010239 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:40:01.010239 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:40:01.010239 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:40:01.012636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:01.031380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.072476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3255/6569] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:40:00 2022] DELETE /identity/v3/groups/06e0a5b24c43455c92f3beea9634a76e/users/d9d96ab18bf84772ab2c1d56f886cb83 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:01.079636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:01.082282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:01.082677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:01.082886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:01.083164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:01.085227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:01.222291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:01.224958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:01.254211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049b770-b0fa-4df4-9c45-a3aceff18b9a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:01.280635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:01.282184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:01.282624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:01.283722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3315/6570] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:01.289642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/06e0a5b24c43455c92f3beea9634a76e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:01.296174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_group(group_id=06e0a5b24c43455c92f3beea9634a76e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:01.298769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:01.307454 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:01.395968 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3256/6571] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:40:01 2022] DELETE /identity/v3/groups/06e0a5b24c43455c92f3beea9634a76e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:01.401051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:01.420872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b222c-dc2c-4af7-a221-39a29b454637 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:01.536531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:01.537419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:01.537727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:01.538014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles/ad27f4eeb18e478bb2efd715eb4d8e1e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:01.539566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad27f4eeb18e478bb2efd715eb4d8e1e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:01.542733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:01.544533 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:01.661991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role ad27f4eeb18e478bb2efd715eb4d8e1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:01.662359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.666474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.671168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3316/6572] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:01 2022] DELETE /identity/v3/roles/ad27f4eeb18e478bb2efd715eb4d8e1e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:01.675386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:01.677584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:01.697891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e661e-8635-4bb2-991e-bf96503ac5f1 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:01.797081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:01.797997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:01.798286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:01.798566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:01.799990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b13bb2b2c7b04bd8b2fe11fd41c7ff81)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:01.803186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:01.848739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.850340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.879679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.880404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:01.884945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3257/6573] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:01 2022] PATCH /identity/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81 => generated 276 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:01.888666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:01.902806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cd882-7d19-4b18-a4f2-7f12ccd75a1f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:02.073562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:02.074729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:02.075208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:02.085531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:02.106297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b13bb2b2c7b04bd8b2fe11fd41c7ff81)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:02.113434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:02.175326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.198480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.312587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.359797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.380546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.414621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project b13bb2b2c7b04bd8b2fe11fd41c7ff81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:02.414929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.421709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.460298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.470776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.471753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b13bb2b2c7b04bd8b2fe11fd41c7ff81', 'request_id': 'req-c6eb2061-3b11-47b2-a352-ff4dac51775b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.493523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3317/6574] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:40:01 2022] DELETE /identity/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:02.497444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:02.499021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:02.530857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a783ed-d144-4f40-bc86-102ea960ad53 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:02.656738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:02.657603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:02.658110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:02.658403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/cee39db8c7e548a1a94429645c816a80/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/3dd35749ef2f42fdbbbc0db5cefaf389` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:02.684707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cee39db8c7e548a1a94429645c816a80, user_id=d9d96ab18bf84772ab2c1d56f886cb83, role_id=3dd35749ef2f42fdbbbc0db5cefaf389)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:02.694500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:02.709349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role 3dd35749ef2f42fdbbbc0db5cefaf389 was removed from user d9d96ab18bf84772ab2c1d56f886cb83 on domain cee39db8c7e548a1a94429645c816a80. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:02.709349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.710289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.748629 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3258/6575] 10.222.0.27 () {58 vars in 1463 bytes} [Sun Jul 24 01:40:02 2022] DELETE /identity/v3/domains/cee39db8c7e548a1a94429645c816a80/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/3dd35749ef2f42fdbbbc0db5cefaf389 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:02.752445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:02.754493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:02.772106 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:02.792984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb2061-3b11-47b2-a352-ff4dac51775b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:02.913102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:02.914101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:02.914487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:02.914876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles/3dd35749ef2f42fdbbbc0db5cefaf389` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:02.917326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3dd35749ef2f42fdbbbc0db5cefaf389)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:02.919156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:02.990560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role 3dd35749ef2f42fdbbbc0db5cefaf389 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:02.990853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.991512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:02.994541 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3318/6576] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:02 2022] DELETE /identity/v3/roles/3dd35749ef2f42fdbbbc0db5cefaf389 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:02.998609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:03.000089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:03.018605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba71aa-6b61-42ec-a696-a6907beb56c4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:03.042015 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:03.132842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:03.133887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:03.134683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:03.134966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/cee39db8c7e548a1a94429645c816a80` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:03.136780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cee39db8c7e548a1a94429645c816a80)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:03.138621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:03.195295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.196171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.232541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.233365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.236292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3259/6577] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:02 2022] PATCH /identity/v3/domains/cee39db8c7e548a1a94429645c816a80 => generated 278 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:40:03.241283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:03.245535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:03.287636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d7e43-676b-4a90-9afd-3eb22d3f5fe4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:03.407237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:03.408941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:03.409427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:03.409927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/cee39db8c7e548a1a94429645c816a80` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:03.424199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cee39db8c7e548a1a94429645c816a80)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:03.426393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:03.454714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.466734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cee39db8c7e548a1a94429645c816a80'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.563516 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:03.599849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.629436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.649093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.724859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project cee39db8c7e548a1a94429645c816a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:03.725172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.728453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.744837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.745638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.746423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cee39db8c7e548a1a94429645c816a80', 'request_id': 'req-9bce740e-51ff-4129-a65b-a29da53f91db'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.768688 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3319/6578] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:40:03 2022] DELETE /identity/v3/domains/cee39db8c7e548a1a94429645c816a80 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:03.770409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:03.775208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:03.828249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e112286-d804-4a8e-913f-d7a712024671 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:03.938924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:03.940150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:03.940606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:03.941200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3be51178a221418085ee518a21e5c7bb/groups/59b605575187414ab1c59dd7ff6d3bd0/roles/e8d63d5cb1464a229bfb69dcb4d33250` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:03.944216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3be51178a221418085ee518a21e5c7bb, group_id=59b605575187414ab1c59dd7ff6d3bd0, role_id=e8d63d5cb1464a229bfb69dcb4d33250)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:03.948533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:03.956252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role e8d63d5cb1464a229bfb69dcb4d33250 was removed from group 59b605575187414ab1c59dd7ff6d3bd0 on domain 3be51178a221418085ee518a21e5c7bb. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:03.959948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.960915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:03.988874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3260/6579] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:40:03 2022] DELETE /identity/v3/domains/3be51178a221418085ee518a21e5c7bb/groups/59b605575187414ab1c59dd7ff6d3bd0/roles/e8d63d5cb1464a229bfb69dcb4d33250 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:03.993604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:03.995144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:04.023879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce740e-51ff-4129-a65b-a29da53f91db tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:04.172745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:04.173724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:04.174019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:04.174294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/59b605575187414ab1c59dd7ff6d3bd0/users/d9d96ab18bf84772ab2c1d56f886cb83` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:04.179732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=59b605575187414ab1c59dd7ff6d3bd0, user_id=d9d96ab18bf84772ab2c1d56f886cb83)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:04.183896 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:40:04.183896 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:40:04.183896 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:40:04.186185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:04.211852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:04.243835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3320/6580] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:40:03 2022] DELETE /identity/v3/groups/59b605575187414ab1c59dd7ff6d3bd0/users/d9d96ab18bf84772ab2c1d56f886cb83 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:04.249256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:04.251041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:04.281438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298c6d0-faac-4392-9dac-45334510797f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:04.435621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:04.436593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:04.436982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:04.437275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/groups/59b605575187414ab1c59dd7ff6d3bd0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:04.439826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_group(group_id=59b605575187414ab1c59dd7ff6d3bd0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:04.441910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:04.456730 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:04.511918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3261/6581] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:40:04 2022] DELETE /identity/v3/groups/59b605575187414ab1c59dd7ff6d3bd0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:04.515824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:04.526845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcda79-8b62-4494-95df-ab85e831d12d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:04.612475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:04.613352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:04.613642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:04.614108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles/e8d63d5cb1464a229bfb69dcb4d33250` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:04.615697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e8d63d5cb1464a229bfb69dcb4d33250)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:04.617332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:04.670687 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:04.688474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role e8d63d5cb1464a229bfb69dcb4d33250 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:04.689165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:04.690203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:04.693506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3321/6582] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:04 2022] DELETE /identity/v3/roles/e8d63d5cb1464a229bfb69dcb4d33250 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:04.698421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:04.700276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:04.722707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b2cd-d439-49a8-bd7d-d2a82e58c046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:04.887414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:04.893334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:04.893334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:04.893334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3be51178a221418085ee518a21e5c7bb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:04.896190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3be51178a221418085ee518a21e5c7bb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:04.898116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:04.948848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:04.950533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.004183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.004918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.013755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:05.014787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3262/6583] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:04 2022] PATCH /identity/v3/domains/3be51178a221418085ee518a21e5c7bb => generated 277 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:05.025457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3f35-24b6-416e-a399-e21c2f5eae24 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:05.106328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:05.107353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:05.107743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:05.108145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3be51178a221418085ee518a21e5c7bb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:05.126617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3be51178a221418085ee518a21e5c7bb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:05.129125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:05.161453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.175388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3be51178a221418085ee518a21e5c7bb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.220274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.226454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.236059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.251010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project 3be51178a221418085ee518a21e5c7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:05.251339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.252457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.261558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.262241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.263135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3be51178a221418085ee518a21e5c7bb', 'request_id': 'req-399919ee-c410-4948-99ec-cdd9feef5c38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.273598 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3322/6584] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:40:05 2022] DELETE /identity/v3/domains/3be51178a221418085ee518a21e5c7bb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:05.278365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:05.279844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:05.292834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e213e85-d643-4039-8c2b-a00e84970ca4 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:05.391463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:05.392642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:05.393006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:05.393353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3398801f056b4dd68e3fa82c6f548b6c/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/5e89826abf774ceeb8d8e055e72d2e30` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:05.396059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3398801f056b4dd68e3fa82c6f548b6c, user_id=d9d96ab18bf84772ab2c1d56f886cb83, role_id=5e89826abf774ceeb8d8e055e72d2e30)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:05.399092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:05.405443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role 5e89826abf774ceeb8d8e055e72d2e30 was removed from user d9d96ab18bf84772ab2c1d56f886cb83 on domain 3398801f056b4dd68e3fa82c6f548b6c. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:05.405850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.406639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.432002 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3263/6585] 10.222.0.27 () {58 vars in 1463 bytes} [Sun Jul 24 01:40:05 2022] DELETE /identity/v3/domains/3398801f056b4dd68e3fa82c6f548b6c/users/d9d96ab18bf84772ab2c1d56f886cb83/roles/5e89826abf774ceeb8d8e055e72d2e30 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:05.436420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:05.438906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:05.458477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399919ee-c410-4948-99ec-cdd9feef5c38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:05.566244 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:05.616940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:05.617873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:05.618352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:05.618862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles/5e89826abf774ceeb8d8e055e72d2e30` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:05.621586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5e89826abf774ceeb8d8e055e72d2e30)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:05.623782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:05.696733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role 5e89826abf774ceeb8d8e055e72d2e30 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:05.697162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.698831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.708871 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3323/6586] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:05 2022] DELETE /identity/v3/roles/5e89826abf774ceeb8d8e055e72d2e30 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:05.710112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:05.712497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:05.736422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4769-becd-4675-9bf8-35d8ae3640fe tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:05.795394 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:05.851420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:05.853556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:05.854119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:05.854619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3398801f056b4dd68e3fa82c6f548b6c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:05.856780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3398801f056b4dd68e3fa82c6f548b6c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:05.859580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:05.892238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.893764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.967455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.968428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:05.976382 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3264/6587] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:05 2022] PATCH /identity/v3/domains/3398801f056b4dd68e3fa82c6f548b6c => generated 277 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:05.980501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:05.982588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:06.000942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101ff92-421c-41e3-8cbb-961342cd275e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.165902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.166840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.167071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.167352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3398801f056b4dd68e3fa82c6f548b6c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.197485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3398801f056b4dd68e3fa82c6f548b6c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.201558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.246273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.260082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.363463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.375468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.384903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.387158 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:06.419454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project 3398801f056b4dd68e3fa82c6f548b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:06.421902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.424915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.437107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:06.437478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:06.454986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.455908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.457344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3398801f056b4dd68e3fa82c6f548b6c', 'request_id': 'req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.481280 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3324/6588] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:40:05 2022] DELETE /identity/v3/domains/3398801f056b4dd68e3fa82c6f548b6c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:06.485187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:06.486894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:06.558008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f3d90-9ff5-4a19-a430-e2c1e960cc90 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.630018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5131d6-6554-40d1-aa41-d4ac0f3fef55 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.639348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.640126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.641804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.642095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.643450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.644474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.659932 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3325/6589] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:06.664649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:06.684406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020537-5496-4921-8135-45359900dcef tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.691689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.692702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.693003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.693287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.697825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:06.703235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.704151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.704438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.704713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/ad636792583a41c3a6b52754f779172e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.707657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ad636792583a41c3a6b52754f779172e, user_id=3541b25895454cba9503d24774248597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.710567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.740812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3326/6590] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:06 2022] PUT /identity/v3/projects/ad636792583a41c3a6b52754f779172e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:06.742158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:06.821868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.824044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.829028 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:06.840155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecbee1-26cc-4626-8bf6-a4fef007bf9d tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.841811 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3265/6591] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:06.869566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.870261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.870552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.870834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.871497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.873025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.928549 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3327/6592] 10.222.0.27 () {58 vars in 1145 bytes} [Sun Jul 24 01:40:06 2022] GET /identity/v3/auth/projects => generated 826 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:06.933183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:06.945782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5625a-214f-4256-8572-2c190a336c84 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:06.953324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:06.954573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:06.955200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:06.955840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/ad636792583a41c3a6b52754f779172e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:06.960490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ad636792583a41c3a6b52754f779172e, user_id=3541b25895454cba9503d24774248597, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:06.964477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:06.972292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role acd1f0a52de7401597f9dc3d88354f7e was removed from user 3541b25895454cba9503d24774248597 on project ad636792583a41c3a6b52754f779172e. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:06.972914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:06.973875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:07.009031 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3266/6593] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:40:06 2022] DELETE /identity/v3/projects/ad636792583a41c3a6b52754f779172e/users/3541b25895454cba9503d24774248597/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:07.014585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:07.017163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:07.054459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10cd13-846e-47e5-8839-012ab2021a38 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:07.140085 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:07.208545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:07.209601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:07.209973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:07.210924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:07.214634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:07.216650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:07.272363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3328/6594] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:07 2022] POST /identity/v3/users => generated 321 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:07.273541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:07.296481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be40f-6f1b-4904-ac56-63a9852567b5 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:07.313123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:07.314486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:07.315014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:07.315529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:07.316470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:07.318651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:07.370823 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3267/6595] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:07 2022] POST /identity/v3/projects => generated 364 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:07.374684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:07.391005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2921b7-9fbf-400f-a8db-23b3d5353e9e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:07.507046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:07.507978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:07.508686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:07.510149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:07.527385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:07.533148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:07.600716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:07.605051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3329/6596] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:07 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:07.615784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098b84-7546-488e-965f-3b3d7520aa6e tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:07.777445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:07.778366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:07.778902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:07.780851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:07.781771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:07.785489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:07.816122 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3268/6597] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:40:07 2022] POST /identity/v3/roles => generated 239 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:07.819984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:07.832783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960962-6c83-48cb-a896-63dbb9bb39ae tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:07.867213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:07.872011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:07.876364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:07.876978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/20e319e032054e1d8ca6f5357096cf39/users/49bbeb0d9b7340bbb3653eaae115b252/roles/dddba26a175948b188a265e59797332e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:07.945558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(project_id=20e319e032054e1d8ca6f5357096cf39, user_id=49bbeb0d9b7340bbb3653eaae115b252, role_id=dddba26a175948b188a265e59797332e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:07.955851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478b9d-94d9-42e9-b57d-9d814e415046 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:08.009005 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3330/6598] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:07 2022] PUT /identity/v3/projects/20e319e032054e1d8ca6f5357096cf39/users/49bbeb0d9b7340bbb3653eaae115b252/roles/dddba26a175948b188a265e59797332e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:08.013141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:08.028137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b734-d81c-4a63-b397-4909444b6caa tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:08.171462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:08.172468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:08.172854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:08.173362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2/users/49bbeb0d9b7340bbb3653eaae115b252/roles/dddba26a175948b188a265e59797332e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:08.178039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:create_grant(project_id=80979a9a52d743f7a1b1bd3eb21cc6f2, user_id=49bbeb0d9b7340bbb3653eaae115b252, role_id=dddba26a175948b188a265e59797332e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:08.181150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3ae1-bf75-4087-838e-dadca979a491 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:08.223426 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3269/6599] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:08 2022] PUT /identity/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2/users/49bbeb0d9b7340bbb3653eaae115b252/roles/dddba26a175948b188a265e59797332e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:08.229888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:08.230354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:08.230435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:08.286912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] MFA Rules not processed for user `49bbeb0d9b7340bbb3653eaae115b252`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:08.288307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:08.301037 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3331/6600] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:08 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:40:08.302568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95957-fe9c-4a69-92e8-aa00acf660e2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:08.302869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95957-fe9c-4a69-92e8-aa00acf660e2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:08.303255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f95957-fe9c-4a69-92e8-aa00acf660e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:08.323830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f7f95957-fe9c-4a69-92e8-aa00acf660e2 None None] MFA Rules not processed for user `49bbeb0d9b7340bbb3653eaae115b252`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:08.325403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7f95957-fe9c-4a69-92e8-aa00acf660e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:08.457246 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:08.497983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3270/6601] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:08 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 24 01:40:08.502139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:08.724290 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:08.738106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ff7d1-84aa-4fb9-8919-3380b5eac094 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:08.749416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:08.750130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:08.750423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:08.750705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:08.773356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:08.777281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:08.807445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3332/6602] 10.222.0.27 () {56 vars in 1307 bytes} [Sun Jul 24 01:40:08 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:08.812021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:08.812408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:08.812810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:08.830395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] MFA Rules not processed for user `49bbeb0d9b7340bbb3653eaae115b252`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:08.831900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:08.982367 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3271/6603] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:08 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 24 01:40:08.984208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:09.000053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018302e-45c9-456d-a577-6dffd72b7c64 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:09.007313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:09.008325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:09.008626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:09.008944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/roles/dddba26a175948b188a265e59797332e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:09.011698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dddba26a175948b188a265e59797332e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:09.013624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:09.135228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invalidating the token cache because role dddba26a175948b188a265e59797332e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:09.135674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.137114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.142913 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3333/6604] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:08 2022] DELETE /identity/v3/roles/dddba26a175948b188a265e59797332e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:09.147321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:09.178891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b6a04-ec08-4b6b-a598-d1d31b059293 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:09.349229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:09.350529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:09.351015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:09.351488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:09.354559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80979a9a52d743f7a1b1bd3eb21cc6f2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:09.357022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:09.469101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80979a9a52d743f7a1b1bd3eb21cc6f2', 'request_id': 'req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.517259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80979a9a52d743f7a1b1bd3eb21cc6f2', 'request_id': 'req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.531914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80979a9a52d743f7a1b1bd3eb21cc6f2', 'request_id': 'req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.553847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project 80979a9a52d743f7a1b1bd3eb21cc6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:09.554176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.556420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.558388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3272/6605] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:09 2022] DELETE /identity/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:09.562316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:09.563883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:09.582541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc5a0-1fe9-48e7-9a3c-651a8c20914a tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:09.697963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:09.698845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:09.699124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:09.699397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:09.707049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80979a9a52d743f7a1b1bd3eb21cc6f2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:09.708916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Could not find project: 80979a9a52d743f7a1b1bd3eb21cc6f2.: keystone.exception.ProjectNotFound: Could not find project: 80979a9a52d743f7a1b1bd3eb21cc6f2. Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 24 01:40:09.733532 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 80979a9a52d743f7a1b1bd3eb21cc6f2. Jul 24 01:40:09.734745 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:09.735357 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3334/6606] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:09 2022] DELETE /identity/v3/projects/80979a9a52d743f7a1b1bd3eb21cc6f2 => generated 113 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:40:09.739156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:09.740612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:09.753710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4337a-ec96-4e3b-81eb-b1bf52fb79f3 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:09.758687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:09.759587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:09.759871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:09.760147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/projects/20e319e032054e1d8ca6f5357096cf39` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:09.761386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20e319e032054e1d8ca6f5357096cf39)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:09.764701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:09.804044 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:09.871228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e319e032054e1d8ca6f5357096cf39', 'request_id': 'req-27c5966a-2186-46cd-a028-ebb679ef5d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.879321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e319e032054e1d8ca6f5357096cf39', 'request_id': 'req-27c5966a-2186-46cd-a028-ebb679ef5d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.887711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e319e032054e1d8ca6f5357096cf39', 'request_id': 'req-27c5966a-2186-46cd-a028-ebb679ef5d5f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.914965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] The token cache is being invalidate because project 20e319e032054e1d8ca6f5357096cf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:09.916131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.919175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:09.923318 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3273/6607] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:09 2022] DELETE /identity/v3/projects/20e319e032054e1d8ca6f5357096cf39 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:09.927780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:09.930702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:09.960461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ecc7-02fc-4e94-ae6b-6c53b1491a87 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.074531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.075435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.075718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.075994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/users/49bbeb0d9b7340bbb3653eaae115b252` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.079746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49bbeb0d9b7340bbb3653eaae115b252)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:10.081696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:10.208090 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:10.218197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bbeb0d9b7340bbb3653eaae115b252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.219344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bbeb0d9b7340bbb3653eaae115b252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.233740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bbeb0d9b7340bbb3653eaae115b252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.245133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bbeb0d9b7340bbb3653eaae115b252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.273280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bbeb0d9b7340bbb3653eaae115b252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.293215 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3335/6608] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:09 2022] DELETE /identity/v3/users/49bbeb0d9b7340bbb3653eaae115b252 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:10.304436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:10.317246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5966a-2186-46cd-a028-ebb679ef5d5f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.401742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.403008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.403539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.404011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.414046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Could not find domain: b13bb2b2c7b04bd8b2fe11fd41c7ff81.: keystone.exception.DomainNotFound: Could not find domain: b13bb2b2c7b04bd8b2fe11fd41c7ff81. Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b13bb2b2c7b04bd8b2fe11fd41c7ff81. Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:40:10.426223 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:40:10.427489 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b13bb2b2c7b04bd8b2fe11fd41c7ff81. Jul 24 01:40:10.428929 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.432690 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3274/6609] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:10 2022] PATCH /identity/v3/domains/b13bb2b2c7b04bd8b2fe11fd41c7ff81 => generated 112 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:40:10.436912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:10.438973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:10.481353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951dfa1-4067-4253-bdc9-4f261d491fd2 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.514441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.515354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.515644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.515930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/cee39db8c7e548a1a94429645c816a80` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.525690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Could not find domain: cee39db8c7e548a1a94429645c816a80.: keystone.exception.DomainNotFound: Could not find domain: cee39db8c7e548a1a94429645c816a80. Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cee39db8c7e548a1a94429645c816a80. Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:40:10.537412 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:40:10.538473 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cee39db8c7e548a1a94429645c816a80. Jul 24 01:40:10.539397 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.543385 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3336/6610] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:10 2022] PATCH /identity/v3/domains/cee39db8c7e548a1a94429645c816a80 => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:40:10.544073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:10.555132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbc4d-6448-4121-bf84-9ee728e2986b tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.561191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.562097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.562383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.562659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3be51178a221418085ee518a21e5c7bb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.574095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Could not find domain: 3be51178a221418085ee518a21e5c7bb.: keystone.exception.DomainNotFound: Could not find domain: 3be51178a221418085ee518a21e5c7bb. Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3be51178a221418085ee518a21e5c7bb. Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:40:10.600870 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:40:10.601952 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3be51178a221418085ee518a21e5c7bb. Jul 24 01:40:10.603876 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:40:10.613320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:10.628013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3275/6611] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:10 2022] PATCH /identity/v3/domains/3be51178a221418085ee518a21e5c7bb => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:40:10.629986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653fac1-9818-4d90-a862-cbe8903059ad tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.637729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3541b25895454cba9503d24774248597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0687338502474d2382bad7d8c505cf5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.639683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.640348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.641021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] PATH_INFO: `/v3/domains/3398801f056b4dd68e3fa82c6f548b6c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.651133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-857fc3e9-2fb0-4298-9401-904c50be0c20 tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Could not find domain: 3398801f056b4dd68e3fa82c6f548b6c.: keystone.exception.DomainNotFound: Could not find domain: 3398801f056b4dd68e3fa82c6f548b6c. Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3398801f056b4dd68e3fa82c6f548b6c. Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:40:10.662333 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:40:10.663317 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3398801f056b4dd68e3fa82c6f548b6c. Jul 24 01:40:10.664245 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:40:10.672097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3337/6612] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:40:10 2022] PATCH /identity/v3/domains/3398801f056b4dd68e3fa82c6f548b6c => generated 112 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:40:10.672405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:10.674443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:10.766224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb14fc9-1eb3-426b-8a23-2359fe3e183f tempest-TokensV3TestJSON-177938121 tempest-TokensV3TestJSON-177938121-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:10.786988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:10.794508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.795811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.796113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] PATH_INFO: `/v3/users/eb96c2ca89af40ee9afbaac3cb0d8d08` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.797892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb96c2ca89af40ee9afbaac3cb0d8d08)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:10.799897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:10.860203 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:10.876412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb96c2ca89af40ee9afbaac3cb0d8d08'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.887804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb96c2ca89af40ee9afbaac3cb0d8d08'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.897227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb96c2ca89af40ee9afbaac3cb0d8d08'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.929471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb96c2ca89af40ee9afbaac3cb0d8d08'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.931232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb96c2ca89af40ee9afbaac3cb0d8d08'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:10.941981 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3276/6613] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:10 2022] DELETE /identity/v3/users/eb96c2ca89af40ee9afbaac3cb0d8d08 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:10.944033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:10.944322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:10.944602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:10.985311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:10.986845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:11.138399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3338/6614] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:11.152697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:11.156208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:11.288928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12fc73-6bf3-474f-8cb8-28665058a377 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:11.294902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:11.296067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:11.296504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:11.296644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:11.311258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:11.313266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:11.327971 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3277/6615] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:11.815276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:11.816759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:11.839456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a72b6-5291-4160-b073-d08a98c91753 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:11.848238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:11.849288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:11.849566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:11.849862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] PATH_INFO: `/v3/projects/ad636792583a41c3a6b52754f779172e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:11.854431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad636792583a41c3a6b52754f779172e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:11.859531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:11.943586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad636792583a41c3a6b52754f779172e', 'request_id': 'req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:11.950993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad636792583a41c3a6b52754f779172e', 'request_id': 'req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:11.972887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad636792583a41c3a6b52754f779172e', 'request_id': 'req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:11.991668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] The token cache is being invalidate because project ad636792583a41c3a6b52754f779172e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:11.991958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:11.994478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:11.997321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3339/6616] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:11 2022] DELETE /identity/v3/projects/ad636792583a41c3a6b52754f779172e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:12.000205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:12.018920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762cd9-bacc-4d17-b1ef-d79ae3f414b8 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:12.102039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:12.104171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:12.104920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:12.104920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] PATH_INFO: `/v3/users/3541b25895454cba9503d24774248597` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:12.106633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3541b25895454cba9503d24774248597)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:12.108806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:12.242711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3541b25895454cba9503d24774248597'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:12.255387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3541b25895454cba9503d24774248597'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:12.271086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3541b25895454cba9503d24774248597'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:12.273096 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:12.306584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3541b25895454cba9503d24774248597'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:12.307336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3541b25895454cba9503d24774248597'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:12.334003 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3278/6617] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:11 2022] DELETE /identity/v3/users/3541b25895454cba9503d24774248597 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:12.928505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:12.930867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:12.997095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4425-7396-4e2f-9cbe-3f36e4a70ac2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:13.043874 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:13.136979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:13.138803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:13.139084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:13.139356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] PATH_INFO: `/v3/projects/0687338502474d2382bad7d8c505cf5e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:13.142367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0687338502474d2382bad7d8c505cf5e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:13.144463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:13.282978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0687338502474d2382bad7d8c505cf5e', 'request_id': 'req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.294070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0687338502474d2382bad7d8c505cf5e', 'request_id': 'req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.309273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0687338502474d2382bad7d8c505cf5e', 'request_id': 'req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.327941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] The token cache is being invalidate because project 0687338502474d2382bad7d8c505cf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:13.328462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.329282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.332570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3340/6618] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:12 2022] DELETE /identity/v3/projects/0687338502474d2382bad7d8c505cf5e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:13.336591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:13.339921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:13.386540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf067-09d7-4227-a819-5abf46746d0c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:13.589802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:13.590835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:13.591188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:13.591560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] PATH_INFO: `/v3/users/d9d96ab18bf84772ab2c1d56f886cb83` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:13.593281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d96ab18bf84772ab2c1d56f886cb83)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:13.595404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:13.739290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.756477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.784710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.804523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.808035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca62dc50-01a1-4ccb-8ccc-4d3ad5bb429f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d96ab18bf84772ab2c1d56f886cb83'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:13.839745 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3279/6619] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:13 2022] DELETE /identity/v3/users/d9d96ab18bf84772ab2c1d56f886cb83 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:15.013309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:15.015787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:15.039189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4bd5-3a0b-4501-b094-d5c4749db3b4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:15.196085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:15.196869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.197211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:15.197412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] PATH_INFO: `/v3/projects/a929c6e254814a4e8bf693cbc4559212` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:15.198644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a929c6e254814a4e8bf693cbc4559212)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:15.200561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:15.295388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a929c6e254814a4e8bf693cbc4559212', 'request_id': 'req-14fb8264-06f1-48d6-991a-77c86afd4e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:15.306660 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:15.314659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a929c6e254814a4e8bf693cbc4559212', 'request_id': 'req-14fb8264-06f1-48d6-991a-77c86afd4e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:15.339371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a929c6e254814a4e8bf693cbc4559212', 'request_id': 'req-14fb8264-06f1-48d6-991a-77c86afd4e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:15.366604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] The token cache is being invalidate because project a929c6e254814a4e8bf693cbc4559212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:15.367143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:15.369840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-14fb8264-06f1-48d6-991a-77c86afd4e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:15.374165 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3341/6620] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:15 2022] DELETE /identity/v3/projects/a929c6e254814a4e8bf693cbc4559212 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:15.380525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.381043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:15.381140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:15.436265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:15.437509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:15.640457 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:15.705856 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3280/6621] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:15.707837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.708229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:15.708605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:15.751586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:15.757325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:15.780354 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3342/6622] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:15.784537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:15.801091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4f405-5dce-4157-a35d-73078f92f783 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:15.815626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:15.816318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.817011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:15.817315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:15.819683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:15.820238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:15.822974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:15.847291 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3281/6623] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:15.851466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:15.891146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a6f97-abc6-4eb6-aa39-81375d065911 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:15.923595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:15.924752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.925039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:15.925311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:15.926283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:15.931241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:15.943897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:15.945651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:15.980315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142521eb-59b5-4ac2-b65d-e1f6f0ca6bcf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:15.993058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:15.994596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:15.994878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.000442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] PATH_INFO: `/v3/users/f6a5e8716f324b53b51e8d34cb704321` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.000599 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3343/6624] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:15 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:16.001543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a5e8716f324b53b51e8d34cb704321)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.002586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:16.006993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.080261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a5e8716f324b53b51e8d34cb704321'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:16.090571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a5e8716f324b53b51e8d34cb704321'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:16.102924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a5e8716f324b53b51e8d34cb704321'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:16.122921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a5e8716f324b53b51e8d34cb704321'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:16.124129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a5e8716f324b53b51e8d34cb704321'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:16.134790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3282/6625] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:15 2022] DELETE /identity/v3/users/f6a5e8716f324b53b51e8d34cb704321 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:16.211480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b22f6-fa2f-48d1-893a-74e4031d24ad admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:16.405620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:16.408422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.408719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.410645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.412228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.421559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.471414 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3344/6626] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:16 2022] POST /identity/v3/users => generated 289 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:16.472512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:16.474116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:16.491781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3c00-f438-47c5-a228-d7d34c5944e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:16.500311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:16.501253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.501641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.502054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.503333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.505639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.526263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:16.534086 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3283/6627] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:40:16.538229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0a46-e192-49d7-b85f-8ffb50156325 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:16.549351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:16.550187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.550539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.550886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.553199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.553501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670c65a-b03e-43e4-8751-6e06404bbe74 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.582829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:16.590964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3345/6628] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:16.595573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322c186-f175-427d-97d5-2eeea17edb69 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:16.600911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:16.601909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.602852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.603242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] PATH_INFO: `/v3/projects/d52c34c5b76f4b5a8a552ba636349e93/users/e8b66ee23a0b4b689b881dfc14f60c5c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.629602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52c34c5b76f4b5a8a552ba636349e93, user_id=e8b66ee23a0b4b689b881dfc14f60c5c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.632900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.669981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.670550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.671089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.673034 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3284/6629] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:16 2022] PUT /identity/v3/projects/d52c34c5b76f4b5a8a552ba636349e93/users/e8b66ee23a0b4b689b881dfc14f60c5c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:16.726492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] MFA Rules not processed for user `e8b66ee23a0b4b689b881dfc14f60c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:16.726929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:16.785569 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:16.916928 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3346/6630] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:16.919871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:16.943963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064266ee-db1c-4e03-b12c-9e418b70ba8b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:16.949486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8b66ee23a0b4b689b881dfc14f60c5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd52c34c5b76f4b5a8a552ba636349e93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:16.950462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:16.950849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:16.958623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] PATH_INFO: `/v3/domains/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:16.960463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:16.963014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641191-8ff8-4b41-8ac0-669f1e5bd002 tempest-DefaultDomainTestJSON-438476547 tempest-DefaultDomainTestJSON-438476547-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:16.964831 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3285/6631] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:40:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:16.970482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:17.150636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e899b4-304f-4c89-87a4-2534a74d71af None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:17.156939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:17.161171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:17.161728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:17.164213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] PATH_INFO: `/v3/users/e8b66ee23a0b4b689b881dfc14f60c5c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:17.167013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b66ee23a0b4b689b881dfc14f60c5c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:17.174264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:17.282578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b66ee23a0b4b689b881dfc14f60c5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.284632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b66ee23a0b4b689b881dfc14f60c5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.304093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b66ee23a0b4b689b881dfc14f60c5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.315037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b66ee23a0b4b689b881dfc14f60c5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.330272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b66ee23a0b4b689b881dfc14f60c5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.339244 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3347/6632] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:16 2022] DELETE /identity/v3/users/e8b66ee23a0b4b689b881dfc14f60c5c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:17.343423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:17.343718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:17.344001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:17.369731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:17.371828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:17.525579 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3286/6633] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:17.600422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:17.602053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:17.626964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:17.628413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:17.663409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf58d-9748-4ec9-842b-31b4776cceaf None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:17.680156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:17.682186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:17.683407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:17.685305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] PATH_INFO: `/v3/projects/b97b2217fca247759ee6e9f15d150866` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:17.689875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97b2217fca247759ee6e9f15d150866)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:17.694415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:17.726975 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:17.731708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab03a38-78b2-42c3-a8ad-a7fc4afb1aff admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:17.733950 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:17.746654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:17.747354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:17.747644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:17.747924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:17.772279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:17.773799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67738e-f413-4997-9f83-09a385456fc5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:17.798868 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3348/6634] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:17.847543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97b2217fca247759ee6e9f15d150866', 'request_id': 'req-4c88b9d1-e44f-4b04-ab27-382c30025d21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.860476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97b2217fca247759ee6e9f15d150866', 'request_id': 'req-4c88b9d1-e44f-4b04-ab27-382c30025d21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.909418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97b2217fca247759ee6e9f15d150866', 'request_id': 'req-4c88b9d1-e44f-4b04-ab27-382c30025d21'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.941808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] The token cache is being invalidate because project b97b2217fca247759ee6e9f15d150866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:17.942111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.943616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4c88b9d1-e44f-4b04-ab27-382c30025d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:17.945791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3287/6635] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:17 2022] DELETE /identity/v3/projects/b97b2217fca247759ee6e9f15d150866 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:17.951308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:17.951750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:17.952103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:17.992079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:17.992079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:18.138596 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3349/6636] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:18.146699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.147130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.147520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.183913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:18.185500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:18.213923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3288/6637] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:18.217929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.234149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58334-3381-48a6-bf46-e39eaaddec6f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.253304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.254173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.254564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.254963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.255814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:18.256227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.257981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.278132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3350/6638] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:18.278732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.294643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20144dba-422c-46c7-9ede-85fcc396d5b2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.304689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.305814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.306682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.307198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.308109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.314789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.368148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3289/6639] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:18 2022] POST /identity/v3/projects => generated 395 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:18.372314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.393481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5375d55-a5e0-4788-bbc9-30f99de7fd38 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.573994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.574689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.574968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.575234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.576224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.578822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.616959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3351/6640] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:18 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:18.621597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.637103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c724c-fbde-4a91-8093-dcf6a6b4e159 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.650564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.651262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.651540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.652282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.652947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.655415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.689766 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3290/6641] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:18.694160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.712127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4562b-fa82-47ea-8866-4c934a1f95d6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.731317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.732092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.732451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.732819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.734425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.737898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.759907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3352/6642] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:18.764099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.795303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c246195-d5e3-4066-9825-29c7486fa0ce admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.815377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.816336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.816623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.816918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] PATH_INFO: `/v3/projects/faa2aefb6f8846fc9211fec841a4351d/users/d7cb0037a91f461f8f39e28fe3c1ba85/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.825852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:18.828256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:18.859267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f0f17-eb6f-4870-a5c2-5b0f737908fc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:18.887976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:18.889215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.889393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.889641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] PATH_INFO: `/v3/projects/d52c34c5b76f4b5a8a552ba636349e93` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:18.894479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52c34c5b76f4b5a8a552ba636349e93)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.905395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.910098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa2aefb6f8846fc9211fec841a4351d, user_id=d7cb0037a91f461f8f39e28fe3c1ba85, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:18.917084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744764e2-38c2-454d-8d70-a26fb4376bb2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:18.964151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3291/6643] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:18 2022] PUT /identity/v3/projects/faa2aefb6f8846fc9211fec841a4351d/users/d7cb0037a91f461f8f39e28fe3c1ba85/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:18.965755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:18.966059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:18.966347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.025705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:19.029353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:19.070871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52c34c5b76f4b5a8a552ba636349e93', 'request_id': 'req-a49fef90-8f02-4ac5-b795-183b142b1175'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:19.073647 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:19.081265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52c34c5b76f4b5a8a552ba636349e93', 'request_id': 'req-a49fef90-8f02-4ac5-b795-183b142b1175'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:19.093960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52c34c5b76f4b5a8a552ba636349e93', 'request_id': 'req-a49fef90-8f02-4ac5-b795-183b142b1175'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:19.116108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] The token cache is being invalidate because project d52c34c5b76f4b5a8a552ba636349e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:19.116675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:19.117508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49fef90-8f02-4ac5-b795-183b142b1175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:19.121717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3353/6644] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:18 2022] DELETE /identity/v3/projects/d52c34c5b76f4b5a8a552ba636349e93 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:19.131263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a854c2-78b9-45a6-865b-39febc2e81cc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.131738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a854c2-78b9-45a6-865b-39febc2e81cc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.132172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a854c2-78b9-45a6-865b-39febc2e81cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.173394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f6a854c2-78b9-45a6-865b-39febc2e81cc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:19.177360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3292/6645] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:19.181433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6a854c2-78b9-45a6-865b-39febc2e81cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:19.208992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:19.210924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:19.353718 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:19.407436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3354/6646] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:19.416618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.416945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.417863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.442737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d5b59-158d-4304-9236-786c6cf7c43c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:19.479852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:19.481570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:19.516296 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3355/6647] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:19.521371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:19.550423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2d6d7-46e7-49ef-a8a6-708a5a95fd34 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:19.562916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:19.564045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.564385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.564669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.565466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:19.565804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:19.571962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:19.573806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:19.574535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.574824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.575097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.601112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:19.605518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:19.630766 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3293/6648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:40:19.634591 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3356/6649] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:19.639174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:19.674690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5b7c1-d9f8-4b8e-aeae-76662e8e119d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:19.688103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:19.689386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.689542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.692331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.692331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:19.694254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:19.754354 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3294/6650] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:19 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:19.761049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:19.779719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7bef7-1950-4aea-998b-2f0168d4e655 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:19.886423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:19.887388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.887839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.890797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.891918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:19.895789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:19.942481 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3357/6651] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:19 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:19.947095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:19.968520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19377-88cd-460c-9465-659f1f39206b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:19.985532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:19.986617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:19.986914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:19.987193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:19.987962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:19.989918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:20.016252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:20.027769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3295/6652] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:20.030165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308eac-ffb7-43fb-a53b-738939226811 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:20.049255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:20.050248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:20.050695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:20.051131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:20.052065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:20.056303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07a63-0f55-42cb-82d8-a4a777ccee51 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:20.089051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3358/6653] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:20.090237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:20.102699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6039bf-684f-4432-a358-a41f47b5e923 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:20.122138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:20.123060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:20.123346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:20.123629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] PATH_INFO: `/v3/projects/5e95230ef90f4c1396e3185b43f1110b/users/8849a09ec9614ddb810cf8e8ca44093f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:20.175864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e95230ef90f4c1396e3185b43f1110b, user_id=8849a09ec9614ddb810cf8e8ca44093f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:20.176849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:20.206887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3296/6654] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:20 2022] PUT /identity/v3/projects/5e95230ef90f4c1396e3185b43f1110b/users/8849a09ec9614ddb810cf8e8ca44093f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:20.217704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:20.218315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:20.218607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:20.292038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] MFA Rules not processed for user `8849a09ec9614ddb810cf8e8ca44093f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:20.294018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:20.404308 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:20.499032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:20.520114 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3359/6655] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:20.667591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be757d-a1a3-4117-84ee-f10c67d37b04 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:20.686434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:20.687390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:20.687838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:20.688270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:20.689244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:20.691361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:20.749073 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3297/6656] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:20.752963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:20.793474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f1c98-ccfa-4300-8db0-00ff319d57b5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:20.943951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:20.944675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:20.944959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:20.945230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:20.954017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:20.958060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:21.029091 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3360/6657] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:20 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:21.029769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:21.052127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516d1d7-5b86-4659-b72d-8989f1329b6a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:21.082994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:21.085530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:21.085937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:21.086354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:21.087467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:21.089252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:21.127128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:21.135252 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3298/6658] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:21.147036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27d62d-d579-4a9d-b4e3-da28f046b3e9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:21.158933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:21.159884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:21.160181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:21.160459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:21.161209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:21.162863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184e51-7b15-4f9c-943f-05e9fd36b491 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:21.190699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:21.210176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca91ae-fbc7-464a-b852-b33588f850e6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:21.221553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:21.224330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:21.224848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:21.225290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] PATH_INFO: `/v3/projects/3c9a5f0d4d0442759b5ef8ec802d85a5/users/a6b3c10a7bbc4830b0b13586ebef0003/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:21.233913 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3361/6659] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:21.260450 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:21.271813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9a5f0d4d0442759b5ef8ec802d85a5, user_id=a6b3c10a7bbc4830b0b13586ebef0003, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:21.275026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:21.304104 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3299/6660] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:21 2022] PUT /identity/v3/projects/3c9a5f0d4d0442759b5ef8ec802d85a5/users/a6b3c10a7bbc4830b0b13586ebef0003/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:21.316212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf66c3-b42d-403e-bf56-1483d88e14cc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:21.316503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf66c3-b42d-403e-bf56-1483d88e14cc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:21.316789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf66c3-b42d-403e-bf56-1483d88e14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:21.361412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42cf66c3-b42d-403e-bf56-1483d88e14cc None None] MFA Rules not processed for user `a6b3c10a7bbc4830b0b13586ebef0003`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:21.363007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42cf66c3-b42d-403e-bf56-1483d88e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:21.581915 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3362/6661] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:21.588977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:21.594051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:21.841383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ac80d-b3b4-4098-8069-1338ea5c1d20 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:21.857339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:21.859483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:21.860000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:21.860496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:22.036018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:22.039238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:22.061727 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3300/6662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:22.311227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:22.311523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:22.311807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:22.350318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:22.351594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:22.419159 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:22.504817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3363/6663] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:40:22.521724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:22.523255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:22.687077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69d135-40ea-4715-9276-5f999b23c3e7 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:22.694079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:22.694399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:22.694789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:22.695077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:22.705896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:22.707529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd30b2-6357-4c0e-94c6-28a070d29a77 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:22.793820 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3301/6664] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:23.203167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:23.221311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d88c8-1963-435b-b319-c7cfb0d359c5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:23.225481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:23.226376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:23.226825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:23.227296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:23.247291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:23.249628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:23.261304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3364/6665] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:23.411821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:23.412426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:23.412426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:23.442858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:23.446973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:23.467095 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3302/6666] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:23.481192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:23.520507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e9f7-0fb6-4378-86da-0e32f39b3a8d service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:23.533756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:23.534428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:23.534712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:23.534984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:23.557103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:23.562699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:23.586092 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3365/6667] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:40:23.624557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:23.627126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:23.729112 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:23.851571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57bbc-f952-4bcd-b624-30d6e837634f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:23.864123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:23.865121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:23.865304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:23.865576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] PATH_INFO: `/v3/users/a4242cf259f9480b87435fdd16e04610` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:23.870660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4242cf259f9480b87435fdd16e04610)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:23.889086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:23.903049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:23.917896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cdee5-d303-4575-8247-636fb5b2d27b service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:23.923556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:23.925056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:23.925747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:23.926879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] PATH_INFO: `/v3/users/8849a09ec9614ddb810cf8e8ca44093f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:23.928922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8849a09ec9614ddb810cf8e8ca44093f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:23.932017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:24.020868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4242cf259f9480b87435fdd16e04610'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.033788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4242cf259f9480b87435fdd16e04610'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.046444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4242cf259f9480b87435fdd16e04610'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.065906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8849a09ec9614ddb810cf8e8ca44093f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.069093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8849a09ec9614ddb810cf8e8ca44093f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.085931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8849a09ec9614ddb810cf8e8ca44093f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.098897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8849a09ec9614ddb810cf8e8ca44093f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.107248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4242cf259f9480b87435fdd16e04610'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.108138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ffecc18-0a39-4b31-a4d3-382f12e06d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4242cf259f9480b87435fdd16e04610'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.131332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3303/6668] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:23 2022] DELETE /identity/v3/users/a4242cf259f9480b87435fdd16e04610 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:24.133346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8849a09ec9614ddb810cf8e8ca44093f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.154603 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3366/6669] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:23 2022] DELETE /identity/v3/users/8849a09ec9614ddb810cf8e8ca44093f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:24.154916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:24.155214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:24.155497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:24.194163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:24.199410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:24.335646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3304/6670] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:24.359289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:24.362798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:24.471455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509a8-7bda-4998-a994-edd9adf9013a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:24.474980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:24.475647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:24.475934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:24.476201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:24.491432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:24.502795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:24.504899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:24.506430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:24.528964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07a35-0250-4448-9e0c-fe93b2d70bd0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:24.534701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:24.535752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:24.536234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:24.536588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] PATH_INFO: `/v3/projects/a373807910a0427bb9ae0955d13bf1fa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:24.538313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a373807910a0427bb9ae0955d13bf1fa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:24.541039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:24.567481 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3367/6671] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:24.608889 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:24.628081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a373807910a0427bb9ae0955d13bf1fa', 'request_id': 'req-39fbcabc-5760-4990-b490-d23aa94abd70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.641392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a373807910a0427bb9ae0955d13bf1fa', 'request_id': 'req-39fbcabc-5760-4990-b490-d23aa94abd70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.648441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a373807910a0427bb9ae0955d13bf1fa', 'request_id': 'req-39fbcabc-5760-4990-b490-d23aa94abd70'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.669055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] The token cache is being invalidate because project a373807910a0427bb9ae0955d13bf1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:24.669344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.670262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.672291 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3305/6672] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:24 2022] DELETE /identity/v3/projects/a373807910a0427bb9ae0955d13bf1fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:24.677597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:24.699292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739866b-8aba-485d-9f8d-c01ed21a76af service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:24.736994 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:24.846405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:24.847701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:24.848237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:24.848709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] PATH_INFO: `/v3/users/d677b15439644342b2ae1a2bac230d68` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:24.851110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d677b15439644342b2ae1a2bac230d68)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:24.854195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:24.923781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd677b15439644342b2ae1a2bac230d68'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.924545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd677b15439644342b2ae1a2bac230d68'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.938404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd677b15439644342b2ae1a2bac230d68'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.963790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd677b15439644342b2ae1a2bac230d68'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:24.990285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd677b15439644342b2ae1a2bac230d68'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.003136 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3368/6673] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:24 2022] DELETE /identity/v3/users/d677b15439644342b2ae1a2bac230d68 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:25.230609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:25.233179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:25.267097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbcabc-5760-4990-b490-d23aa94abd70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:25.405422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:25.406263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:25.406809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:25.406809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] PATH_INFO: `/v3/projects/5e95230ef90f4c1396e3185b43f1110b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:25.408027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e95230ef90f4c1396e3185b43f1110b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:25.414023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:25.517364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e95230ef90f4c1396e3185b43f1110b', 'request_id': 'req-7ee2d194-c9f6-401d-bd40-7732071ad662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.535346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e95230ef90f4c1396e3185b43f1110b', 'request_id': 'req-7ee2d194-c9f6-401d-bd40-7732071ad662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.547213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e95230ef90f4c1396e3185b43f1110b', 'request_id': 'req-7ee2d194-c9f6-401d-bd40-7732071ad662'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.567943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:25.569803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:25.579443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] The token cache is being invalidate because project 5e95230ef90f4c1396e3185b43f1110b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:25.579736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.580722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.585748 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3306/6674] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:25 2022] DELETE /identity/v3/projects/5e95230ef90f4c1396e3185b43f1110b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:25.587496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:25.589470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:25.595454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde81-67e5-4a5e-8e6a-6780bcce91ec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:25.695131 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:25.718960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d194-c9f6-401d-bd40-7732071ad662 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:25.726640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:25.729995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:25.738400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:25.738863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] PATH_INFO: `/v3/users/a6b3c10a7bbc4830b0b13586ebef0003` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:25.744246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b3c10a7bbc4830b0b13586ebef0003)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:25.750530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:25.824549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:25.825865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:25.826547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:25.827137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] PATH_INFO: `/v3/projects/93929029e5fe4d0b831b831339f4203d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:25.829857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=93929029e5fe4d0b831b831339f4203d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:25.832680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:25.849188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b3c10a7bbc4830b0b13586ebef0003'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.861417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b3c10a7bbc4830b0b13586ebef0003'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.873019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b3c10a7bbc4830b0b13586ebef0003'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.895697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b3c10a7bbc4830b0b13586ebef0003'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.897143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d72951f8-8ac8-41aa-a049-c2fcd4bc4e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b3c10a7bbc4830b0b13586ebef0003'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.911369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3307/6675] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:25 2022] DELETE /identity/v3/users/a6b3c10a7bbc4830b0b13586ebef0003 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:25.931179 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:25.937860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93929029e5fe4d0b831b831339f4203d', 'request_id': 'req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.947677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93929029e5fe4d0b831b831339f4203d', 'request_id': 'req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.960025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93929029e5fe4d0b831b831339f4203d', 'request_id': 'req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.993825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] The token cache is being invalidate because project 93929029e5fe4d0b831b831339f4203d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:25.994284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.995024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9f6039a0-8533-4f5e-82c7-1e72e8c709ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:25.996996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3369/6676] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:25 2022] DELETE /identity/v3/projects/93929029e5fe4d0b831b831339f4203d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:26.002359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.002648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.002926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.046054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:26.048451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:26.198525 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3308/6677] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:26.201136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.201433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.202640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.250858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:26.252127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:26.275818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3370/6678] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:26.280950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.308185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be7d5-121c-4171-b326-a57866ee7534 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.345174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.346103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.346217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.346494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.347246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:26.347553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.350248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.381501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3309/6679] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:26.382969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.396280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24623a61-7fd6-416c-8d05-e364066da7b9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.410433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.411122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.411409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.411679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.412390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.415121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.483086 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3371/6680] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:26 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:26.484639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.497192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709af9e-ea29-4efa-a807-a60958954874 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.579818 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:26.597266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.598266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.598657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.598960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.600624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.605294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.641928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3310/6681] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:26 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:26.646758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.661318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933b24d-d072-4eb7-b79c-1d689fe9d0e4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.670915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.672070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.672525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.673241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.674218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.677073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.694369 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3372/6682] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:26.704265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.738354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e767-fbc0-4085-bab4-c492d41deb6c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.757650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.758988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.759275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.759561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.760486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.762487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8530ed5-13c4-41e7-a131-408601372925 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.791444 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3311/6683] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:26.798018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:26.809954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7563-6eec-43f0-ba3b-3ee5aebe149f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:26.829961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:26.830878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.831160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.831432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] PATH_INFO: `/v3/projects/9594d185ff204f60b15075242c4a9d4c/users/8f38ad0b87584fb498dc0479b0656b7f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.869853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9594d185ff204f60b15075242c4a9d4c, user_id=8f38ad0b87584fb498dc0479b0656b7f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:26.872558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:26.897480 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3373/6684] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:26 2022] PUT /identity/v3/projects/9594d185ff204f60b15075242c4a9d4c/users/8f38ad0b87584fb498dc0479b0656b7f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:26.903376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:26.903670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:26.903970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:26.936923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:26.938685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:27.064896 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3312/6685] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:27.093028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:27.102314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:27.248577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865e6c-5e52-4fe0-a263-ff9d0a2b48a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:27.257662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:27.260230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:27.261815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:27.263001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:27.281242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:27.283468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38f5d5-b06d-45b2-af17-97addc0492b5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:27.314219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3374/6686] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:27.597716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:27.606723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:27.625244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420dcb4-33b7-43c0-a6cd-d51920a2ebe7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:27.648613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:27.650062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:27.650338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:27.650619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] PATH_INFO: `/v3/projects/3c9a5f0d4d0442759b5ef8ec802d85a5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:27.651868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9a5f0d4d0442759b5ef8ec802d85a5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:27.653863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:27.760922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9a5f0d4d0442759b5ef8ec802d85a5', 'request_id': 'req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:27.772036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9a5f0d4d0442759b5ef8ec802d85a5', 'request_id': 'req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:27.791937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9a5f0d4d0442759b5ef8ec802d85a5', 'request_id': 'req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:27.810488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] The token cache is being invalidate because project 3c9a5f0d4d0442759b5ef8ec802d85a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:27.811019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:27.813001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6e53e7d0-ccac-4e36-b63b-dbb5c7bed983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:27.815442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3313/6687] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:27 2022] DELETE /identity/v3/projects/3c9a5f0d4d0442759b5ef8ec802d85a5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:27.824715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:27.825579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:27.826051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:27.865051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:27.866354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:28.053376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3375/6688] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:28.061516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.061934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.062320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.087279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:28.088835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:28.098969 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3314/6689] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:28.104600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.138357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfee1-b9a8-458d-b430-8f8ee780a025 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.158559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.159258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.159842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.160123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.161142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:28.161712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.167051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.185984 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:28.193131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3376/6690] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:28.202731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.216199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ad7f-23b6-4c63-885b-a8be5ac87806 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.233486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.234806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.235510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.235890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.243586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.250351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.311274 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3315/6691] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:28 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:28.315493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.338231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209135a-71aa-41fb-9396-f24d01006a7c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.444462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.446212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.448447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.449192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.450236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.454955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.507785 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3377/6692] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:28 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:28.512487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.531016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8ee7-147e-469a-839c-ec89d9aef6da admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.537572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.541404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.542070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.542571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.543547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.545465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.560384 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3316/6693] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:28.564156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.580899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e7e8-ec5b-400f-a8ea-b427645c0d47 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.592271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.594543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.594959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.595344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.596232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.597980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f95b67-2579-463c-b9d7-31a997a49d9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.613041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3378/6694] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:28.618269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:28.635847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f44bd-9687-4820-80e7-35a7f5f9239b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:28.654846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:28.659672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.661910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.662312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] PATH_INFO: `/v3/projects/bab8033932ed4c1b91df1be53188c075/users/f8ac0ff9a8d54953b4a341d66a6a1eef/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.719619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab8033932ed4c1b91df1be53188c075, user_id=f8ac0ff9a8d54953b4a341d66a6a1eef, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:28.732135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:28.740152 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:28.769189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3317/6695] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:28 2022] PUT /identity/v3/projects/bab8033932ed4c1b91df1be53188c075/users/f8ac0ff9a8d54953b4a341d66a6a1eef/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:28.775821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:28.776244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:28.777248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:28.834632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] MFA Rules not processed for user `f8ac0ff9a8d54953b4a341d66a6a1eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:28.837695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:28.995088 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3379/6696] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:29.003345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:29.006600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:29.030954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:29.033485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:29.151682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ac05a-6500-4373-8841-e24ace78cfd3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:29.156236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:29.157187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:29.157842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:29.158299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:29.170878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:29.172945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:29.205801 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3318/6697] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:29.216468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd5715-531d-41ba-8405-c2408c390e2f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:29.226395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:29.227708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:29.228236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:29.228594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] PATH_INFO: `/v3/users/a6cea44a68f04b52972b770230b5130a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:29.230366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cea44a68f04b52972b770230b5130a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:29.233106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:29.240507 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:29.353955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cea44a68f04b52972b770230b5130a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.354836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cea44a68f04b52972b770230b5130a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.369064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cea44a68f04b52972b770230b5130a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.379043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cea44a68f04b52972b770230b5130a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.398319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cea44a68f04b52972b770230b5130a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.415199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3380/6698] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:29 2022] DELETE /identity/v3/users/a6cea44a68f04b52972b770230b5130a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:29.514777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:29.534859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40463943-b9f0-4d5d-b486-f39bc225c441 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:29.673461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:29.674382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:29.674660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:29.674934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] PATH_INFO: `/v3/users/f8ac0ff9a8d54953b4a341d66a6a1eef` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:29.676159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ac0ff9a8d54953b4a341d66a6a1eef)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:29.678124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:29.778653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ac0ff9a8d54953b4a341d66a6a1eef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.791212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ac0ff9a8d54953b4a341d66a6a1eef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.805858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ac0ff9a8d54953b4a341d66a6a1eef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.817332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:29.819680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:29.837943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ac0ff9a8d54953b4a341d66a6a1eef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.838682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2f8f7d8-dee5-4188-98d7-ccce77962a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ac0ff9a8d54953b4a341d66a6a1eef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:29.859494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3319/6699] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:29 2022] DELETE /identity/v3/users/f8ac0ff9a8d54953b4a341d66a6a1eef => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:29.862114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:29.863270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:29.863718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:29.883697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e8a28-43b7-4721-a45c-9e9a74acca33 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:29.892992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:29.894446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:29.911809 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:30.020872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:30.021964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:30.022270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:30.022530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] PATH_INFO: `/v3/projects/a0193195c3004cca93fa3f343b4b4f1e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:30.025517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0193195c3004cca93fa3f343b4b4f1e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:30.028089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:30.050100 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3320/6700] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:30.075833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:30.080980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:30.129798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0193195c3004cca93fa3f343b4b4f1e', 'request_id': 'req-149848b8-14cf-4f52-9db8-62ae4b8fe492'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.150794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0193195c3004cca93fa3f343b4b4f1e', 'request_id': 'req-149848b8-14cf-4f52-9db8-62ae4b8fe492'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.170330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0193195c3004cca93fa3f343b4b4f1e', 'request_id': 'req-149848b8-14cf-4f52-9db8-62ae4b8fe492'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.206557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] The token cache is being invalidate because project a0193195c3004cca93fa3f343b4b4f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:30.210570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.212390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.219109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3381/6701] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:29 2022] DELETE /identity/v3/projects/a0193195c3004cca93fa3f343b4b4f1e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:30.220603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:30.222893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:30.237622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f159c-1d45-438d-97f7-bae38d6ff9d1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:30.269195 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:30.356364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149848b8-14cf-4f52-9db8-62ae4b8fe492 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:30.367395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:30.369511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:30.370497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:30.371329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] PATH_INFO: `/v3/users/9943ea411696482b8d288153ac2e8bbb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:30.372780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9943ea411696482b8d288153ac2e8bbb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:30.374782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:30.379203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:30.379880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:30.380163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:30.381500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:30.385721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:30.403394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:30.404876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:30.428625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3321/6702] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:30.477541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9943ea411696482b8d288153ac2e8bbb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.479239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9943ea411696482b8d288153ac2e8bbb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.496885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9943ea411696482b8d288153ac2e8bbb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.515498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9943ea411696482b8d288153ac2e8bbb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.538282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9943ea411696482b8d288153ac2e8bbb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:30.549593 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3382/6703] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:30 2022] DELETE /identity/v3/users/9943ea411696482b8d288153ac2e8bbb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:31.130311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:31.146703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28109ff-0a36-4b53-80cf-7dea7c309a8a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:31.173748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:31.177177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:31.426981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:31.428088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.428506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.429067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] PATH_INFO: `/v3/projects/99fa4a8655d946dcbbbafdda043b2a57` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.430329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ff78-9ea7-4a45-bd7e-e6fa99e07a65 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:31.433434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fa4a8655d946dcbbbafdda043b2a57)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:31.437352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:31.437610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:31.438753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.439301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.439595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] PATH_INFO: `/v3/projects/bab8033932ed4c1b91df1be53188c075` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.441002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab8033932ed4c1b91df1be53188c075)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:31.450413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:31.481603 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:31.544607 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:31.551553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fa4a8655d946dcbbbafdda043b2a57', 'request_id': 'req-3f009816-35d2-4d88-a19a-7feaf3fccc01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.564540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fa4a8655d946dcbbbafdda043b2a57', 'request_id': 'req-3f009816-35d2-4d88-a19a-7feaf3fccc01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.567654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab8033932ed4c1b91df1be53188c075', 'request_id': 'req-1072c368-a271-49ec-8fbd-87514604d396'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.584264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fa4a8655d946dcbbbafdda043b2a57', 'request_id': 'req-3f009816-35d2-4d88-a19a-7feaf3fccc01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.584445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab8033932ed4c1b91df1be53188c075', 'request_id': 'req-1072c368-a271-49ec-8fbd-87514604d396'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.618109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] The token cache is being invalidate because project 99fa4a8655d946dcbbbafdda043b2a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:31.618854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.620241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3f009816-35d2-4d88-a19a-7feaf3fccc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.634082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab8033932ed4c1b91df1be53188c075', 'request_id': 'req-1072c368-a271-49ec-8fbd-87514604d396'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.641044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3322/6704] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:31 2022] DELETE /identity/v3/projects/99fa4a8655d946dcbbbafdda043b2a57 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:31.642988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385338f-5c8c-47f0-9d46-989c39a16840 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.643458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385338f-5c8c-47f0-9d46-989c39a16840 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.643812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385338f-5c8c-47f0-9d46-989c39a16840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.696005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] The token cache is being invalidate because project bab8033932ed4c1b91df1be53188c075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:31.696303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.698213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f385338f-5c8c-47f0-9d46-989c39a16840 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:31.699452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f385338f-5c8c-47f0-9d46-989c39a16840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:31.702159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1072c368-a271-49ec-8fbd-87514604d396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:31.705262 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3383/6705] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:31 2022] DELETE /identity/v3/projects/bab8033932ed4c1b91df1be53188c075 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:31.710925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afbe8a-ae80-46fe-ae9c-6241f95584d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.711689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afbe8a-ae80-46fe-ae9c-6241f95584d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.713377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afbe8a-ae80-46fe-ae9c-6241f95584d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.790704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c1afbe8a-ae80-46fe-ae9c-6241f95584d2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:31.794931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c1afbe8a-ae80-46fe-ae9c-6241f95584d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:31.906000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3323/6706] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:40:31.914961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.915655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.916109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.944845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:31.950003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:31.964873 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3324/6707] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:40:31.968936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:31.980035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3384/6708] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:40:31.988254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:31.988694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:31.989079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:31.996728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c00d-3907-4f9e-89e8-e812b98c1465 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.011469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.013851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.014122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.014721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.017391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:32.018693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.024594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.043853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:32.049488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:32.058286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3325/6709] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:40:32.059366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.070892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3385/6710] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:32.074722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.077489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6fe28-4e5b-4e96-876a-c1681f796a93 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.084638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.085322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.085610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.086744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.088002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.104855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7df584-3be7-4ce4-bd70-daf455c8e1a9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.107672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.131799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.134653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.139095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.139532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.140784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:32.141359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.144530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.192845 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3386/6711] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:32.194124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.226485 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3326/6712] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:32 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:32.231200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.252065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0330-2015-48b4-8dc1-37a62580077d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.374132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c428a84-0e53-47d8-a085-89785faa1b62 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.382884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.383724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.384014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.384293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.385001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.388505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.404468 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:32.441988 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3327/6713] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:32 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:32.448236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.457865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.458368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.458677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.458954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.459809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.465017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.473533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b8631-e2ed-410d-b478-a5bcf7ba23f5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.490528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.491503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.491891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.497152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.498156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.500478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.518671 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3328/6714] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:32.523303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.548789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc52356-14b3-4514-a6cb-dab8d14cc73c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.553492 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3387/6715] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:32 2022] POST /identity/v3/projects => generated 383 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:32.559726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.565595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.566477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.566870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.568606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.569817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.573074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.619092 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3329/6716] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:40:32.619092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.628940 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:32.650554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235501-9023-4c5e-8fd7-61f6eb86d421 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.752010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9022c2-0ce7-4141-9752-437f9ea9d237 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.766184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.767877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.768489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.771461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.774547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.776962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.841410 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3388/6717] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:32 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:32.842476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.873487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75b12-475f-43f3-8699-5cdc38f1d710 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.877639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.877639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.877639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.877639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] PATH_INFO: `/v3/projects/3b5ece69cce240f7bce8c1e9d85876f8/users/0157dba075b94d559b40ddbf4cc4234a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.896395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:32.897100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.897384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.900761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:32.902490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.907395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.919830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5ece69cce240f7bce8c1e9d85876f8, user_id=0157dba075b94d559b40ddbf4cc4234a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:32.926055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37234-2be4-4377-9057-19922b302c48 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:32.936053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3389/6718] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:32.939964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:32.974079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c6b6-65ef-4237-a0b5-0f7d84a73730 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:32.974311 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3330/6719] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:32 2022] PUT /identity/v3/projects/3b5ece69cce240f7bce8c1e9d85876f8/users/0157dba075b94d559b40ddbf4cc4234a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:32.976719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:32.978887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:32.979708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.058679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] MFA Rules not processed for user `0157dba075b94d559b40ddbf4cc4234a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:33.059939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:33.119341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:33.120300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.120749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.121221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.122001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:33.123614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08c96-e764-4c82-bee7-9449e43b2929 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:33.145749 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3390/6720] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:33.145749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bbd0-f14d-4683-a094-563174c3ef71 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.147567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bbd0-f14d-4683-a094-563174c3ef71 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.147908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bbd0-f14d-4683-a094-563174c3ef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.170530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3331/6721] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:33.177126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.190381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23d9a-b479-4079-ac89-853ab814dffa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:33.196132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:33.197190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.197711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.198103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] PATH_INFO: `/v3/projects/ff0e71237e494c3c9b4ebf9f8b77c54e/users/842f52b7d77b4734a15cc6da0595d181/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.215357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-baa0bbd0-f14d-4683-a094-563174c3ef71 None None] MFA Rules not processed for user `d7cb0037a91f461f8f39e28fe3c1ba85`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:33.216633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-baa0bbd0-f14d-4683-a094-563174c3ef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:33.220034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0e71237e494c3c9b4ebf9f8b77c54e, user_id=842f52b7d77b4734a15cc6da0595d181, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:33.226170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:33.249852 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3332/6722] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:33 2022] PUT /identity/v3/projects/ff0e71237e494c3c9b4ebf9f8b77c54e/users/842f52b7d77b4734a15cc6da0595d181/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:33.249852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.321474 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:33.363559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3391/6723] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:33.374448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.374735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.375014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.412346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] MFA Rules not processed for user `842f52b7d77b4734a15cc6da0595d181`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:33.413608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:33.459060 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:33.464603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4948d-b3d6-48fa-92f7-636df73f0529 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:33.479008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0157dba075b94d559b40ddbf4cc4234a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5ece69cce240f7bce8c1e9d85876f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:33.481055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.481369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.481625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.485891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:33.487002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9f8a-57e5-4959-8f52-0c3c7d55c543 tempest-IdentityCatalogTest-349125400 tempest-IdentityCatalogTest-349125400-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:33.493234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3333/6724] 10.222.0.27 () {58 vars in 1142 bytes} [Sun Jul 24 01:40:33 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:33.493234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.493234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.493234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.528789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] MFA Rules not processed for user `d7cb0037a91f461f8f39e28fe3c1ba85`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:33.530055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:33.557748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3392/6725] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:33.564859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.654198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3334/6726] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:33.661493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.676973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758b3c-6f7b-41af-8546-40e0aab16ee8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:33.689184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aadff8-8975-435b-aa0a-5e1a333c6e83 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:33.690122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:33.690952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.691235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.691827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.692538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:33.696709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:33.708391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:33.709292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:33.709570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:33.712058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] PATH_INFO: `/v3/users/0157dba075b94d559b40ddbf4cc4234a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:33.714965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0157dba075b94d559b40ddbf4cc4234a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:33.719341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:33.775497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3335/6727] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:33 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:33.776362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.780989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:33.836307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0157dba075b94d559b40ddbf4cc4234a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:33.837456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0157dba075b94d559b40ddbf4cc4234a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:33.851163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0157dba075b94d559b40ddbf4cc4234a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:33.875680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0157dba075b94d559b40ddbf4cc4234a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:33.902202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0157dba075b94d559b40ddbf4cc4234a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:33.918773 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3393/6728] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:33 2022] DELETE /identity/v3/users/0157dba075b94d559b40ddbf4cc4234a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:33.930872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:33.932907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:34.035095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0506e4-93c5-460e-9b76-262b27c90dbe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.054470 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:34.111340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade312a-e92a-4f84-bdf0-bf4a162a3e0a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.131033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.131743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.132022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.132298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.133052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.138888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543718e-2536-4441-bf8c-8664ea748500 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.170836 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:34.226066 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3394/6729] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:33 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:34.233846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.234540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.234828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.235106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.237063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.237365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.237645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.241153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:34.283429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:34.286571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:34.312091 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3395/6730] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:34.313141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:34.333760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883773e-dc2d-47d7-b74c-38d690f212e8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.347954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.348911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.349574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.350169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.351099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.354738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.380199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3396/6731] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:34.381472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:34.387713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:34.480185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.491595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.534111 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3336/6732] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:34.549990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:34.587486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29925b99-54a8-4218-8959-bcee8b70bf5b service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.593416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739766-97a9-4777-a96f-212d68620bde admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.594327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.595266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.595722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.596163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.597135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.598953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.604724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.605593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.607759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.608142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.617919 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3337/6733] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:34.624300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:34.649534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.651137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43b598-84a5-4566-902a-3011f1f2565a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.674613 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3397/6734] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:34.684763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a61db-4b6c-4463-9716-b13decb83224 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:34.699513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:34.701171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.703148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.703644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] PATH_INFO: `/v3/projects/86f83f42d5bc4f2fad2763c05ae5ec16/users/222e8eb81e614a5d92212098e8b89e4b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.750043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f83f42d5bc4f2fad2763c05ae5ec16, user_id=222e8eb81e614a5d92212098e8b89e4b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:34.754476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:34.809313 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3338/6735] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:34 2022] PUT /identity/v3/projects/86f83f42d5bc4f2fad2763c05ae5ec16/users/222e8eb81e614a5d92212098e8b89e4b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:34.821941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:34.822299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:34.822543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:34.924731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] MFA Rules not processed for user `222e8eb81e614a5d92212098e8b89e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:34.927074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:35.046554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3398/6736] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:35.053954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.263423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71685d-6307-4eae-9147-ec4cd6710cc6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.284554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.285994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:35.290107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.290819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.291488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.291488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.292070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.294042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:35.327721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16436-25ad-437d-a118-ff9dedfb6ab8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.343329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.348495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.348495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.348495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] PATH_INFO: `/v3/projects/3b5ece69cce240f7bce8c1e9d85876f8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.353980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5ece69cce240f7bce8c1e9d85876f8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.360525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:35.371883 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3339/6737] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:35 2022] POST /identity/v3/projects => generated 383 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:35.377351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.469746 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:35.476050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5ece69cce240f7bce8c1e9d85876f8', 'request_id': 'req-da281646-5b10-4ef1-829a-861b3420e599'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:35.492292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5ece69cce240f7bce8c1e9d85876f8', 'request_id': 'req-da281646-5b10-4ef1-829a-861b3420e599'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:35.509168 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:35.526409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5ece69cce240f7bce8c1e9d85876f8', 'request_id': 'req-da281646-5b10-4ef1-829a-861b3420e599'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:35.553246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] The token cache is being invalidate because project 3b5ece69cce240f7bce8c1e9d85876f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:35.555317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:35.556974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-da281646-5b10-4ef1-829a-861b3420e599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:35.562561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3399/6738] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:35 2022] DELETE /identity/v3/projects/3b5ece69cce240f7bce8c1e9d85876f8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:35.568987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960d67-7fd4-4e21-bcdf-eb3a24d80220 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.569558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960d67-7fd4-4e21-bcdf-eb3a24d80220 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.570820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960d67-7fd4-4e21-bcdf-eb3a24d80220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.620529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc59a3-fff4-4aae-a6f5-9452d43aeebe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.648467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2a960d67-7fd4-4e21-bcdf-eb3a24d80220 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:35.652436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a960d67-7fd4-4e21-bcdf-eb3a24d80220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:35.746268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.746970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.747259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.747548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.751519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.756937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:35.770554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3400/6739] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:35.778580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c707-4465-4605-b994-d5a2696f75db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.779466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c707-4465-4605-b994-d5a2696f75db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.780082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c707-4465-4605-b994-d5a2696f75db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.806714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3340/6740] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:35 2022] POST /identity/v3/users => generated 298 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:35.807655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.814153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:35.818454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0119c707-4465-4605-b994-d5a2696f75db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:35.819689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0119c707-4465-4605-b994-d5a2696f75db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:35.832232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf98bc-fd2a-4b04-859e-516d28495c6c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.847030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3401/6741] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:35.847961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119c707-4465-4605-b994-d5a2696f75db None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.871617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.872311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.872595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.872869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.873611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.875269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:35.888389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119c707-4465-4605-b994-d5a2696f75db None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.894324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.895229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.895724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.896186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.897260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:35.897634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.899899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:35.911632 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3341/6742] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:35.912864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.938300 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3402/6743] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:35.939684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:35.941864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b734d-f6d4-45e2-ad48-e2aa816080f9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.966996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.968438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.969162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.970212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] PATH_INFO: `/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e/users/b5526daba0664e239062adcb5c8050b7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.970652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060901-b64b-4d89-8055-7d69b4836b8d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:35.989407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:35.990116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:35.990389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:35.990664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:35.991365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:35.993474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.013550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d3bb7cfdec48d4902c48ca47acf86e, user_id=b5526daba0664e239062adcb5c8050b7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.016808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.061711 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3342/6744] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:35 2022] PUT /identity/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e/users/b5526daba0664e239062adcb5c8050b7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:36.067209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.069833 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3403/6745] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:35 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:36.071665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.168726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4a33-25cf-4cc8-b275-4f2e397a0873 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.182341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.186082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.186459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.186811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.188381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.194613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.216804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276559c4-6113-46e7-842f-38ed61208920 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.223907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.224813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.225099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.225453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.226400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.229760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.235055 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3404/6746] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:36 2022] POST /identity/v3/users => generated 305 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:36.239034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.245715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3343/6747] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:36.249636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.271429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0ed8b-7ec2-4c63-ad16-a09e62585a95 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.282244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffcbfb-2f15-424f-976d-370ff4fe9655 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.287042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.289840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.290672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.291484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.293386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.294166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.298717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.299687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.299896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.300246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] PATH_INFO: `/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e/users/b5526daba0664e239062adcb5c8050b7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.306204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d3bb7cfdec48d4902c48ca47acf86e, user_id=b5526daba0664e239062adcb5c8050b7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.313489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a77c2-66d2-444d-a3f5-70783cfdde75 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.334212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3405/6748] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:36.335553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.362008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3344/6749] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:36 2022] PUT /identity/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e/users/b5526daba0664e239062adcb5c8050b7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:36.377927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.378275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.378726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.389268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f102d4-611f-44e5-903e-02e86d5e691e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.408802 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:36.466723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] MFA Rules not processed for user `b5526daba0664e239062adcb5c8050b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:36.468342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:36.532901 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:36.734640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3345/6750] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:36.734640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.737540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:36.782531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.783622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.783835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.784181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] PATH_INFO: `/v3/projects/10e0fe85bd144482ab6e981462acf190/users/dc4d0e76b30849b493dcb48c2338997c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.809647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e0fe85bd144482ab6e981462acf190, user_id=dc4d0e76b30849b493dcb48c2338997c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:36.813512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:36.848195 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3406/6751] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:36 2022] PUT /identity/v3/projects/10e0fe85bd144482ab6e981462acf190/users/dc4d0e76b30849b493dcb48c2338997c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:36.848788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:36.854736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:36.920961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08433-3e97-48cc-9e7b-c746925b9a80 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.923471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e9dea-836d-442c-a5ac-40229ae28ab4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:36.929328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:36.934374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:36.934708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:36.935440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:36.939862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:37.021114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:37.022173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:37.022816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:37.023292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:37.040472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:37.061088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:37.062656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:37.067696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:37.070752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:37.089731 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3407/6752] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:37.090650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:37.111023 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3346/6753] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:37.242837 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:37.301172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da456e2-f0ca-4eb0-8de9-f671f423ed9f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:37.322595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:37.322868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:37.323110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:37.323392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:37.324143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:37.326413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e821b-d975-478d-a2a5-e6602b8fca36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:37.376885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3408/6754] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:37.381429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:37.397746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899697-ccea-41e5-b63d-6f536cac919f service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:37.411932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:37.413041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:37.413321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:37.413610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] PATH_INFO: `/v3/projects/10e0fe85bd144482ab6e981462acf190/users/dc4d0e76b30849b493dcb48c2338997c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:37.420025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e0fe85bd144482ab6e981462acf190, user_id=dc4d0e76b30849b493dcb48c2338997c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:37.422778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:37.456298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3347/6755] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:37 2022] PUT /identity/v3/projects/10e0fe85bd144482ab6e981462acf190/users/dc4d0e76b30849b493dcb48c2338997c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:37.467415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:37.467755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:37.468148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:37.547484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] MFA Rules not processed for user `dc4d0e76b30849b493dcb48c2338997c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:37.554254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:37.790511 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3409/6756] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:37.794698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:37.863422 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:38.114354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cb07b-9ff1-4952-898d-1afc911ee857 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:38.136041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:38.136740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.137026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.137307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.138094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:38.140596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:38.194932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3348/6757] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:37 2022] POST /identity/v3/projects => generated 397 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:38.199618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:38.221640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5671c1-d792-4592-9a81-ae348c4276ee None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:38.423711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:38.424434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.424708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.424975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.425976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:38.439935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:38.504959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3410/6758] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:38 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:38.509212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:38.526163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80deda-63d4-4c19-a2db-a098ee05eeaf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:38.546428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:38.547136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.547417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.547690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.553081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:38.560381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:38.608011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:38.620210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3349/6759] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:38.631603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ece64d-b726-4128-9165-41af5804767f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:38.643644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:38.644329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.644610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.644884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.645628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:38.651669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b5623-5ee2-43d8-a843-1f0fa5a98d86 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:38.681478 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3411/6760] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:40:38.683149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:38.716665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf0c9-3baa-4939-a877-ab814fe2e08a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:38.747688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:38.748754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.749043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.749357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] PATH_INFO: `/v3/projects/fd02dd5633ba4f8aafb266bc0a7a67df/users/d7e3087a34b6436c958e095043ab2ea8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.813760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd02dd5633ba4f8aafb266bc0a7a67df, user_id=d7e3087a34b6436c958e095043ab2ea8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:38.816604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:38.888497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3350/6761] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:38 2022] PUT /identity/v3/projects/fd02dd5633ba4f8aafb266bc0a7a67df/users/d7e3087a34b6436c958e095043ab2ea8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:38.890282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:38.890874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:38.891326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:38.979001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] MFA Rules not processed for user `d7e3087a34b6436c958e095043ab2ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:38.980544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:39.074907 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:39.172051 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3412/6762] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:39.187029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:39.189398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:39.411922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178c27d-bf57-4ff8-98ed-ecd3f3be590d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:39.424525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:39.425209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:39.426112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:39.426403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:39.546969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:39.549273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d16b9-ce78-4836-bab4-e761a70f4d09 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:39.575563 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3351/6763] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:40.466475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:40.653600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de291d3-2f8a-487d-9eb0-a6674865c863 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:40.660025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:40.661281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:40.661713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:40.662086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] PATH_INFO: `/v3/users/dc4d0e76b30849b493dcb48c2338997c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:40.665954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4d0e76b30849b493dcb48c2338997c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:40.668194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:40.769605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4d0e76b30849b493dcb48c2338997c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:40.771896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4d0e76b30849b493dcb48c2338997c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:40.795659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4d0e76b30849b493dcb48c2338997c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:40.811423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4d0e76b30849b493dcb48c2338997c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:40.844870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec9ce23b-9b34-4af9-becb-efb684d5d2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4d0e76b30849b493dcb48c2338997c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:40.858944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:40.859500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:40.859500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:40.868317 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3413/6764] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:40 2022] DELETE /identity/v3/users/dc4d0e76b30849b493dcb48c2338997c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:40.874015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:40.877916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:40.878505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:40.911503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:40.912917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:40.921886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] MFA Rules not processed for user `8f38ad0b87584fb498dc0479b0656b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:40.925038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:40.935123 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:41.030961 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:41.056413 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3414/6765] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:41.069470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.074293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:41.131011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3352/6766] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:40:41.135675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.137383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:41.162904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2163b-dac6-4930-85b3-cdb7f3f404c2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.172048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.173296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.173847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.174372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.176385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.179360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.219052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d370efb-70c5-4330-a3f9-5df24fb5f3ea None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.234478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.235161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.235440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.235718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.241606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3353/6767] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:41 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:41.245431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.267357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.269087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.296963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3415/6768] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:41.361709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03debb-0948-4aff-b42d-4c2b457e9380 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.376736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.380212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.380507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.380789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.384730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.389205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.445163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3354/6769] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:41 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:40:41.447761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.461192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9dde1-32a2-4292-a0a8-1be406cf37e0 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.474198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.477192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.478585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.478585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.480190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.485603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.517120 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3416/6770] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:41.521692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.539614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cd5d1-a445-4b6d-87fc-6222394894ec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.546032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.547329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.547789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.548233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] PATH_INFO: `/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9/users/8bd7836fac9243ef9e0a2e363274c545/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.571679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2819399aa5e14dc5bfd98cbce7b830f9, user_id=8bd7836fac9243ef9e0a2e363274c545, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.575853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.598851 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3355/6771] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:41 2022] PUT /identity/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9/users/8bd7836fac9243ef9e0a2e363274c545/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:41.604352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.643062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a137d-5c04-49f4-87d1-f3a11e5ba622 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.747948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.748862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.749245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.750315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.751256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.754687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.780541 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3417/6772] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:41.784515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:41.841552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bacb3-db52-4c63-b6c6-1aa326a481c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:41.874497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:41.883192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:41.886713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:41.888671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] PATH_INFO: `/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9/users/8bd7836fac9243ef9e0a2e363274c545/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:41.897007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2819399aa5e14dc5bfd98cbce7b830f9, user_id=8bd7836fac9243ef9e0a2e363274c545, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:41.908390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:41.967821 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3356/6773] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:41 2022] PUT /identity/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9/users/8bd7836fac9243ef9e0a2e363274c545/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:42.312082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:42.314344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:42.350140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfb4a-2c73-419f-a6f4-3d8d4ba7e2f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:42.533004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:42.533956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:42.534244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:42.534529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] PATH_INFO: `/v3/projects/10e0fe85bd144482ab6e981462acf190` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:42.548037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e0fe85bd144482ab6e981462acf190)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:42.559385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:42.688305 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:42.731901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e0fe85bd144482ab6e981462acf190', 'request_id': 'req-df5c98bb-b243-44ed-b527-bd72f56db4e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:42.744830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e0fe85bd144482ab6e981462acf190', 'request_id': 'req-df5c98bb-b243-44ed-b527-bd72f56db4e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:42.760421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e0fe85bd144482ab6e981462acf190', 'request_id': 'req-df5c98bb-b243-44ed-b527-bd72f56db4e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:42.794531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] The token cache is being invalidate because project 10e0fe85bd144482ab6e981462acf190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:42.794884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:42.801485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:42.814837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:42.815304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3418/6774] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:42 2022] DELETE /identity/v3/projects/10e0fe85bd144482ab6e981462acf190 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:42.816627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:42.837048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac608-f31f-4799-b1e0-7c06dabefc39 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:42.928535 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:43.014565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:43.015477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:43.015759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:43.016034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] PATH_INFO: `/v3/users/d7e3087a34b6436c958e095043ab2ea8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:43.026698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e3087a34b6436c958e095043ab2ea8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:43.033721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:43.155916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e3087a34b6436c958e095043ab2ea8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:43.170351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e3087a34b6436c958e095043ab2ea8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:43.202918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e3087a34b6436c958e095043ab2ea8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:43.240441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e3087a34b6436c958e095043ab2ea8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:43.241423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d63a8b8c-7588-4960-aedb-14f74225ad08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e3087a34b6436c958e095043ab2ea8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:43.253975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3357/6775] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:42 2022] DELETE /identity/v3/users/d7e3087a34b6436c958e095043ab2ea8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:43.862812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:43.877362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c98bb-b243-44ed-b527-bd72f56db4e9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:44.034924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:44.035626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.035990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.036226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] PATH_INFO: `/v3/projects/fd02dd5633ba4f8aafb266bc0a7a67df` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.037488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd02dd5633ba4f8aafb266bc0a7a67df)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:44.039965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:44.167594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd02dd5633ba4f8aafb266bc0a7a67df', 'request_id': 'req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:44.208672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd02dd5633ba4f8aafb266bc0a7a67df', 'request_id': 'req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:44.240525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd02dd5633ba4f8aafb266bc0a7a67df', 'request_id': 'req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:44.267551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] The token cache is being invalidate because project fd02dd5633ba4f8aafb266bc0a7a67df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:44.267882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:44.275641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d3d9853-0d9a-4179-ad3a-85c93ae5ed4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:44.279081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3419/6776] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:43 2022] DELETE /identity/v3/projects/fd02dd5633ba4f8aafb266bc0a7a67df => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:44.283368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.283864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.284294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.315447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:44.318161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:44.430834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3358/6777] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:44.441878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.442493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.442997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.487193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:44.488842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:44.502287 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3420/6778] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:44.504705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:44.521428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0917e5-8f63-4aa8-ad7f-29754b75b7b1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:44.528797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:44.529938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.530337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.530722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.532326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:44.532903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:44.535871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:44.563579 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3359/6779] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:40:44.567539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:44.585023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c7c3-3279-4456-8a91-fc1729a075e1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:44.599034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:44.606766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.607501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.607890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.608935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:44.611315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:44.730567 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3421/6780] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:44.732650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:44.751162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d89f9-0e16-4840-963d-63ca4d938e56 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:44.857231 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:44.909309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:44.910230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:44.910566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:44.912121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:44.912900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:44.922869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.010197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.011557 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3360/6781] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:44 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:45.025793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0923a-f1f9-430b-8709-2d8d73acf89f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:45.043518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:45.044536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.044968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.045292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.046226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:45.048753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.076419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3422/6782] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:45.080883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.100121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e0268-ca1a-4e94-bc4a-2e1458b5cba1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:45.118506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:45.120828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.121696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.123061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] PATH_INFO: `/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7/users/64c96faa4a584717aba341c59e781252/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.167589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bad1788ebde40fd8c2b79b2d2f385a7, user_id=64c96faa4a584717aba341c59e781252, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:45.172441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.218049 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3361/6783] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:45 2022] PUT /identity/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7/users/64c96faa4a584717aba341c59e781252/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:45.219374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.246114 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:45.269216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18983b3-cc51-43b1-a4ac-be4cbc283884 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:45.508867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:45.510260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.510476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.511139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.515300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:45.517273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8792c51-e330-48ac-b223-40eb49e26ee1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.545911 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3423/6784] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:45.547734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.574642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c961-a0a2-4880-ba2b-d856d9439b4c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:45.581493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:45.582804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.583254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.583691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] PATH_INFO: `/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7/users/64c96faa4a584717aba341c59e781252/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.589953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bad1788ebde40fd8c2b79b2d2f385a7, user_id=64c96faa4a584717aba341c59e781252, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:45.592921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.627742 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3362/6785] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:45 2022] PUT /identity/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7/users/64c96faa4a584717aba341c59e781252/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:45.629628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.630353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.630737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.673960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] MFA Rules not processed for user `64c96faa4a584717aba341c59e781252`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:45.675422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:45.769385 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3424/6786] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:45.770657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.872794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71226d-e8f8-46a0-8df8-302dd6d7479e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:45.880335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:45.881502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:45.882015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:45.883341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:45.885010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:45.893536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:45.942029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:45.951061 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3363/6787] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:45 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:45.957252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4a70-4677-488c-b3d8-55879da587a5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:46.112240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:46.112963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:46.121830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:46.121830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:46.121830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:46.135168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:46.204786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3425/6788] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:45 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:46.206047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:46.229108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8efde-f094-4233-8475-10c569d6104e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:46.248140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:46.248839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:46.249125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:46.249399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:46.250594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:46.254948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:46.287678 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3364/6789] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:46.289804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:46.311841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3651e3-9b56-4bfd-87c7-dd94dd61a419 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:46.332165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:46.332867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:46.333159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:46.333444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:46.337847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:46.344072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb57690-b70e-4a0e-9211-8faf45449ee8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:46.403102 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3426/6790] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:46.405849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:46.425277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f879b2-360e-4c8a-aa45-abd424b1b7b5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:46.457032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:46.458084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:46.458372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:46.458651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] PATH_INFO: `/v3/projects/eaa09b4955834769b7b8d5b7f62b2a79/users/47270ffca0ac47dba2c4e5cca7c7f8ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:46.539653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa09b4955834769b7b8d5b7f62b2a79, user_id=47270ffca0ac47dba2c4e5cca7c7f8ab, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:46.542827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:46.613113 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3365/6791] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:46 2022] PUT /identity/v3/projects/eaa09b4955834769b7b8d5b7f62b2a79/users/47270ffca0ac47dba2c4e5cca7c7f8ab/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:46.636844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:46.640924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:46.642728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:46.661966 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:46.700361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] MFA Rules not processed for user `47270ffca0ac47dba2c4e5cca7c7f8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:46.701907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:46.862419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3427/6792] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:46.878067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:46.890995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:47.022432 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:47.080930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3c0b-9ea6-4818-8484-c7f45a796aad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:47.084841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:47.086007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:47.086478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:47.087477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:47.274666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:47.276158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e884a4-eb0e-4d45-9108-32bee6c5d3d9 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:47.304931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3366/6793] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:47.822145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:48.038953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83affa-7744-420d-92d8-63640c0230a9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:48.052299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:48.053453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:48.053866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:48.054896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] PATH_INFO: `/v3/users/64c96faa4a584717aba341c59e781252` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:48.057970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c96faa4a584717aba341c59e781252)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:48.066476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:48.240674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c96faa4a584717aba341c59e781252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:48.242197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c96faa4a584717aba341c59e781252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:48.259816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c96faa4a584717aba341c59e781252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:48.275907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c96faa4a584717aba341c59e781252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:48.315099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c96faa4a584717aba341c59e781252'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:48.339383 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3428/6794] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:47 2022] DELETE /identity/v3/users/64c96faa4a584717aba341c59e781252 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:48.344714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:48.345292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:48.345292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:48.422982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:48.424237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:48.590678 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3367/6795] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:48.615947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:48.618043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:48.646267 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:48.751580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d561da-0b05-4c6d-8ee5-3d8c53096aa4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:48.760418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:48.760747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:48.761038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:48.761416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:48.790096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:48.791578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:48.820779 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3429/6796] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:50.137068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:50.142897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:50.171616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174130-e098-43db-af2b-ca292f31b218 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:50.182560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:50.183697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:50.184220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:50.184725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] PATH_INFO: `/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:50.186324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bad1788ebde40fd8c2b79b2d2f385a7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:50.192430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:50.284109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bad1788ebde40fd8c2b79b2d2f385a7', 'request_id': 'req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.293617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bad1788ebde40fd8c2b79b2d2f385a7', 'request_id': 'req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.300685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bad1788ebde40fd8c2b79b2d2f385a7', 'request_id': 'req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.318619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] The token cache is being invalidate because project 8bad1788ebde40fd8c2b79b2d2f385a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:50.319251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.320901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.325901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3368/6797] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:50 2022] DELETE /identity/v3/projects/8bad1788ebde40fd8c2b79b2d2f385a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:50.327323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:50.339794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e066-aa08-4b4d-b7cc-eac39f776c1a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:50.462317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:50.463321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:50.463681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:50.464743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] PATH_INFO: `/v3/users/47270ffca0ac47dba2c4e5cca7c7f8ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:50.473021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47270ffca0ac47dba2c4e5cca7c7f8ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:50.476768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:50.615439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47270ffca0ac47dba2c4e5cca7c7f8ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.616325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47270ffca0ac47dba2c4e5cca7c7f8ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.639543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47270ffca0ac47dba2c4e5cca7c7f8ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.650876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47270ffca0ac47dba2c4e5cca7c7f8ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.697743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c563ab6b-5e04-4476-a47b-411e4ce46a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47270ffca0ac47dba2c4e5cca7c7f8ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:50.707595 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3430/6798] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:50 2022] DELETE /identity/v3/users/47270ffca0ac47dba2c4e5cca7c7f8ab => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:52.106401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:52.111672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:52.168541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efc4d1-b33b-4430-ba43-0d6464ca3ada admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:52.177469 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:52.359848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:52.360978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:52.361351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:52.361820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] PATH_INFO: `/v3/projects/eaa09b4955834769b7b8d5b7f62b2a79` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:52.365374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa09b4955834769b7b8d5b7f62b2a79)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:52.371098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:52.539752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa09b4955834769b7b8d5b7f62b2a79', 'request_id': 'req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:52.575961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa09b4955834769b7b8d5b7f62b2a79', 'request_id': 'req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:52.586497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa09b4955834769b7b8d5b7f62b2a79', 'request_id': 'req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:52.614809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] The token cache is being invalidate because project eaa09b4955834769b7b8d5b7f62b2a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:52.615390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:52.617176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d2593fd1-6aaf-41fb-b912-d5cbdfd2fe02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:52.622557 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3369/6799] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:52 2022] DELETE /identity/v3/projects/eaa09b4955834769b7b8d5b7f62b2a79 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:52.628265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:52.629564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:52.632864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:52.673856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:52.676056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:52.757907 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:52.821580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:52.822011 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3431/6800] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:52.822391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:52.822676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:52.863585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:52.864866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:52.887303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3370/6801] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:52.891191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:52.906103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970a1e7-b05c-403c-a6d7-0986618615db None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:52.922948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:52.927892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:52.930959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:52.931329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:52.932219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:52.934309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:52.946234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:52.985201 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3432/6802] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:52.990829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.021908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d473-ae0e-43a8-82ec-2376cd171b29 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:53.028672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:53.029976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.030371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.030990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.032397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:53.038081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:53.136297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3371/6803] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:52 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:53.140977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.155523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe0d-751f-4ae5-abe8-766349aaf7d5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:53.243286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:53.243984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.244450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.244749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.245485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:53.247726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:53.281435 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3433/6804] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:53 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:53.286455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.301579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8fdc7-5d4f-4563-87b3-1b2da9d419a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:53.314168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:53.314788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.315077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.315359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.316257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:53.320819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:53.357894 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3372/6805] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:53.360804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.373527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded53290-571b-4a5c-957d-cbff70a5b092 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:53.393924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:53.395400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.396023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.396468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.400613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:53.403809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cda7-2487-4a7e-803d-0f3746e78361 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:53.434189 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3434/6806] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:53.435493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.464527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5a34c-b689-419a-9209-7f4dfdf28be6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:53.477044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:53.480015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.484182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.484672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] PATH_INFO: `/v3/projects/775473dee07e423c9f7bb7dd9ee8b786/users/db74d334478e4be08bee59dcaa3b34e2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.543988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775473dee07e423c9f7bb7dd9ee8b786, user_id=db74d334478e4be08bee59dcaa3b34e2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:53.546850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:53.608337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3373/6807] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:53 2022] PUT /identity/v3/projects/775473dee07e423c9f7bb7dd9ee8b786/users/db74d334478e4be08bee59dcaa3b34e2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:53.621453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:53.621962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:53.622318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:53.714809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] MFA Rules not processed for user `db74d334478e4be08bee59dcaa3b34e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:53.716322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:53.925307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3435/6808] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:53.936267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:53.939617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:54.142902 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:54.258830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77308-02c2-410f-a6fc-5be03d5c7393 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:54.272784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:54.273407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:54.273828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:54.274288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:54.310669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:54.312257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff996837-1080-4a71-99d3-ec6c95b21811 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:54.346503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3374/6809] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:55.526694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:55.592096 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:55.665570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459419-dd3b-4b40-b8ae-4ad7d808dea7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:55.680331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:55.681297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:55.681725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:55.687301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] PATH_INFO: `/v3/users/db74d334478e4be08bee59dcaa3b34e2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:55.696438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db74d334478e4be08bee59dcaa3b34e2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:55.698340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:55.838800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db74d334478e4be08bee59dcaa3b34e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:55.839521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db74d334478e4be08bee59dcaa3b34e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:55.862080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db74d334478e4be08bee59dcaa3b34e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:55.878450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db74d334478e4be08bee59dcaa3b34e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:55.916570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-244afde9-0d7c-4131-aca3-7d4dea5fb7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db74d334478e4be08bee59dcaa3b34e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:55.920071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:55.920537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:55.920629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:55.939007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3436/6810] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:40:55 2022] DELETE /identity/v3/users/db74d334478e4be08bee59dcaa3b34e2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:55.945430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:55.945818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:55.948140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:55.983490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:55.984766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:55.987890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] MFA Rules not processed for user `8bd7836fac9243ef9e0a2e363274c545`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:55.990398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:56.169404 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3437/6811] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:56.179183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:56.182498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:56.184026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3375/6812] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:56.201189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:56.202619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:56.414533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08348-6db1-4576-a27b-26ac47a6e894 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:56.422869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b84fc7-499c-4b69-a245-82b92bf93275 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:56.428098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:56.430346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:56.431085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:56.432565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:56.436839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:56.438901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:56.439825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:56.440808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:56.446182 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:56.447863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:56.455954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:56.457907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:56.483180 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3438/6813] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:56.582332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:56.594159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81070f7-1aa9-4157-8cc7-65d516f204ef service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:56.657300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3376/6814] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:40:57.245875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:57.248037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:57.323272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4a6ac-d8b3-43ba-8c8e-22b2ae698974 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:57.363940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:57.366086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:57.369132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:57.369649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] PATH_INFO: `/v3/projects/775473dee07e423c9f7bb7dd9ee8b786` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:57.372621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775473dee07e423c9f7bb7dd9ee8b786)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:57.377933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:57.513486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775473dee07e423c9f7bb7dd9ee8b786', 'request_id': 'req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:57.542567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775473dee07e423c9f7bb7dd9ee8b786', 'request_id': 'req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:57.573208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775473dee07e423c9f7bb7dd9ee8b786', 'request_id': 'req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:57.597830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] The token cache is being invalidate because project 775473dee07e423c9f7bb7dd9ee8b786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:40:57.598578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:57.599558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cf0c6c7-fc4d-4069-b855-8445d8aa5204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:40:57.603176 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3439/6815] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:40:57 2022] DELETE /identity/v3/projects/775473dee07e423c9f7bb7dd9ee8b786 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:57.608756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:57.609728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:57.610021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:57.649466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:57.650785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:57.678112 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:57.854094 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3377/6816] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:57.861016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:57.861342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:57.861627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:57.896001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:57.898807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:57.911996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3440/6817] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:57.913502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:57.940057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d18ab9-8c83-4a3a-9466-60374d8dae72 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:57.958239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:57.960046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:57.961111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:57.962713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:57.963773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:40:57.964356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:57.971251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.016078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3378/6818] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:40:58.017471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:58.039325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79a02a-08ac-45e7-b709-aa2ab59fcc87 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:58.053289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:58.054130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.054417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.056174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.058371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:58.064156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.166218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3441/6819] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:58.167393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:58.186070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222791b-1def-4122-beb7-92600a80f3ff admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:58.331057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:58.331755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.332219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.332506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.333213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:58.336394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.388214 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3379/6820] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:58 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:58.388827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:58.404496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460741-5d7c-4396-bb1c-04bdf195a1ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:58.428934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:58.429643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.430099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.430380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.431419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:58.434292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.474905 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3442/6821] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:58.479016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:58.498545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fa000-071a-4fda-8f44-769d651c546e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:58.512777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:58.513489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.513814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.514867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.515677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:58.518265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459ba8-244a-46cc-8e98-3351431ac6e2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.530584 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3380/6822] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:40:58.534184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:58.548954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35c8db-b8ac-49cd-98e1-633452a0fa60 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:58.554941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:58.556096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.556563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.557006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] PATH_INFO: `/v3/projects/f3e7e1ed545c4a708a217012193c4e0c/users/136e026c4abb46ccb4effc5070d42175/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.583445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e7e1ed545c4a708a217012193c4e0c, user_id=136e026c4abb46ccb4effc5070d42175, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:58.589129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:58.609815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3443/6823] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:58 2022] PUT /identity/v3/projects/f3e7e1ed545c4a708a217012193c4e0c/users/136e026c4abb46ccb4effc5070d42175/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:40:58.620870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:58.621997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:58.622459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:58.664955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] MFA Rules not processed for user `136e026c4abb46ccb4effc5070d42175`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:40:58.666771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:58.933754 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3381/6824] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:40:58.940333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.046899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.048328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:59.074908 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:59.160795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df38d1-d93c-4b35-8642-6ccc2d24dbf8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:59.184308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:59.186895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:59.187274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:59.187958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:59.189254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:59.201227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:59.247870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fed0b9-5202-4181-b0ae-c61f7d2151cc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:59.252356 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:40:59.260773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:59.262710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:59.264982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:59.265499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:59.270517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:40:59.285695 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3444/6825] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:59.290168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.477380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:59.478883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:59.504766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50761-8e38-4b33-b1c6-768686857baa admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:59.513482 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3382/6826] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:40:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:40:59.532284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:59.535695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:59.535996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:59.537035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:59.540029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:59.542074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:59.597116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3445/6827] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:40:59 2022] POST /identity/v3/users => generated 295 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:40:59.601288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.615468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51433-7b8b-45ad-9971-61fe169e5b17 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:59.628970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:59.631583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:59.633101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:59.634141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:59.636126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:59.639768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:59.660014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3383/6828] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:40:59.664392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.676005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7988-1029-4210-a4be-5c5de2135f95 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:40:59.698321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:40:59.699597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:40:59.704207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:40:59.704777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] PATH_INFO: `/v3/projects/a76476c2d00d42b48afad264966eeba6/users/515f9b2423984b8a97bfda9d4d024016/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:40:59.748051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76476c2d00d42b48afad264966eeba6, user_id=515f9b2423984b8a97bfda9d4d024016, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:40:59.756075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:40:59.790700 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3446/6829] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:40:59 2022] PUT /identity/v3/projects/a76476c2d00d42b48afad264966eeba6/users/515f9b2423984b8a97bfda9d4d024016/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:40:59.792914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:40:59.815017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c68f-0889-4395-bcdc-447de540c8c2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:00.004771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:00.006130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:00.006610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:00.007336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:00.008292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:00.011012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3c01-4872-452b-953e-d2cc1dbc2ae9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:00.029596 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3384/6830] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:00.030876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:00.048795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405f888-ddd4-4a96-881f-f9d8ddfd7240 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:00.071765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:00.072834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:00.073123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:00.073400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] PATH_INFO: `/v3/projects/a76476c2d00d42b48afad264966eeba6/users/515f9b2423984b8a97bfda9d4d024016/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:00.080265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76476c2d00d42b48afad264966eeba6, user_id=515f9b2423984b8a97bfda9d4d024016, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:00.088700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:00.127299 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3447/6831] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:00 2022] PUT /identity/v3/projects/a76476c2d00d42b48afad264966eeba6/users/515f9b2423984b8a97bfda9d4d024016/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:00.144480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:00.144480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:00.144480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:00.196413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] MFA Rules not processed for user `515f9b2423984b8a97bfda9d4d024016`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:00.198239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:00.281188 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:00.404813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3385/6832] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:00.442683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:00.444609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:00.666733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0007-34b9-4ed9-99f3-7fb8a7e37816 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:00.672433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:00.673417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:00.673887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:00.674398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:00.687315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:00.689292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05319d5-070e-4b2d-9378-b4be245d6885 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:00.710704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3448/6833] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:03.993277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:04.172236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1fa6e-70f8-40cf-b6a7-096ad231767a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:04.185379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:04.187092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:04.190478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:04.190889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] PATH_INFO: `/v3/users/136e026c4abb46ccb4effc5070d42175` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:04.196154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136e026c4abb46ccb4effc5070d42175)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:04.203655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:04.314805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136e026c4abb46ccb4effc5070d42175'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:04.327186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136e026c4abb46ccb4effc5070d42175'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:04.338376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136e026c4abb46ccb4effc5070d42175'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:04.365042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136e026c4abb46ccb4effc5070d42175'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:04.365966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136e026c4abb46ccb4effc5070d42175'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:04.375757 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3386/6834] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:03 2022] DELETE /identity/v3/users/136e026c4abb46ccb4effc5070d42175 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:04.380455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:04.380964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:04.381212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:04.409159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:04.410809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:04.487900 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:04.515988 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3449/6835] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:04.526868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:04.528613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:04.626735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d4477-426f-4be1-8b0b-d684938cb538 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:04.639805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:04.641524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:04.643720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:04.644865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:04.659054 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:04.667295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:04.669633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:04.703223 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3387/6836] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:05.350435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:05.352089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:05.394016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5314-ea54-4e18-8a41-b4ec59c510e0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:05.415727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:05.417270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:05.417770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:05.421121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] PATH_INFO: `/v3/projects/f3e7e1ed545c4a708a217012193c4e0c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:05.424386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e7e1ed545c4a708a217012193c4e0c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:05.428552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:05.555253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e7e1ed545c4a708a217012193c4e0c', 'request_id': 'req-3b3876bc-ad38-449c-9e38-8862b6d08df9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.570713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e7e1ed545c4a708a217012193c4e0c', 'request_id': 'req-3b3876bc-ad38-449c-9e38-8862b6d08df9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.587185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e7e1ed545c4a708a217012193c4e0c', 'request_id': 'req-3b3876bc-ad38-449c-9e38-8862b6d08df9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.619138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] The token cache is being invalidate because project f3e7e1ed545c4a708a217012193c4e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:05.619686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.621377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.629403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3450/6837] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:05 2022] DELETE /identity/v3/projects/f3e7e1ed545c4a708a217012193c4e0c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:05.630502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:05.652967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825142-4828-442a-9184-4db8d1f434eb service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:05.765179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:05.769102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:05.769102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:05.770129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] PATH_INFO: `/v3/users/515f9b2423984b8a97bfda9d4d024016` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:05.774412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] RBAC: Authorizing `identity:delete_user(user_id=515f9b2423984b8a97bfda9d4d024016)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:05.780125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:05.882777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515f9b2423984b8a97bfda9d4d024016'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.912260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515f9b2423984b8a97bfda9d4d024016'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.931429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515f9b2423984b8a97bfda9d4d024016'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.949019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515f9b2423984b8a97bfda9d4d024016'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.950026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515f9b2423984b8a97bfda9d4d024016'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:05.961478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3388/6838] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:05 2022] DELETE /identity/v3/users/515f9b2423984b8a97bfda9d4d024016 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:41:06.532649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:06.535751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:06.558786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3876bc-ad38-449c-9e38-8862b6d08df9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:06.573330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:06.575447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:06.711434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:06.712784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:06.713086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:06.713440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] PATH_INFO: `/v3/projects/a76476c2d00d42b48afad264966eeba6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:06.715660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76476c2d00d42b48afad264966eeba6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:06.715823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68336f6-3db5-46fc-b968-fc60bbdc030f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:06.718520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:06.724187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:06.724883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:06.725208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:06.725485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:06.733150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:06.782587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76476c2d00d42b48afad264966eeba6', 'request_id': 'req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:06.786042 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:06.797040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76476c2d00d42b48afad264966eeba6', 'request_id': 'req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:06.810408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76476c2d00d42b48afad264966eeba6', 'request_id': 'req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:06.836428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] The token cache is being invalidate because project a76476c2d00d42b48afad264966eeba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:06.838012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:06.840346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b131fe4c-a448-4b81-a940-3dcefe6ce9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:06.844630 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3451/6839] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:06 2022] DELETE /identity/v3/projects/a76476c2d00d42b48afad264966eeba6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:06.849633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:06.850687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:06.859501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:06.861285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cf2c-65d6-4a8e-b751-09d45c4c05bd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:06.863173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:06.875454 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3389/6840] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:41:06.883321 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:06.893217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:06.900188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.060970 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3452/6841] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:07.069820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.070127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.070409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.105453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:07.105453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.133459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3390/6842] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:07.134469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.146505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142991b3-45c6-4d55-94e3-343c01441035 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.155686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.156476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.156832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.157313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.158449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:07.158975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.161021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.182540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.189447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3453/6843] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:41:07.194024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c93595-ff6b-4e40-b0b5-98c0523bb116 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.212873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.214440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.217935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.220462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.220462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.228478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.241841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.243866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.265572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b960cc-1ab5-4859-a24c-08581bfe9dfe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.285534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.287685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.290756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.291347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] PATH_INFO: `/v3/users/5f4ef1bf26ac43f9bda95774f39779f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.295842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4ef1bf26ac43f9bda95774f39779f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.299966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.318408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3391/6844] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:07 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:07.320652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.398715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4ef1bf26ac43f9bda95774f39779f9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:07.399522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4ef1bf26ac43f9bda95774f39779f9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:07.415814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4ef1bf26ac43f9bda95774f39779f9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:07.430827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4ef1bf26ac43f9bda95774f39779f9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:07.461801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c64fc733-ba9c-43cf-b981-68b4358ec181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4ef1bf26ac43f9bda95774f39779f9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:07.469583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd200294-b610-4939-bf68-6720ab765f9c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.474162 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3454/6845] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:07 2022] DELETE /identity/v3/users/5f4ef1bf26ac43f9bda95774f39779f9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:41:07.479013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.479558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.480120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.507773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:07.509500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.613748 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3455/6846] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:41:07.620809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.622526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.624224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.624530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.625228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.626913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.627144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.629238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.641891 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:07.661934 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3392/6847] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:07 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:07.666445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.676125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:07.726696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3029198-9700-4ae8-a2bc-269feac6fee1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.738727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d927ccd-f798-4624-85ad-c03a4cb74cc7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.739856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.744019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.745107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.745107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.745905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.746427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.747595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.748057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.748604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.751054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.764985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.767073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.780219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3456/6848] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:41:07.781718 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3393/6849] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:07.794215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.820150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f190-c51f-4964-9cd2-2696fe657096 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.835239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.836256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.836855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.837206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.839632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.841383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd13656-66b6-4bd7-ba78-d75b627383ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.871236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3457/6850] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:07.873012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:07.891997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646176a-188e-49f1-8012-6f35c25abdc1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:07.905103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:07.906151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:07.906521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:07.906842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] PATH_INFO: `/v3/projects/64b9f630d02a473aa53de73e6d340111/users/2259600401ff41a59ff1bc7ecb05d57d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:07.949623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b9f630d02a473aa53de73e6d340111, user_id=2259600401ff41a59ff1bc7ecb05d57d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:07.957601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:07.978632 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:07.995167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3394/6851] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:07 2022] PUT /identity/v3/projects/64b9f630d02a473aa53de73e6d340111/users/2259600401ff41a59ff1bc7ecb05d57d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:08.005150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.005506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.005890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.070492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] MFA Rules not processed for user `2259600401ff41a59ff1bc7ecb05d57d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:08.072024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:08.251918 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3458/6852] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:08.257192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.387009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e565b-7d43-4a66-8d16-7fcecabd53f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.400965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.401841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.402233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.402662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.406594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.408695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.460781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.464302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:08.488933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f749a-1eb2-4a3e-a9ca-cbd836bdb9f9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.495803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.496899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.497465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.498074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] PATH_INFO: `/v3/projects/c1ea27ee187741f59225b2f2b0b94226` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.499813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ea27ee187741f59225b2f2b0b94226)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.502561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.525424 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3395/6853] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:08.529394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.596282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ea27ee187741f59225b2f2b0b94226', 'request_id': 'req-8315fda6-d93c-47b6-aa2c-2490040a6d10'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:08.612628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ea27ee187741f59225b2f2b0b94226', 'request_id': 'req-8315fda6-d93c-47b6-aa2c-2490040a6d10'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:08.625817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ea27ee187741f59225b2f2b0b94226', 'request_id': 'req-8315fda6-d93c-47b6-aa2c-2490040a6d10'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:08.641047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] The token cache is being invalidate because project c1ea27ee187741f59225b2f2b0b94226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:08.641782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:08.643821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8315fda6-d93c-47b6-aa2c-2490040a6d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:08.645902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3459/6854] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:08 2022] DELETE /identity/v3/projects/c1ea27ee187741f59225b2f2b0b94226 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:08.651097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b71d03-5aa6-40f6-b518-f545faa9de90 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.651678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b71d03-5aa6-40f6-b518-f545faa9de90 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.652153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b71d03-5aa6-40f6-b518-f545faa9de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.671101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5b77-d071-4ad3-a66f-bc28cc6447d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.673654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b4b71d03-5aa6-40f6-b518-f545faa9de90 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:08.676975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b4b71d03-5aa6-40f6-b518-f545faa9de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:08.686140 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:08.788998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.791592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.792290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.792674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.793492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.794780 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3460/6855] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:41:08.795901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.808410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.809019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.809445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.822575 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3396/6856] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:08.828600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.832542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:08.851644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:08.854176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:08.859790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275ee3-c3a4-4de6-bc8a-9fce6c5fb815 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.869261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.870572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.870860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.871144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.873309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.873532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.878100 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3461/6857] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:08.882024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.893026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b1e62-08eb-45e0-9123-d5e3d4b9dc99 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.899112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.899789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.900076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.900412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.901162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:08.901474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.903179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.907476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3397/6858] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:08.911519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.921580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3462/6859] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:41:08.925599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:08.935620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2908b-401e-4dd7-8f49-dc5e8a1a3c4e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.938491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b7779-5b19-47c0-9cfb-19fb456e5438 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:08.943671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.944947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.945340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.946084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.947036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.949295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:08.952488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:08.953472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:08.953706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:08.953994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] PATH_INFO: `/v3/projects/1d48306e14cb486d85e6b6294a931713/users/eb9c72b9b15c401e8a10ae1ab5115a38/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:08.965541 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:08.975798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d48306e14cb486d85e6b6294a931713, user_id=eb9c72b9b15c401e8a10ae1ab5115a38, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:08.978527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.000802 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3463/6860] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:08 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:41:09.004747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.005741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3398/6861] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:08 2022] PUT /identity/v3/projects/1d48306e14cb486d85e6b6294a931713/users/eb9c72b9b15c401e8a10ae1ab5115a38/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:09.010388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.087774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a623-d076-4fff-806e-f3d33af33876 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.102087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.102774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.103060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.103509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.104280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.108695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.142454 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3464/6862] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:09 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:09.143971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.161439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a61-f469-45f5-bc74-8293a3bf3a89 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.161830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45284100-943f-47d8-9c9d-ce5682f2dc31 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.168498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.169556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.170148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.170650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.171576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.173289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.173945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.177042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.177419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.177724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.179224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.185212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.186187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3465/6863] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:09.190100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.201198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3399/6864] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:09.205529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.206831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cafba-57f2-4a3e-b003-01c8aa89424f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.214689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.215594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.215884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.216158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.216954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.218589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.233614 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3466/6865] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:41:09.234093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf27d-0145-477b-9ede-edf453eb2cb5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.242131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.244695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.244695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.256050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.256562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] PATH_INFO: `/v3/projects/1d48306e14cb486d85e6b6294a931713/users/eb9c72b9b15c401e8a10ae1ab5115a38/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.256968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f3d06-8adc-4ddb-a6af-4f43f563313d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.260305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d48306e14cb486d85e6b6294a931713, user_id=eb9c72b9b15c401e8a10ae1ab5115a38, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.265457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.267421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146544f0-045c-435b-8eb6-f79360f23343 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.267792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.268973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.269954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] PATH_INFO: `/v3/projects/37e2878c337d4b92acb73d1937049161/users/62f36c88b9f043cc948c3a385211994e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.300619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e2878c337d4b92acb73d1937049161, user_id=62f36c88b9f043cc948c3a385211994e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.302188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3400/6866] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:09 2022] PUT /identity/v3/projects/1d48306e14cb486d85e6b6294a931713/users/eb9c72b9b15c401e8a10ae1ab5115a38/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:09.304765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184b4b4-1e03-4998-b0a9-c87e3767d62d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.314522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.315147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.315920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.346533 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3467/6867] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:09 2022] PUT /identity/v3/projects/37e2878c337d4b92acb73d1937049161/users/62f36c88b9f043cc948c3a385211994e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:41:09.355056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.355056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.355357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.398022 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:09.399801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] MFA Rules not processed for user `eb9c72b9b15c401e8a10ae1ab5115a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:09.401340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:09.402834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] MFA Rules not processed for user `62f36c88b9f043cc948c3a385211994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:09.408535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:09.525270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3468/6868] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:41:09.537498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.539413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:09.614887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3401/6869] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:09.616713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:09.618281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:09.720381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc43dd-b8b3-4aa7-9aa4-eae3f0146da0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.724963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.725927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.726424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.726921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.782540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.784750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.785997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b389181-727b-4036-83e2-6b8d6ad06b81 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:09.791454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:09.792209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:09.792563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:09.792919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:09.806107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:09.808508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43577985-a0f8-4224-b47c-bc842e22980e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:09.814508 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:09.820959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3469/6870] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:41:09.830935 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3402/6871] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:12.937156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:13.086378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7690e-dbfa-4975-aeb9-b46aa4a7dbe5 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:13.099835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:13.102676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:13.103084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:13.103424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] PATH_INFO: `/v3/users/2259600401ff41a59ff1bc7ecb05d57d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:13.105136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2259600401ff41a59ff1bc7ecb05d57d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:13.118780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:13.222102 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:13.230558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2259600401ff41a59ff1bc7ecb05d57d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:13.233581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2259600401ff41a59ff1bc7ecb05d57d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:13.259474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2259600401ff41a59ff1bc7ecb05d57d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:13.276224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2259600401ff41a59ff1bc7ecb05d57d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:13.292394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2259600401ff41a59ff1bc7ecb05d57d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:13.300081 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3470/6872] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:12 2022] DELETE /identity/v3/users/2259600401ff41a59ff1bc7ecb05d57d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:13.305290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:13.305830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:13.305953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:13.328182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:13.329695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:13.437102 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3403/6873] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:13.444565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:13.446160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:13.558109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c35ee-a6c2-459b-b998-cd2c13ef7766 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:13.562201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:13.562866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:13.563153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:13.563433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:13.577554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:13.579060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:13.594082 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3471/6874] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:14.085205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:14.087195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:14.122447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732857f-c0f8-4100-bd66-58c047f766c2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:14.129458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:14.130377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:14.130663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:14.130938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] PATH_INFO: `/v3/projects/64b9f630d02a473aa53de73e6d340111` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:14.142613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b9f630d02a473aa53de73e6d340111)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:14.144583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:14.247351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b9f630d02a473aa53de73e6d340111', 'request_id': 'req-831fcd08-54c8-439c-9e70-ad9d56aeff2e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.267516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b9f630d02a473aa53de73e6d340111', 'request_id': 'req-831fcd08-54c8-439c-9e70-ad9d56aeff2e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.287354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b9f630d02a473aa53de73e6d340111', 'request_id': 'req-831fcd08-54c8-439c-9e70-ad9d56aeff2e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.319645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] The token cache is being invalidate because project 64b9f630d02a473aa53de73e6d340111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:14.320254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.320650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.333783 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3404/6875] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:14 2022] DELETE /identity/v3/projects/64b9f630d02a473aa53de73e6d340111 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:14.335551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:14.349611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedff7bd-91b8-4e34-bf82-fee886af2e34 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:14.591529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:14.593356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:14.593642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:14.593977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] PATH_INFO: `/v3/users/eb9c72b9b15c401e8a10ae1ab5115a38` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:14.601803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9c72b9b15c401e8a10ae1ab5115a38)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:14.605392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:14.731319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9c72b9b15c401e8a10ae1ab5115a38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.734220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9c72b9b15c401e8a10ae1ab5115a38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.755827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9c72b9b15c401e8a10ae1ab5115a38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.765427 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:14.770350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9c72b9b15c401e8a10ae1ab5115a38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.809362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cdfef845-7d95-4dcf-a065-9c8b16e455c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9c72b9b15c401e8a10ae1ab5115a38'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:14.820028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3472/6876] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:14 2022] DELETE /identity/v3/users/eb9c72b9b15c401e8a10ae1ab5115a38 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:41:15.063407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.065140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:15.082039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fcd08-54c8-439c-9e70-ad9d56aeff2e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.181469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.182491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.182869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.183213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] PATH_INFO: `/v3/projects/1d48306e14cb486d85e6b6294a931713` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.184870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d48306e14cb486d85e6b6294a931713)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.187114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.224076 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:15.259619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d48306e14cb486d85e6b6294a931713', 'request_id': 'req-b790c1d7-b85d-42b9-97b2-dd994a44db42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:15.267583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d48306e14cb486d85e6b6294a931713', 'request_id': 'req-b790c1d7-b85d-42b9-97b2-dd994a44db42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:15.273984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d48306e14cb486d85e6b6294a931713', 'request_id': 'req-b790c1d7-b85d-42b9-97b2-dd994a44db42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:15.308148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] The token cache is being invalidate because project 1d48306e14cb486d85e6b6294a931713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:15.308528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:15.310267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b790c1d7-b85d-42b9-97b2-dd994a44db42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:15.312375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3405/6877] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:15 2022] DELETE /identity/v3/projects/1d48306e14cb486d85e6b6294a931713 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:15.317747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e28be-b470-4a13-a332-98d32928328e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.318293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e28be-b470-4a13-a332-98d32928328e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.318573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e28be-b470-4a13-a332-98d32928328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.348519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-188e28be-b470-4a13-a332-98d32928328e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:15.350644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-188e28be-b470-4a13-a332-98d32928328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:15.420906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3473/6878] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:41:15.430254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.430637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.430768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.454923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:15.456574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:15.472045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e28be-b470-4a13-a332-98d32928328e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.472753 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3406/6879] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:15.483261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e28be-b470-4a13-a332-98d32928328e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.489455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.490385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.491547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.492192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.493233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:15.493764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.495602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.522692 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3474/6880] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:41:15.523980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.556790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa5277-daab-4db6-b10c-645dd64400d2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.592740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.593777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.594134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.594484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.595257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.598229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.653496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3407/6881] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:15 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:15.658100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.674886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0616e-09ef-4239-95f8-18758782170e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.811647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.812341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.812623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.812948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.814638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.816168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.843521 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3475/6882] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:15 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:15.846811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.863235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870133b0-f8b5-46ca-aa47-ec776c6a42eb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.878471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.879545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.879991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.880486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.882702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.884619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.899495 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3408/6883] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:15.903338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.915158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df27dba-39a2-4d1e-a124-31cf2f4cd94f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.920681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.921390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.921662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.921979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:15.922725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:15.927464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404648-9d17-444d-a102-6290368d593a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:15.951363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3476/6884] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:15.955236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:15.971857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc4fae-1414-4df1-98c9-e772ac624822 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:15.982563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:15.983760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:15.984221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:15.984681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] PATH_INFO: `/v3/projects/014071d36fe2407daf548d221451ade6/users/22ef3760959d4a3488a75e0e110b1b86/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:16.029714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014071d36fe2407daf548d221451ade6, user_id=22ef3760959d4a3488a75e0e110b1b86, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:16.032682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:16.067848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3409/6885] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:15 2022] PUT /identity/v3/projects/014071d36fe2407daf548d221451ade6/users/22ef3760959d4a3488a75e0e110b1b86/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:16.078906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:16.079199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:16.079475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:16.161471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] MFA Rules not processed for user `22ef3760959d4a3488a75e0e110b1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:16.163274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:16.260665 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:16.372402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3477/6886] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:16.385086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:16.387357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:16.559764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e100f3-0df4-4a89-8649-096551084bc0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:16.566726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:16.575636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:16.575934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:16.576227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:16.596212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:16.599900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e888-4dbd-4b37-8a68-bf3e2e7908cd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:16.628675 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3410/6887] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:41:18.343672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:18.346133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:18.463361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ce5e-0a59-4d76-96b0-b777e81a5a01 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:18.468658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:18.469641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:18.470211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:18.470717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] PATH_INFO: `/v3/users/842f52b7d77b4734a15cc6da0595d181` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:18.473222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842f52b7d77b4734a15cc6da0595d181)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:18.476495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:18.586278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842f52b7d77b4734a15cc6da0595d181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:18.588364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842f52b7d77b4734a15cc6da0595d181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:18.618057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842f52b7d77b4734a15cc6da0595d181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:18.638308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842f52b7d77b4734a15cc6da0595d181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:18.658558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842f52b7d77b4734a15cc6da0595d181'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:18.687403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3478/6888] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:18 2022] DELETE /identity/v3/users/842f52b7d77b4734a15cc6da0595d181 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:18.688860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:18.689369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:18.689455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:18.734908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:18.736045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:18.871993 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:18.937201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3411/6889] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:18.948040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:18.949664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:19.158290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb61d-b946-437a-ab90-a6427400bae5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:19.162029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:19.163113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:19.163622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:19.163912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:19.172102 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:19.174540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:19.176043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:19.204130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3479/6890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:19.520033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:19.523368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:19.562025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce7228-507f-40d6-bbbf-890ca80b4196 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:19.600224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:19.602843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:19.603337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:19.616631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] PATH_INFO: `/v3/projects/ff0e71237e494c3c9b4ebf9f8b77c54e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:19.621962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0e71237e494c3c9b4ebf9f8b77c54e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:19.627281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:19.754108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0e71237e494c3c9b4ebf9f8b77c54e', 'request_id': 'req-718cb877-4c23-40cf-9300-226ee39773d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:19.766594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0e71237e494c3c9b4ebf9f8b77c54e', 'request_id': 'req-718cb877-4c23-40cf-9300-226ee39773d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:19.778976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0e71237e494c3c9b4ebf9f8b77c54e', 'request_id': 'req-718cb877-4c23-40cf-9300-226ee39773d6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:19.799961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] The token cache is being invalidate because project ff0e71237e494c3c9b4ebf9f8b77c54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:19.801607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:19.805173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:19.811176 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3412/6891] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:19 2022] DELETE /identity/v3/projects/ff0e71237e494c3c9b4ebf9f8b77c54e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:19.812755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:19.832475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef5865-83c7-494a-8331-8170d5d02fd9 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:19.986741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:19.987915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:19.988295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:19.988666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] PATH_INFO: `/v3/users/222e8eb81e614a5d92212098e8b89e4b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:19.994688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222e8eb81e614a5d92212098e8b89e4b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:19.997343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:20.124560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222e8eb81e614a5d92212098e8b89e4b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:20.126563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222e8eb81e614a5d92212098e8b89e4b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:20.153067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222e8eb81e614a5d92212098e8b89e4b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:20.170552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222e8eb81e614a5d92212098e8b89e4b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:20.199822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222e8eb81e614a5d92212098e8b89e4b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:20.228552 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3480/6892] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:19 2022] DELETE /identity/v3/users/222e8eb81e614a5d92212098e8b89e4b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:21.098362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:21.100553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:21.132380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb877-4c23-40cf-9300-226ee39773d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:21.282251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:21.285826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:21.286430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:21.288165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] PATH_INFO: `/v3/projects/86f83f42d5bc4f2fad2763c05ae5ec16` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:21.292832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f83f42d5bc4f2fad2763c05ae5ec16)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:21.298235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:21.488133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f83f42d5bc4f2fad2763c05ae5ec16', 'request_id': 'req-0390de43-4c52-4963-bf81-e609bbacbe68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:21.515486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f83f42d5bc4f2fad2763c05ae5ec16', 'request_id': 'req-0390de43-4c52-4963-bf81-e609bbacbe68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:21.537514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f83f42d5bc4f2fad2763c05ae5ec16', 'request_id': 'req-0390de43-4c52-4963-bf81-e609bbacbe68'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:21.581215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] The token cache is being invalidate because project 86f83f42d5bc4f2fad2763c05ae5ec16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:21.583006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:21.587940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:21.599404 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3413/6893] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:21 2022] DELETE /identity/v3/projects/86f83f42d5bc4f2fad2763c05ae5ec16 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:41:21.601336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:21.603498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:21.643924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a80a-d79e-44dc-942d-f54f52e5b805 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:21.867031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:21.868308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:21.868580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:21.868859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] PATH_INFO: `/v3/users/b5526daba0664e239062adcb5c8050b7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:21.872176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5526daba0664e239062adcb5c8050b7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:21.879039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:21.924540 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:22.020995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5526daba0664e239062adcb5c8050b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:22.025368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5526daba0664e239062adcb5c8050b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:22.051072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5526daba0664e239062adcb5c8050b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:22.064215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5526daba0664e239062adcb5c8050b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:22.103631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3b482fa7-a23b-4478-a425-67778a5f4dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5526daba0664e239062adcb5c8050b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:22.124936 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3481/6894] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:21 2022] DELETE /identity/v3/users/b5526daba0664e239062adcb5c8050b7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:22.780276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:22.781662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:22.810506 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:22.818177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390de43-4c52-4963-bf81-e609bbacbe68 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:22.958449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:22.962604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:22.963140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:22.963660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] PATH_INFO: `/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:22.968402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d3bb7cfdec48d4902c48ca47acf86e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:22.976179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.125130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d3bb7cfdec48d4902c48ca47acf86e', 'request_id': 'req-81f9c295-4bb7-49c7-95f6-7d236451a159'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:23.141925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d3bb7cfdec48d4902c48ca47acf86e', 'request_id': 'req-81f9c295-4bb7-49c7-95f6-7d236451a159'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:23.150675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d3bb7cfdec48d4902c48ca47acf86e', 'request_id': 'req-81f9c295-4bb7-49c7-95f6-7d236451a159'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:23.175917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] The token cache is being invalidate because project 41d3bb7cfdec48d4902c48ca47acf86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:23.176321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:23.179483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f9c295-4bb7-49c7-95f6-7d236451a159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:23.183366 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3414/6895] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:22 2022] DELETE /identity/v3/projects/41d3bb7cfdec48d4902c48ca47acf86e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:23.187911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.188400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.188675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.221901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:23.226520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:23.376490 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3482/6896] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:23.385224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.386033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.386554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.430110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:23.431263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:23.453962 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3415/6897] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:23.457923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.474437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d300b-fc27-468e-93a8-30bd02344165 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.486646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.487648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.488012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.488385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.489435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:23.489841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.491998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.510951 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3483/6898] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:41:23.514921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.529196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232db2c-53d6-4b6b-901d-cbaf81d38288 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.536348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.537795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.538299 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.538713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.539711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.542316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.581505 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3416/6899] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:23 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:23.586090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.599525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcadf2f-e34c-4a58-8a13-132bd01b3367 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.693094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.694811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.695203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.695586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.696875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.698923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.729342 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3484/6900] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:23 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:23.734184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.752278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14334a8-f0bc-4f50-9a4c-e8980a6d2f08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.774386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.775089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.775540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.775822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.776576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.778256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.823323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.827195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3417/6901] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:23.836926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa3c8a-9704-4cc4-bdb1-d0a98d0f014d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.843491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.844859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.855477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.856567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.857472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.859303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f597e-ad89-4d1f-93fd-9afd67bcf2cd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:23.876920 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:23.889732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3485/6902] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:41:23.910928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:23.928641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774bb25-1395-4ab5-a4c5-8cdfaa13fb0b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:23.938728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:23.939922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:23.940423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:23.940917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] PATH_INFO: `/v3/projects/53c7f8e706a24d85ac0e37c40a10c8b1/users/0e207ca283954d848208435830d8ccd6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:23.976957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c7f8e706a24d85ac0e37c40a10c8b1, user_id=0e207ca283954d848208435830d8ccd6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:23.984738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:24.030541 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3418/6903] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:23 2022] PUT /identity/v3/projects/53c7f8e706a24d85ac0e37c40a10c8b1/users/0e207ca283954d848208435830d8ccd6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:24.046011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:24.046011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:24.046011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:24.130690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] MFA Rules not processed for user `0e207ca283954d848208435830d8ccd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:24.133368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:24.283544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3486/6904] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:24.293919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:24.298983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:24.393567 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:24.431758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cda6a-cbcc-4d47-9be2-3431a0aeb958 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:24.437893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:24.438802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:24.439530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:24.439912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:24.451280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:24.452666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:24.465901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3419/6905] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:27.740096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:27.742237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:27.984403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:27.986189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:28.023573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de937725-e861-4c02-9bbf-e08b93f48f03 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:28.028293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac384d-7c6e-49e1-8bbc-8f383072aa35 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:28.046803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:28.050059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:28.050354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:28.050724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:28.050923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:28.051145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:28.051312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:28.051654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:28.056367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:28.057108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:28.110487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:28.112376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:28.120028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:28.122062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:28.143426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3487/6906] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:28.165084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3420/6907] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:37.506912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:37.534172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa9c0a-cd3f-4d26-a114-1333b4894dd9 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:37.552729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:37.554285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:37.555848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:37.556326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:37.561536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:37.627409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:37.629066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:37.680376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3488/6908] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:38.144218 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=18 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:44.986420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:45.009956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7165b57-a211-44d5-a9c5-19a2856582b5 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:45.038245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:45.038918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:45.039199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:45.039473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:45.045498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:45.093606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:45.095730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:45.145932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3421/6909] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:47.654370 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=70 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:50.152748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:50.300874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4ac5e-03c4-4de4-8d0c-6b3073c7ce48 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:50.313320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:50.314512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:50.326230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:50.326517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] PATH_INFO: `/v3/users/0e207ca283954d848208435830d8ccd6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:50.343455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e207ca283954d848208435830d8ccd6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:50.345399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:50.421798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:50.423461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.481587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e207ca283954d848208435830d8ccd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:50.483097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e207ca283954d848208435830d8ccd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:50.496455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e207ca283954d848208435830d8ccd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:50.511085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e207ca283954d848208435830d8ccd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:50.532434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-94e6105c-d8f3-461f-af67-fb3abe47f2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e207ca283954d848208435830d8ccd6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:50.546292 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3489/6910] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:50 2022] DELETE /identity/v3/users/0e207ca283954d848208435830d8ccd6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:50.547849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:50.548514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:50.548909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:50.574293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:50.575736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.642361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8ccc-8502-42bd-a602-191156f2cda7 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:50.671981 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3490/6911] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:50.673046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:50.674575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.704151 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:50.791726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8e33-70e8-408c-bb6f-24bfbc061522 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:50.806141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:50.806825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:50.807111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:50.807505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:50.809636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.837258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:50.837957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:50.839096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:50.846085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:50.856176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.859272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:50.866483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:50.913286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3491/6912] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:50.925054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:50.928818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:50.966519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfe809-6704-4d6e-bc42-cd5f90009b33 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:50.982615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:50.983450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:50.983801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:50.984144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:51.010452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:51.012175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:51.041885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3492/6913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:51.101934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:51.106838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ca593-d85c-447e-a5f7-5b10772b5027 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:51.141233 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3422/6914] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:41:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:41:52.251668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:52.253253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:52.288033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481f18c-7966-47db-841d-cdf6e11c97c5 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:52.311184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:52.312375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:52.312770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:52.313155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] PATH_INFO: `/v3/projects/53c7f8e706a24d85ac0e37c40a10c8b1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:52.315257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c7f8e706a24d85ac0e37c40a10c8b1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:52.316713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:52.489577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c7f8e706a24d85ac0e37c40a10c8b1', 'request_id': 'req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:52.517656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c7f8e706a24d85ac0e37c40a10c8b1', 'request_id': 'req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:52.537250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c7f8e706a24d85ac0e37c40a10c8b1', 'request_id': 'req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:52.556416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] The token cache is being invalidate because project 53c7f8e706a24d85ac0e37c40a10c8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:52.556719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:52.561866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1385cd60-fce4-45b8-ad8b-f49fcb4f1bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:52.568335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3493/6915] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:52 2022] DELETE /identity/v3/projects/53c7f8e706a24d85ac0e37c40a10c8b1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:52.569476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:52.570027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:52.570135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:52.667154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:52.670525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:52.755379 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:52.865115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3423/6916] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:52.873233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:52.873233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:52.873529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:52.924645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:52.925919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:52.956810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3494/6917] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:52.957026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:52.977731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b811f-2456-440e-8ce9-01172c054a92 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.000075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.002248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.008421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.008879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.009683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:53.010014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.022638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:53.076722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3424/6918] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:41:53.077980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:53.092599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b0f11-924f-47a2-8799-3049aff28c9d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.109526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.113715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.115211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.115504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.116213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.132605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:53.251837 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3495/6919] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:53 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:53.255874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:53.281094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e147e-e8bd-4800-8feb-8ac257566192 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.517028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.517741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.518034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.518315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.519038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.521143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:53.575164 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3425/6920] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:53 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:41:53.579355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:53.600147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed43e5-9cae-43ed-b367-2f2ee74c2017 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.623570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.624720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.625105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.625462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.626303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.627993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:53.666986 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3496/6921] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:53.670826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:53.683380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108b48-4956-4f42-9a85-e0998dd8e4a7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.726666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.731604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.733809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.733809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.733809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.734964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce25a8a-6374-4d92-84e3-771fccd290e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:53.789292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3426/6922] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:53.795080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:53.816514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e06e9-f17a-45a8-b8fb-ecb226a97eac admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:53.864154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:53.866585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:53.866916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:53.867164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] PATH_INFO: `/v3/projects/7700c045f8804a779a7e28000b6b56ce/users/bd1eaabb330e45b7b03aaaf6e801561d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:53.948138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7700c045f8804a779a7e28000b6b56ce, user_id=bd1eaabb330e45b7b03aaaf6e801561d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:53.959016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:54.002802 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3497/6923] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:53 2022] PUT /identity/v3/projects/7700c045f8804a779a7e28000b6b56ce/users/bd1eaabb330e45b7b03aaaf6e801561d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:54.014772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:54.015068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:54.015346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:54.105037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] MFA Rules not processed for user `bd1eaabb330e45b7b03aaaf6e801561d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:54.106575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:54.285300 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3427/6924] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:54.342362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:54.344338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:54.436905 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:54.502290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7ddf-7514-440b-be53-60a053636e75 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:54.515295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:54.515994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:54.516284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:54.516570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:54.537826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:54.539381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:54.565872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3498/6925] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:55.148480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:55.184689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8b6b8-98d5-42c8-8cd1-fe0880416ed2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:55.208991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:55.209694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:55.209983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:55.210260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:55.217723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:55.253296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:55.255742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f73d3-6e0b-49d1-9104-6d62ca44db76 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:55.293047 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3428/6926] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:55.586203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:55.806845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779606d-8c41-4b24-8f87-e3cb769abbb9 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:55.829716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:55.830806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:55.831194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:55.831593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] PATH_INFO: `/v3/users/bd1eaabb330e45b7b03aaaf6e801561d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:55.832985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1eaabb330e45b7b03aaaf6e801561d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:55.835052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:55.980959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1eaabb330e45b7b03aaaf6e801561d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:55.983204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1eaabb330e45b7b03aaaf6e801561d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:56.002527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1eaabb330e45b7b03aaaf6e801561d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:56.019737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1eaabb330e45b7b03aaaf6e801561d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:56.089353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1eaabb330e45b7b03aaaf6e801561d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:56.108059 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3499/6927] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:41:55 2022] DELETE /identity/v3/users/bd1eaabb330e45b7b03aaaf6e801561d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:56.112317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:56.112834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:56.113293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:56.166958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:56.168923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:56.196096 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:56.369639 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3429/6928] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:56.420819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:56.422627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:56.632788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8728aa-c9bb-4a41-8b4b-86733cd28d9a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:56.656182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:56.657239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:56.657792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:56.658313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:56.675015 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:56.696253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:56.697904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdc52e-b555-4314-b273-3c4bef1b9aac service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:56.736018 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3500/6929] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:41:58.316459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:58.320002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:58.368974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f01b3-c013-44b6-a837-feaab72e584c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:58.387394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:58.389488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:58.390030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:58.390731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] PATH_INFO: `/v3/projects/7700c045f8804a779a7e28000b6b56ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:58.392230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7700c045f8804a779a7e28000b6b56ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:58.398596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:58.519779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7700c045f8804a779a7e28000b6b56ce', 'request_id': 'req-d8ae95dd-b201-4179-9ae5-514695f58dd3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:58.535315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7700c045f8804a779a7e28000b6b56ce', 'request_id': 'req-d8ae95dd-b201-4179-9ae5-514695f58dd3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:58.551078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7700c045f8804a779a7e28000b6b56ce', 'request_id': 'req-d8ae95dd-b201-4179-9ae5-514695f58dd3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:58.578655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] The token cache is being invalidate because project 7700c045f8804a779a7e28000b6b56ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:41:58.579241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:58.580430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:41:58.585946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3430/6930] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:41:58 2022] DELETE /identity/v3/projects/7700c045f8804a779a7e28000b6b56ce => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:58.587807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec688-72ef-4a7c-8338-e39e05cda1f4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:58.588271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec688-72ef-4a7c-8338-e39e05cda1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:58.588544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec688-72ef-4a7c-8338-e39e05cda1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:58.627143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f00ec688-72ef-4a7c-8338-e39e05cda1f4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:58.628753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f00ec688-72ef-4a7c-8338-e39e05cda1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:58.644432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:58.647709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:58.891185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3501/6931] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:41:58.899184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:58.899633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:58.899910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:58.914250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae95dd-b201-4179-9ae5-514695f58dd3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:58.950340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:58.951623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:58.954515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:58.955530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:58.956972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:58.963943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:58.964570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:59.000833 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3502/6932] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:41:59.002069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.033535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e671aa-83de-4e40-bfb6-50579246d50c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.063826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.064905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.065347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.065851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.068102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:41:59.068583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.070417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.096664 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3503/6933] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:41:59.100795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.125241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0971e-10e0-4892-a2e5-97e65f4aac3b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.143962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.145175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.145847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.146349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.147275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.149503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.182826 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:41:59.218781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.220420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.221468 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3504/6934] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:41:59 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:41:59.225336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.293024 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3431/6935] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:41:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:41:59.414031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c00f9e-679a-4d3d-8ece-f93cf11053bf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.433032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.434579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.434972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.435293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.438752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.443455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.510018 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3505/6936] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:41:59 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:41:59.511877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.537932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4882ea-9582-4cb6-b00b-5a44e22a01da service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.560004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.560695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.560976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.561700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.562011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.563624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.592272 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3432/6937] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:59.595950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.612613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcb6a-cd5b-49ab-987d-82422dd9b8b2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.625172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.632655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.633055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.633405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.635610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.637322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d43ae-dabb-4906-8141-76f3b0dbba44 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.671290 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3506/6938] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:41:59.675657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:41:59.697205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098790a-f4e1-42a3-9480-4a0bf308d315 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:41:59.726565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:41:59.727698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.728162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.728630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] PATH_INFO: `/v3/projects/98b00f5c9a1d43629e74ce8bebc610b0/users/562ec59ea7ce4a2a826c681069dc2318/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.775189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b00f5c9a1d43629e74ce8bebc610b0, user_id=562ec59ea7ce4a2a826c681069dc2318, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:41:59.784824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:41:59.823201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3433/6939] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:41:59 2022] PUT /identity/v3/projects/98b00f5c9a1d43629e74ce8bebc610b0/users/562ec59ea7ce4a2a826c681069dc2318/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:41:59.835332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:41:59.836357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:41:59.836858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:41:59.897573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] MFA Rules not processed for user `562ec59ea7ce4a2a826c681069dc2318`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:41:59.899085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:41:59.926119 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:00.073511 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3507/6940] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:00.083500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:00.085422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:00.211247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8842-ece1-4757-8fab-8e2b46ec6747 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:00.216343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:00.216343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:00.216343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:00.218686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:00.243958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:00.244376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfbc0c-42d9-4d62-a2d4-0e2faf124d3c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:00.259946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3434/6941] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:07.396162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:07.397626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:07.620149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd7805-1863-45c2-8b4d-0a3d4269e458 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:07.634990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:07.636426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:07.637436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:07.638022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] PATH_INFO: `/v3/users/22ef3760959d4a3488a75e0e110b1b86` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:07.641606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ef3760959d4a3488a75e0e110b1b86)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:07.648713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:07.763723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ef3760959d4a3488a75e0e110b1b86'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:07.764629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ef3760959d4a3488a75e0e110b1b86'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:07.779956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ef3760959d4a3488a75e0e110b1b86'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:07.815513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ef3760959d4a3488a75e0e110b1b86'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:07.841281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ef3760959d4a3488a75e0e110b1b86'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:07.897315 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3508/6942] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:07 2022] DELETE /identity/v3/users/22ef3760959d4a3488a75e0e110b1b86 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:07.899151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:07.899627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:07.899849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:07.939632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:07.943122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:08.110254 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3435/6943] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:08.122481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:08.123536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:08.242853 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:08.278851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faed18-7a67-4054-b006-2f823ac97685 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:08.282840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:08.283499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:08.283780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:08.284052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:08.314432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:08.320617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eebdb5-9be7-460d-a50a-0c079214f8be service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:08.344255 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3509/6944] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:08.775317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:08.776970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:08.800233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164c30-d22b-4e3f-818b-54828e042f8f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:08.820105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:08.821274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:08.821652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:08.822044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] PATH_INFO: `/v3/projects/014071d36fe2407daf548d221451ade6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:08.827386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=014071d36fe2407daf548d221451ade6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:08.829565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:08.927673 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:08.934766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014071d36fe2407daf548d221451ade6', 'request_id': 'req-d9b9f707-d9c8-4222-b352-75d1be78fedb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:08.949586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014071d36fe2407daf548d221451ade6', 'request_id': 'req-d9b9f707-d9c8-4222-b352-75d1be78fedb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:08.968831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014071d36fe2407daf548d221451ade6', 'request_id': 'req-d9b9f707-d9c8-4222-b352-75d1be78fedb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:08.990259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] The token cache is being invalidate because project 014071d36fe2407daf548d221451ade6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:08.990845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:08.991891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d9b9f707-d9c8-4222-b352-75d1be78fedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:08.997567 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3436/6945] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:08 2022] DELETE /identity/v3/projects/014071d36fe2407daf548d221451ade6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:08.999238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:08.999736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.000071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.034486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:09.036621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:09.182475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3510/6946] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:09.190650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.191097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.191563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.218118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:09.219435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:09.229726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3437/6947] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:09.234028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.247535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533eaa-e6ed-4e10-ae45-0ca15b11b1ad None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.258191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.259163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.260493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.260996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.262082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:09.262892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.267272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.307185 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3511/6948] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:09.311635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.327699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9784-9dbe-41fc-98c8-cc35481ee897 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.338691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.339706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.342043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.342583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.344499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.350628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.419323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3438/6949] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:09 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:09.420078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.437831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ad14-e4f3-4680-824a-5fb4a473b9da admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.599228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.600245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.605925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.605925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.605925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.617418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.663534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3512/6950] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:09 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:09.667823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.688227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccbbad-62a6-4acb-bb85-aa24cd89ab5f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.702551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.705332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.705629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.705929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.708832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.719059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.769052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.776148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3439/6951] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:09.787976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1033d5-bf45-49a5-90f1-8ceed598a787 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.799307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.802149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.802574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.803016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.805468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.810600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf61a5d-ac7e-491a-9397-c4a5172a4181 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.841994 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3513/6952] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:09.843185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:09.860551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad002-774d-47a0-83a6-f5aad78c9d86 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:09.869154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:09.871651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.872457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.873204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] PATH_INFO: `/v3/projects/6ce481565ca64e6db6d065467ddf2102/users/c21609d2e74a43c2b21dce191e7a4a67/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:09.927528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce481565ca64e6db6d065467ddf2102, user_id=c21609d2e74a43c2b21dce191e7a4a67, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:09.937570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:09.970361 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3440/6953] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:09 2022] PUT /identity/v3/projects/6ce481565ca64e6db6d065467ddf2102/users/c21609d2e74a43c2b21dce191e7a4a67/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:09.984472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:09.984803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:09.985035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:10.066666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] MFA Rules not processed for user `c21609d2e74a43c2b21dce191e7a4a67`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:10.068500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:10.178629 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:10.252418 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3514/6954] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:10.296273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:10.298479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:10.491303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa55b76-48a1-4a3b-9a1a-0c5b1d100104 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:10.496267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:10.497182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:10.497662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:10.498163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:10.510663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:10.512461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:10.524384 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3441/6955] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:16.924997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:16.927859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:17.112140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0893-a2ec-4202-9ec8-0b96e244a51b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:17.126358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:17.128498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:17.131050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:17.134380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] PATH_INFO: `/v3/users/d7cb0037a91f461f8f39e28fe3c1ba85` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:17.137789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cb0037a91f461f8f39e28fe3c1ba85)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:17.140652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:17.284324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cb0037a91f461f8f39e28fe3c1ba85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:17.286560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cb0037a91f461f8f39e28fe3c1ba85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:17.310808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cb0037a91f461f8f39e28fe3c1ba85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:17.330596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cb0037a91f461f8f39e28fe3c1ba85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:17.372329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4d7c4811-577f-4d32-83b4-9329e87dbae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cb0037a91f461f8f39e28fe3c1ba85'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:17.395782 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3515/6956] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:16 2022] DELETE /identity/v3/users/d7cb0037a91f461f8f39e28fe3c1ba85 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:18.071368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:18.117210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac25b9-9918-4b61-960f-631fbf4b5d7c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:18.373519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:18.374474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:18.374755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:18.375030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] PATH_INFO: `/v3/projects/faa2aefb6f8846fc9211fec841a4351d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:18.379232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa2aefb6f8846fc9211fec841a4351d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:18.386592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:18.431749 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:18.512275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa2aefb6f8846fc9211fec841a4351d', 'request_id': 'req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:18.528876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa2aefb6f8846fc9211fec841a4351d', 'request_id': 'req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:18.546533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa2aefb6f8846fc9211fec841a4351d', 'request_id': 'req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:18.578358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] The token cache is being invalidate because project faa2aefb6f8846fc9211fec841a4351d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:18.581584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:18.584604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-864b59a8-f3a5-4bbe-873e-ca36740ba3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:18.594059 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3442/6957] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:18 2022] DELETE /identity/v3/projects/faa2aefb6f8846fc9211fec841a4351d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:18.598325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:18.598775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:18.598955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:18.638153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:18.639446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:18.820748 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:18.870449 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3516/6958] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:18.871740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:18.872041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:18.872323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:18.900952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:18.903170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:18.914188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3443/6959] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:18.918148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:18.937081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83e7-2b3f-4e3d-87bf-3667be8fbf22 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:18.954463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:18.956018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:18.956018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:18.956018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:18.960766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:18.960766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:18.963757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.003392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3517/6960] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:19.007936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:19.037993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3b6c0-4309-410e-9e64-d9aa04678877 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:19.059391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:19.060176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.060436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.060713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.069726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:19.075133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.190136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3444/6961] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:19 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:19.194522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:19.211833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555eb1-f0ba-48dd-ade5-1b532ef8bf3b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:19.386686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:19.387381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.387664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.387942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.388786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:19.393068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.458129 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3518/6962] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:19 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:19.462284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:19.492125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f76de-4eac-4fbb-9b54-8f44075561f7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:19.508833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:19.512302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.512819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.514071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.515676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:19.518739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.545570 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3445/6963] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:19.549083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:19.577346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff691-d079-4279-9daa-bdc9c0bc4ad5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:19.583646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:19.584695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.585418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.585896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.587499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:19.591808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03051-2607-498a-ad5c-100f24be4018 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.611937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3519/6964] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:19.616500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:19.635715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89af1b-8957-4d35-8862-b0e65f614444 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:19.657469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:19.658974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.659258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.660683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] PATH_INFO: `/v3/projects/d87190e6623c4f87b1933e489b33c42f/users/fe81a08dbe9e437896a087e92422f631/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.692192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87190e6623c4f87b1933e489b33c42f, user_id=fe81a08dbe9e437896a087e92422f631, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:19.696067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:19.717636 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3446/6965] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:19 2022] PUT /identity/v3/projects/d87190e6623c4f87b1933e489b33c42f/users/fe81a08dbe9e437896a087e92422f631/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:19.731982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:19.732273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:19.733863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:19.805984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] MFA Rules not processed for user `fe81a08dbe9e437896a087e92422f631`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:19.807613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:19.970866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3520/6966] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:19.975664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:20.171039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc888411-2935-42a6-b352-836f56895ef5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:20.177132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:20.178135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:20.178487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:20.178835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:20.179909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:20.182349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:20.253226 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3447/6967] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:19 2022] POST /identity/v3/projects => generated 389 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:20.258023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:20.276091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc710-6d8d-4ff2-b408-d97cd41ca231 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:20.455239 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:20.479992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:20.482267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:20.483454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:20.484424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:20.486083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:20.496509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:20.542641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:20.545008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3521/6968] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:20 2022] POST /identity/v3/users => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:20.558541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b932-1347-40a5-b976-69709550998d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:20.572288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:20.572976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:20.573257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:20.573538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:20.574296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:20.575921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:20.626040 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3448/6969] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:20.630956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:20.644885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dbb41-8509-41dc-ab8a-b4d163d60c38 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:20.664206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:20.666281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:20.668562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:20.668954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] PATH_INFO: `/v3/projects/f575c25ea879424fb9f4590ad1146e89/users/5bc83f7d296448dd9317951946404980/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:20.724747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f575c25ea879424fb9f4590ad1146e89, user_id=5bc83f7d296448dd9317951946404980, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:20.735675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:20.775956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3522/6970] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:20 2022] PUT /identity/v3/projects/f575c25ea879424fb9f4590ad1146e89/users/5bc83f7d296448dd9317951946404980/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:20.776577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:20.799142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1259e-2105-4297-a1fd-def64a56fcd1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:20.858281 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:21.035257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:21.036443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:21.036956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:21.037444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:21.038469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:21.040876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39fb7d-4a55-48be-811c-7872018d0b66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:21.086028 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3449/6971] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:21.087308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:21.108053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f00be2-6ab5-42e2-8473-7de86813e759 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:21.135961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:21.137968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:21.138255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:21.138535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] PATH_INFO: `/v3/projects/f575c25ea879424fb9f4590ad1146e89/users/5bc83f7d296448dd9317951946404980/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:21.146125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f575c25ea879424fb9f4590ad1146e89, user_id=5bc83f7d296448dd9317951946404980, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:21.149483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:21.177847 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3523/6972] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:21 2022] PUT /identity/v3/projects/f575c25ea879424fb9f4590ad1146e89/users/5bc83f7d296448dd9317951946404980/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:21.192182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:21.194944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:21.195454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:21.279223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] MFA Rules not processed for user `5bc83f7d296448dd9317951946404980`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:21.285464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:21.578134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3450/6973] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:21.578778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:21.601693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c472-9237-4fe5-9f90-466c7fc7cfff admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:21.621517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:21.627911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:21.628217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:21.630257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:21.631088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:21.637278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:21.696604 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3524/6974] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:21 2022] POST /identity/v3/domains => generated 277 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:42:21.701541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:21.717800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54f65-eed5-48bc-9c89-3fe70ecaa103 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:21.874396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:21.875775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:21.875775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:21.876490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:21.888320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:21.891911 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:21.891911 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:21.891911 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:21.893429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:21.982793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:21.985511 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3451/6975] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:42:21 2022] PUT /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config => generated 138 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:22.000109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92470b2c-78c6-4ec7-9e31-82cdea0a43d8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.036043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.036907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.037196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.037479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.054859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883, group=identity)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.056681 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:22.056681 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:22.056681 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:22.057157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.077618 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3525/6976] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:42:21 2022] GET /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/identity => generated 45 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:22.079225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.160457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080ae8-72df-4ad6-9fa4-e2f0a1f154ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.192773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.193686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.200477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.200784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/identity/driver` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.223601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883, group=identity, option=driver)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.232523 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:22.232523 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:22.232523 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:22.233468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.243060 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:22.270392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.271152 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3452/6977] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:42:22 2022] GET /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/identity/driver => generated 31 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:22.286622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cc5b-ea03-4108-8551-81161821538a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.299618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.301259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.301814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.302314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.304464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883, group=ldap)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.307397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.323536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3526/6978] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:42:22 2022] GET /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap => generated 106 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:22.328022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.343778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9943c-e0e7-4459-b3f0-cd34aae51d41 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.365016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.369278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.369577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.369917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap/url` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.377096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883, group=ldap, option=url)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.387449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.401936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3453/6979] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:42:22 2022] GET /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap/url => generated 46 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:22.405488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.421731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334d59b-c3c0-4fff-a8c3-0f9bbc6f183a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.430070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.432571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.433924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.434278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap/user_tree_dn` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.435737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883, group=ldap, option=user_tree_dn)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.437847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.452991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.453603 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3527/6980] 10.222.0.27 () {58 vars in 1301 bytes} [Sun Jul 24 01:42:22 2022] GET /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config/ldap/user_tree_dn => generated 63 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:22.466790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ad5-176a-4d06-b25e-8dd949dd00f6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.477077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.478164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.478586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.479143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.479968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1ab47cc2b05940a7822e2e155b392883)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.481476 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:22.481476 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:22.481476 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:22.483076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.500323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3454/6981] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:22 2022] DELETE /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883/config => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:22.506479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.527513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1e69-7865-41fe-86b6-80a57b7f2a36 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:22.560267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:22.561188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:22.561477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:22.567540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:22.573608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1ab47cc2b05940a7822e2e155b392883)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:22.576178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:22.669587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:22.672643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:22.778963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:22.779718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:22.787343 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3528/6982] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:22 2022] PATCH /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883 => generated 278 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:22.789786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:22.792219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:22.857788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1091ad-76a4-46d4-9937-8271e4dc65d4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:23.090634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:23.092137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:23.092726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:23.093228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:23.161111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1ab47cc2b05940a7822e2e155b392883)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:23.164512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:23.259166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.284466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1ab47cc2b05940a7822e2e155b392883'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.399367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.411654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.426761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.461875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] The token cache is being invalidate because project 1ab47cc2b05940a7822e2e155b392883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:23.462172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.467121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.486555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.490053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.494578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1ab47cc2b05940a7822e2e155b392883', 'request_id': 'req-8841c9b0-80fc-4ffd-b800-ba0e515a5606'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:23.512344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3455/6983] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:22 2022] DELETE /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:23.520326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:23.544054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f361-d554-438c-88be-096fd4ac57c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:23.763501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:23.768105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:23.772423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:23.772970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:23.774016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:23.783249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:23.829563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3529/6984] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:23 2022] POST /identity/v3/domains => generated 277 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:23.834360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:23.835816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:23.876603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c9b0-80fc-4ffd-b800-ba0e515a5606 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:23.928427 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:24.124217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.125385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.133496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.134178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.135260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.139222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.232412 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3456/6985] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:42:23 2022] PUT /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 138 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:42:24.236956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.271190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aa40c-4b74-4234-bd5b-55971d89172c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.290174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.295134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.295462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.303431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.304521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.308573 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:24.308573 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:24.308573 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:24.309958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.346288 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:24.474993 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3530/6986] 10.222.0.27 () {60 vars in 1270 bytes} [Sun Jul 24 01:42:24 2022] PATCH /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 142 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:24.479417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.502804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f95a-6464-41eb-8705-1a11b3fc7442 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.533579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.547489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.547789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.548080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.556562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.558520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.578699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3457/6987] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:24 2022] GET /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 142 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:24.585450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.600527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670fc62-c020-42b7-86b8-46e537dd96d2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.608523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.609909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.610391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.610685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.611362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.612417 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:24.612417 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:24.612417 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:24.614102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.638374 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3531/6988] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:24 2022] DELETE /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:24.643398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.675195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e795-e91e-4bb4-967f-781dd873fd4d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.712528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.716364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.716364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.716364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.719725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.726671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find any options in domain configuration for domain c93f7ecdbecb4f89a519f6218ec29534.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain c93f7ecdbecb4f89a519f6218ec29534. Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:24.783070 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain c93f7ecdbecb4f89a519f6218ec29534. Jul 24 01:42:24.784101 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:24.789089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3458/6989] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:24 2022] GET /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 151 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:24.792960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.835255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cebee7-a4c8-40b1-9ea6-7ef5b89aa282 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.843274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.844485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.845135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.845292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.846164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.848534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.857882 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3532/6990] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:24 2022] DELETE /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534/config => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:24.861958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.875619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a0ea6-ca20-47b5-a863-ef132557e638 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:24.882644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:24.885473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:24.886723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:24.887210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:24.891015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:24.893887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:24.935271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:24.936099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:24.981810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:24.983653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:24.996315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:24.998647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:24.999686 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3459/6991] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:24 2022] PATCH /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534 => generated 278 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:25.032845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea9b55-0de5-4099-a9a0-ed0cc3a3f188 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:25.234491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:25.242951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:25.245087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:25.245498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:25.277409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c93f7ecdbecb4f89a519f6218ec29534)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:25.284098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:25.342967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.377528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.512747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.538489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.564219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.602622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] The token cache is being invalidate because project c93f7ecdbecb4f89a519f6218ec29534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:25.603177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.605153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.628188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.632257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.634451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c93f7ecdbecb4f89a519f6218ec29534', 'request_id': 'req-ff97944e-638d-427e-96b6-570a92bf16ad'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:25.671444 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3533/6992] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:24 2022] DELETE /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:25.677890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:25.693375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0f977-7556-400a-b0f3-37cda518dc8f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:25.959014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:25.960434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:25.963287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:25.964853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:25.966132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:25.975772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.018430 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3460/6993] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:25 2022] POST /identity/v3/domains => generated 277 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:26.019334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.020797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:26.043262 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:26.059655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97944e-638d-427e-96b6-570a92bf16ad tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.301948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.303561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.303844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.304125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.304891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.312608 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:26.312608 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:26.312608 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:26.313546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.424511 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3534/6994] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:42:26 2022] PUT /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config => generated 138 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:26.429825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.448762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.451283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:26.460552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20688f36-5fc6-45ef-a9e0-5febc6e8604e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.484340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.485309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.485602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.485914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.486686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.487762 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:26.487762 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:26.487762 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:26.499742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.544623 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:26.579340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3461/6995] 10.222.0.27 () {60 vars in 1296 bytes} [Sun Jul 24 01:42:26 2022] PATCH /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity => generated 176 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:26.580257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.600942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6fb80-04e6-4067-b931-10e02d3aa72e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.616120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bca1f-3d1e-41f4-bc19-ffa2f165854d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.620314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.622294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.623132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.624899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.628846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity, option=driver)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.631966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.634298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.634675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.635693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.635980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] PATH_INFO: `/v3/users/c21609d2e74a43c2b21dce191e7a4a67` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.640231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21609d2e74a43c2b21dce191e7a4a67)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.643107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.697085 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3462/6996] 10.222.0.27 () {60 vars in 1317 bytes} [Sun Jul 24 01:42:26 2022] PATCH /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver => generated 176 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:26.700979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.736861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac303fdb-d88d-4646-99fc-3812af9281a4 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.753732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.754648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.754935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.757380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.758129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity, option=driver)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.763622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.798062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21609d2e74a43c2b21dce191e7a4a67'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:26.798973 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3463/6997] 10.222.0.27 () {58 vars in 1298 bytes} [Sun Jul 24 01:42:26 2022] DELETE /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:26.802309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21609d2e74a43c2b21dce191e7a4a67'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:26.804490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.806792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:26.819466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21609d2e74a43c2b21dce191e7a4a67'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:26.835418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21609d2e74a43c2b21dce191e7a4a67'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:26.838361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5ca6d-841b-4a39-bfe0-0e57f8016b21 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.859810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:26.861101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.861570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.862053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.864924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity, option=driver)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:26.866778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:26.876595 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:26.885111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c903cb1-35b0-4ebd-96a7-e88cd16bd957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21609d2e74a43c2b21dce191e7a4a67'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find option driver in group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:26.898487 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:26.899646 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:26.916181 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3535/6999] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:26 2022] DELETE /identity/v3/users/c21609d2e74a43c2b21dce191e7a4a67 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:26.916912 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3464/6998] 10.222.0.27 () {58 vars in 1295 bytes} [Sun Jul 24 01:42:26 2022] GET /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity/driver => generated 171 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:26.918109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:26.919403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:26.921449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:26.922095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:26.945031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd41a5b-b771-4783-b116-2fbb7bc0df64 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:26.984342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:26.993284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:27.090458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.091363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.091652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.098060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.098555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.102080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.142475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3536/7000] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:27.155376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.159375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:27.171763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3465/7001] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:42:26 2022] DELETE /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:27.172900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.189213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290514b-9a05-49b3-ac76-581dd6a3176c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:27.205196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.206112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.206431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.207363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.210083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512, group=identity)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.211897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:27.255803 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:27.256811 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:27.260479 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3466/7002] 10.222.0.27 () {58 vars in 1274 bytes} [Sun Jul 24 01:42:27 2022] GET /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config/identity => generated 154 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:27.263974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.293512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc597e-a844-4668-9e91-82589f7e6185 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:27.296987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22b84f-d9c5-4ece-94de-7582423c985c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:27.298095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.298918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.299273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.299741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.312191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.314470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.327343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.328230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.329915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.330221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512/config` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.330923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d6da8d6041454b8da61959ad5c938512)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.333335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.344087 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3537/7003] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:27.363784 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3467/7004] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:27 2022] DELETE /identity/v3/domains/d6da8d6041454b8da61959ad5c938512/config => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:27.368692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.386401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db19e0-137f-4a08-a4b6-d21c138462db service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:27.392228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.393234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.393532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.393840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.397268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d6da8d6041454b8da61959ad5c938512)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.417210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.523508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:27.523508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:27.556196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:27.557155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:27.560399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3538/7005] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:27 2022] PATCH /identity/v3/domains/d6da8d6041454b8da61959ad5c938512 => generated 278 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:27.565724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.568706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:27.604721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376255c-86bd-4be5-b30d-c362814dc1ce tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:27.788070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:27.802403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:27.803115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:27.803602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:27.817072 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=10,keystone:INSERT=2,keystone:SELECT=88 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:27.846468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d6da8d6041454b8da61959ad5c938512)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:27.853304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:27.868847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:27.870564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:27.970706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.005702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd6da8d6041454b8da61959ad5c938512'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.060594 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:28.071068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957bd7-b421-476f-a296-1f246a0e148c tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.111384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.126105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.148211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.174717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] The token cache is being invalidate because project d6da8d6041454b8da61959ad5c938512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:28.176787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.179388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.196284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.200099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.208647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd6da8d6041454b8da61959ad5c938512', 'request_id': 'req-1224c73b-8d80-41c0-82a5-74934f07a879'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.230082 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3468/7006] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:27 2022] DELETE /identity/v3/domains/d6da8d6041454b8da61959ad5c938512 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:28.231625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.232061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.232521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.232806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.233085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] PATH_INFO: `/v3/projects/6ce481565ca64e6db6d065467ddf2102` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.233372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:28.236448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce481565ca64e6db6d065467ddf2102)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.255021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.409299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce481565ca64e6db6d065467ddf2102', 'request_id': 'req-e702176b-2c62-4f5a-9490-3513a10fbcd7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.427706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c73b-8d80-41c0-82a5-74934f07a879 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.428342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce481565ca64e6db6d065467ddf2102', 'request_id': 'req-e702176b-2c62-4f5a-9490-3513a10fbcd7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.443607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce481565ca64e6db6d065467ddf2102', 'request_id': 'req-e702176b-2c62-4f5a-9490-3513a10fbcd7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.465858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] The token cache is being invalidate because project 6ce481565ca64e6db6d065467ddf2102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:28.467406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.468909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e702176b-2c62-4f5a-9490-3513a10fbcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:28.477422 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3539/7007] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:27 2022] DELETE /identity/v3/projects/6ce481565ca64e6db6d065467ddf2102 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:28.479031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c3c-4692-4971-849d-a848b9fc8ec4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.481560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c3c-4692-4971-849d-a848b9fc8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.481989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320c3c-4692-4971-849d-a848b9fc8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.520920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d6320c3c-4692-4971-849d-a848b9fc8ec4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:28.522371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d6320c3c-4692-4971-849d-a848b9fc8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:28.560942 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:28.609481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.610294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.610447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.611026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.612485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.614520 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:28.614520 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:28.614520 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:28.631818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.638383 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3469/7008] 10.222.0.27 () {58 vars in 1172 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:28.642526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.645414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:28.660175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e1fa4-cbfb-4304-a69a-6ac89ea1be94 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.665648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.674402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.674779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.675222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.675906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.679735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.684433 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3470/7009] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.685390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.690802 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3540/7010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:28.699381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.699618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773c34e-133d-41a1-8a8c-280185ee507b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.705024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.705024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.718150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.719120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.719469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.719909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.720669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.722992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.727889 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3471/7011] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.728894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.757020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:28.761516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534222-ee75-413f-9b47-db8a79b0cbe2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.766946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:28.781003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.781856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.782144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.782428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.783107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.785799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.792715 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3541/7012] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:28.794382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.794684 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3472/7013] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.795601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.823152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c0dc7-9322-4887-9a26-84a345562461 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.829684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.830510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.830797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.831073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.831872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:28.832175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.833091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebc9b-9cce-495f-8f88-0d625aa23b49 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.833821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.846493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.848217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.848606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.848894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.849564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.851223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.852999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3473/7014] 10.222.0.27 () {58 vars in 1187 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:28.858352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.867758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3542/7015] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:42:28.871653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.887998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21143b0-cb24-47a2-a166-b05dfd360159 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.897799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73fbab-3a98-4aff-88b4-a5b53f7aef67 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.899769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.904651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.904968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.905251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.905985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.907644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.916650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3474/7016] 10.222.0.27 () {58 vars in 1199 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.917333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.917580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.918104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.918332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.918605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.919309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.921378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.930326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128e09-2753-43a4-9d5b-38af456b2514 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.936180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.937063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.937417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.937955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.938858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.940539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.942334 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3475/7017] 10.222.0.27 () {58 vars in 1202 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.946879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.958893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8cd4-770f-44c2-b393-d0a5ef3c3409 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:28.959427 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:28.965712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:28.966829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:28.967322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:28.967812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:28.968725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:28.973228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:28.979874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3476/7018] 10.222.0.27 () {58 vars in 1208 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:28.981352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:28.995793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6770f5d-1551-4c17-89aa-d8f57f9bd974 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.001978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.003188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.004435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.005541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.006961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.008916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.014144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3543/7019] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:28 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:29.014620 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3477/7020] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:28 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.014879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.017966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.049279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae7fa6-f29f-42fb-a94b-758672cdbe69 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.189564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0906d-d8ba-4054-9eb3-6a65fb80fdf4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.195014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.196063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.196582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.197073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.198035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.200329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.202276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.203072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.203358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.203644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.204291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.214934 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:29.214934 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:29.214934 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:29.216147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.220899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3544/7021] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.224311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.231504 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3478/7022] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:29 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:42:29.235166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.251859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd23baa-6969-4896-8571-eb6c815caa08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.255312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3f0b-7e01-42b3-a001-080ebafbfd5e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.257898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.258723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.259010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.259291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.260039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.262100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.272058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.272879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.273158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.273440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.274138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.275756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.284071 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3545/7023] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.289307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.289472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3479/7024] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:29.290532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.305122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c5ef-3fe2-4b6f-97c3-36a0bf5c07a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.307410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183ef49-66be-4dc6-88d6-61a992c6cee9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.322315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.323012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.323348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.323625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.324370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.325012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.326274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.328408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.328701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.328989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.331855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.335353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.340990 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3480/7025] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:29.342300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.350509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3546/7026] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:29.354624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.375170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8ad16-d47a-49e4-b87a-99a0adc81618 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.377528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c7bf2-320e-4685-8ee4-5d21de5617b4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.388930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.389276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.389784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.390226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.390326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.390410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.390654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.390654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] PATH_INFO: `/v3/projects/809e01c9372f4801ae3faf4a166bc07e/users/981d1f64c9904d8998af1b0a592fee5d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.391184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.392943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.399198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3481/7027] 10.222.0.27 () {58 vars in 1235 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.401735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.429731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21292-2d33-4423-8257-58aa91a83d87 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.433976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809e01c9372f4801ae3faf4a166bc07e, user_id=981d1f64c9904d8998af1b0a592fee5d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.437253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6540dc9-89d8-4ede-adef-04635397a6f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.451845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.455514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.455836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.456954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.458762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.462532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.465695 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3482/7028] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.471760 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3547/7029] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:29 2022] PUT /identity/v3/projects/809e01c9372f4801ae3faf4a166bc07e/users/981d1f64c9904d8998af1b0a592fee5d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:29.471944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.483214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.483653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.484035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.502514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5108-30df-4297-87fd-5c1489399373 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.548364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] MFA Rules not processed for user `981d1f64c9904d8998af1b0a592fee5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:29.549841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:29.690218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3548/7030] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:29.702657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.703365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.703520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.703757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.703980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.704702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.705523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:29.707732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.717981 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3483/7031] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.718978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.741900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e3b0-1522-4d56-8ac2-8070f78f0258 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.753429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.754396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.754697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.754984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.755678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.757273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.762869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3484/7032] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.763735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.784144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a69d6-312c-4226-8bdb-0ded83233978 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.802238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.803051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.803339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.803622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.804300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.806502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.808664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3485/7033] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.812734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.830234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4173d-547e-4513-8935-c1140164dfb2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.845005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.845851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.846143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.846430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.847333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.848968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.850329 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3486/7034] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.854824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.875033 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:29.881705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d47-1c7f-4da6-aece-9646b01379c7 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.894632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.895451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.895739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.896151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.896728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad73f21-a6cf-4bdd-9a59-c804b7e2d954 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.896852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.898323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.904427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3487/7035] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.905287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.905435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.906185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.906584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.906963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.919915 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:29.920196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.922693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.929522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8da340-5094-4bb8-883a-14947a6c5430 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:29.935752 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3549/7036] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:42:29.951666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:29.962824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:29.963803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:29.964137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:29.964439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:29.965147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:29.966813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:29.967995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3488/7037] 10.222.0.27 () {58 vars in 1268 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:29.973782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.003169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d616-90ec-4e07-9450-7b128a6c172e tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.034741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.035646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.035942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.036228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.036914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.038582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.044508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3489/7038] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:29 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.048046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.057887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c1f55-57d6-434f-a79f-44c867ae4218 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.063719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.064954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.065458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.066691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] PATH_INFO: `/v3/users/981d1f64c9904d8998af1b0a592fee5d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.069064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981d1f64c9904d8998af1b0a592fee5d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.071593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.080350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6ff3a-dde3-46bf-8a57-edfdf9eca67f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.103181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.104013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.104350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.105138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.105356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.107431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.112050 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3490/7039] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:30.131347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.153256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16884-e219-4924-86c7-98c4b306c3a1 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.181792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.182618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.182906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.183193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.184117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.185778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.188134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981d1f64c9904d8998af1b0a592fee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:30.192257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981d1f64c9904d8998af1b0a592fee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:30.195846 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3491/7040] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.196341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.202832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:30.208125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981d1f64c9904d8998af1b0a592fee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:30.228093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981d1f64c9904d8998af1b0a592fee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:30.252044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11271a82-fa9e-4b09-9cad-2dc4709e7c35 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.260130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981d1f64c9904d8998af1b0a592fee5d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:30.262812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.263360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.263647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.263927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.264594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.266252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54c4ad-985b-4194-9073-070462a978ca tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.274815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3550/7041] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:29 2022] DELETE /identity/v3/users/981d1f64c9904d8998af1b0a592fee5d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:30.274815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.275153 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3492/7042] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.276958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.277214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.277465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.318802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:30.320022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:30.419271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fc48-1fba-441f-95ef-906926590eb6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.434221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.435060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.435534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.435828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.436513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.439129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.444216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3551/7043] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.446049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.455513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3493/7044] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:30.466003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.467989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:30.475429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6d-1723-4c6f-95be-bbc2f1600992 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.488177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.489170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.489462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.489795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.490478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.492149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.501564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3552/7045] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:30.502948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.516312 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:30.528453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d8dc-7d35-4dd0-9cb5-0fbcb85b312f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.541471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.542363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.542657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.542949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.544751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.546784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.552597 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3553/7046] 10.222.0.27 () {58 vars in 1289 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:30.553515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.580647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef7bf0-df5f-49b0-82d3-5a0feaeab82d tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.594374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.595351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.595645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.595926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.596594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.602962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.607220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651b4b9-7ad9-4739-975f-fbc46f4521c5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.611949 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3554/7047] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.614115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.636227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e0be8-d755-4032-a92d-350fb34a0b6f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.639734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.640708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.641169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.641601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.656771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.656771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.656771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.657224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.657224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.657224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.662033 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3555/7048] 10.222.0.27 () {58 vars in 1265 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:30.667404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.679315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.680967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.705635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238962-c8e5-43d8-95c1-27307dd14c62 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.722379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3494/7049] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:42:30.741903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.742949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.743332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.744130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.744870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.747934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.756667 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3556/7050] 10.222.0.27 () {58 vars in 1307 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.758253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.773183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323dc1e-e5f9-4bc8-b469-92395cdc71e1 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.788365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.789307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.789621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.790006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.791818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.795929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.806833 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3495/7051] 10.222.0.27 () {58 vars in 1289 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.815125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.853599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9daee-c389-4d27-b449-c6b6c2a90336 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.871126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.872305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.872760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.873200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.874053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.875838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.887944 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3557/7052] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.889060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.911489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabf638-4191-4cd6-a403-62502d4ce0dd tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:30.940514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:30.941341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:30.941631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:30.954457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:30.956440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:30.963492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:30.969037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:30.970042 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3496/7053] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:30.988719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8351b-d6db-4a58-b011-18e4839920c6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.049912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.052441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.052736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.053030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.053725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.059004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.064538 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3558/7054] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:30 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:31.068954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.089211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fe3c0-e08f-4b61-bdae-7c45a8f9b5f2 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.101588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.102665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.103708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.106910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.107805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.109606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.114918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3497/7055] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:31.115981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.132528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2db0-aa06-400e-9904-15abc07aed75 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.143365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.144216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.144504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.144885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.145444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.147084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.148361 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3559/7056] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:31.152590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.173146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ad41b-4289-4eea-a77d-af3a83fcebdf tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.184647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.188012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.191705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.192808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.193948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.195912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.209257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3498/7057] 10.222.0.27 () {58 vars in 1253 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.210749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.224354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5070e-8176-4e66-96c4-8f1a647032a8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.234590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.235702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.238331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.238868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.240633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.244864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.248121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3560/7058] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.252362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.267807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb828a4-1457-48bb-8ede-6ceba5817f9a tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.277427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.279617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.280012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.281019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.283006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.288571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.290420 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3499/7059] 10.222.0.27 () {58 vars in 1250 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.290945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.307195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086533f8-7c86-4ca8-bda3-c8fcfa503de6 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.313653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.314860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.315374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.316562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.317506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.322051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.323865 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3561/7060] 10.222.0.27 () {58 vars in 1256 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:31.328449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.346776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.355963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:31.356811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccd89-d252-4063-a1ae-d13fab408c14 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.371349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.372409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.372791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.373341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.374391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.378824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.386244 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3500/7061] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.387481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.395722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765784-96a2-4b8e-a9b3-2fb550dc0aef tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.406468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.409144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caca35-7ea7-4028-99ba-6179ba678e91 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.410859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.411722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.412081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] PATH_INFO: `/v3/projects/809e01c9372f4801ae3faf4a166bc07e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.414299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=809e01c9372f4801ae3faf4a166bc07e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.417980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.423658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.424805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.426469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.430828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.432172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.434124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.439238 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3501/7062] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.440252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.467074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935a150-2de8-491a-ba1b-d9b1eb6dad30 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.478467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.479872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.482062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.482443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.483749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.485833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.489135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3502/7063] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.494374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.516266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da87723-15ca-44a0-8069-6b4fbb05472f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.536949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809e01c9372f4801ae3faf4a166bc07e', 'request_id': 'req-1177ebd8-68bf-4756-87e3-53249a68b46b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:31.550381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809e01c9372f4801ae3faf4a166bc07e', 'request_id': 'req-1177ebd8-68bf-4756-87e3-53249a68b46b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:31.572984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809e01c9372f4801ae3faf4a166bc07e', 'request_id': 'req-1177ebd8-68bf-4756-87e3-53249a68b46b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:31.590363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] The token cache is being invalidate because project 809e01c9372f4801ae3faf4a166bc07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:31.590692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:31.592228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1177ebd8-68bf-4756-87e3-53249a68b46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:31.600964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3562/7064] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:31 2022] DELETE /identity/v3/projects/809e01c9372f4801ae3faf4a166bc07e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:31.602438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e13a5-ae9d-4648-8ca7-46970e795fb5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.602735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e13a5-ae9d-4648-8ca7-46970e795fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.603018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e13a5-ae9d-4648-8ca7-46970e795fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.638964 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:31.649624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-584e13a5-ae9d-4648-8ca7-46970e795fb5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:31.654200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-584e13a5-ae9d-4648-8ca7-46970e795fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:31.664177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.664871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.667034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.667741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.668446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.671476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.680787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3503/7065] 10.222.0.27 () {58 vars in 1211 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.682004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.684994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:31.701335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adcc11-8e9c-4d47-8131-1bef1b9cbef9 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.707232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.709060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.709371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.709656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.710369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.712013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.716521 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3504/7066] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.717396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.740224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d5b5d-f7bc-4fe3-9d89-a2f9790c6535 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.746806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.747848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.748328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.748768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.749611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.751468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.753532 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3505/7067] 10.222.0.27 () {58 vars in 1214 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.757706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.770136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33237f8-0ae2-44f9-8abd-866aa789b745 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.776714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.777953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.778506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.779027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.779949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.782273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.788470 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3506/7068] 10.222.0.27 () {58 vars in 1217 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.789537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.802413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1b6f5-7d10-4acb-b0ca-be32322fb705 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.808323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.809259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.809553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.809988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.810980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.815405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.819472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3507/7069] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.823447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.836889 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3563/7070] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:31.848829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.849863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.850361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.859672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e3c3f-ef40-4bf3-813a-d3d5303e46c5 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.866911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.867703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.868134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.868293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.868945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.884106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.888518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3508/7071] 10.222.0.27 () {58 vars in 1238 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.889405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.903752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:31.905134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:31.908129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c08b7-8372-4ed9-992a-c8f2612ca757 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.922296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.923124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.923400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.923678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.924348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.930623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.939103 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3509/7072] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:31.940534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.941909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3564/7073] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:31.946155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:31.963184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b756740-c5ad-4e22-90e2-1132d814b310 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:31.981806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:31.981806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:31.981806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:31.982346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:31.982346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:31.982346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:31.986947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3510/7074] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 24 01:42:31.994733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.008408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218c52-53db-4299-b2ce-efa57384e9cc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.010514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00b9d-8474-42bc-884d-ca17be517bf8 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.029417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.030381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.030819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.031073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.031837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.035241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.038414 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3511/7075] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:32.045895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.049423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.052592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.052879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.053158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.070126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:32.070482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.072127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.080901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db24ffb-c337-41d7-96cd-0e919a04679b tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.098335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3565/7076] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:32.099202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.104627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.106201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.107760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.114529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.115708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.123089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.129856 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3512/7077] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:32 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:32.130781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.150137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279271f0-97d0-47f1-89d6-dac4b7b5b1dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.156719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3329-1cd3-4e84-9a2d-1493ff09e45f tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.171367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.172030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.172447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.172836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.173616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.179465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.185653 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3513/7078] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:42:32 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:42:32.187664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.188350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.188630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.188903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.189613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.192428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.198734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.221534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad581a-9e23-42b8-8916-872c939dd219 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.238687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.240169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.242390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.242846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/d6da8d6041454b8da61959ad5c938512` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.265750 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3566/7079] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:32 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:32.280393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.282097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:42:32.294771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find domain: d6da8d6041454b8da61959ad5c938512.: keystone.exception.DomainNotFound: Could not find domain: d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:32.319499 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:32.320938 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:42:32.322439 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d6da8d6041454b8da61959ad5c938512. Jul 24 01:42:32.323741 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.324148 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3514/7080] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:32 2022] PATCH /identity/v3/domains/d6da8d6041454b8da61959ad5c938512 => generated 112 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:32.324761 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:32.325106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.377818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc5ba7-6849-4201-a242-f93e2c474b13 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.450040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3bd7b-a6b5-4b3e-b7f9-790d00647d47 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.462378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.463318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.463675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.464030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.468371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:32.511788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.512655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.513380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.513886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.514659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.517134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.545880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3515/7081] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:32 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:32.560527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.631389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.633072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.658587 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3567/7082] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:32.663657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.682202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a04e3-25c3-42fa-849f-4a6b4367128c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.685622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713032d-762e-4796-a91e-5644536fc366 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.691109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.692241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.692696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.693168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/c93f7ecdbecb4f89a519f6218ec29534` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.705660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.707180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.707686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.708008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.708757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.710424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.712641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:42:32.728564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3568/7083] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:32.733060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find domain: c93f7ecdbecb4f89a519f6218ec29534.: keystone.exception.DomainNotFound: Could not find domain: c93f7ecdbecb4f89a519f6218ec29534. Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c93f7ecdbecb4f89a519f6218ec29534. Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:32.741300 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:32.742607 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:42:32.743807 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c93f7ecdbecb4f89a519f6218ec29534. Jul 24 01:42:32.745073 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.752490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393bdf3-6267-48d4-a902-a387425ab313 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.761570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.761570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.761570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.761570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.762207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.762616 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3516/7084] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:32 2022] PATCH /identity/v3/domains/c93f7ecdbecb4f89a519f6218ec29534 => generated 112 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:32.763634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.764531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.779076 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3569/7085] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:32.782602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.789531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402622-d118-4d07-8948-485a7332fe25 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.795483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ca525-c5af-4535-944b-b8820d2ec65d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:32.799467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bc83f7d296448dd9317951946404980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f575c25ea879424fb9f4590ad1146e89', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.801133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.801584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.802050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] PATH_INFO: `/v3/domains/1ab47cc2b05940a7822e2e155b392883` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.802657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:32.803646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.804038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.804422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] PATH_INFO: `/v3/projects/b7eb2124073d46e49650fd8fb20313a5/users/f70d47b1532a410d9d79a897d53b9ea9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.824996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7eb2124073d46e49650fd8fb20313a5, user_id=f70d47b1532a410d9d79a897d53b9ea9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:32.829684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:32.834388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-ceec66af-372e-472c-91e0-023bc3b48b17 tempest-DomainConfigurationTestJSON-220713589 tempest-DomainConfigurationTestJSON-220713589-project-admin] Could not find domain: 1ab47cc2b05940a7822e2e155b392883.: keystone.exception.DomainNotFound: Could not find domain: 1ab47cc2b05940a7822e2e155b392883. Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1ab47cc2b05940a7822e2e155b392883. Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:32.854129 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:32.855307 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:42:32.856644 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1ab47cc2b05940a7822e2e155b392883. Jul 24 01:42:32.858695 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:42:32.864554 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3570/7086] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:32 2022] PUT /identity/v3/projects/b7eb2124073d46e49650fd8fb20313a5/users/f70d47b1532a410d9d79a897d53b9ea9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:32.868408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3517/7087] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:32 2022] PATCH /identity/v3/domains/1ab47cc2b05940a7822e2e155b392883 => generated 112 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:32.868555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:32.874085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:32.874449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:32.874979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:32.875486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:32.933615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] MFA Rules not processed for user `f70d47b1532a410d9d79a897d53b9ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:32.935342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:32.953286 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:33.087188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd1518-591a-4fed-aea5-ffd57fce29f8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.101052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.102011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.103887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.104191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] PATH_INFO: `/v3/users/fe81a08dbe9e437896a087e92422f631` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.107250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe81a08dbe9e437896a087e92422f631)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.123387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.153581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:33.196729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3518/7088] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:33.198799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.232631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16149-04da-4ecd-bcac-970d535cf587 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.240192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe81a08dbe9e437896a087e92422f631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:33.241929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe81a08dbe9e437896a087e92422f631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:33.257261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.258662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe81a08dbe9e437896a087e92422f631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:33.259297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.262414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.262414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.264505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.274765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe81a08dbe9e437896a087e92422f631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:33.276995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.304096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6c94efe-8061-4792-a7ac-5e84f8ddc0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe81a08dbe9e437896a087e92422f631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:33.323999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3571/7089] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:32 2022] DELETE /identity/v3/users/fe81a08dbe9e437896a087e92422f631 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:33.340550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.340787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.341937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.362302 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3519/7090] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:33 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:33.363615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.385138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:33.391751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:33.393370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:33.547799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3572/7091] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:33.548283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f019c8f-10a3-4eb2-9ddb-01d5adb87d8d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.555418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.555838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.556124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.556400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.557107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.559623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.570306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.571821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:33.627253 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3520/7092] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:33 2022] POST /identity/v3/users => generated 308 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:33.632780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.663217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990c135-ed8c-483e-9030-57a11971c3dc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.679149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.681353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.682280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.683421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.684385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.689116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.726333 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3521/7093] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:33.727631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.761024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa413d-241d-449e-a587-b0cabb651362 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.767313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e53b87-e6f6-4b6d-a9f0-64a3618ea986 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.777389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.778400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:33.779585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.780772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:33.781276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.781780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:33.783158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.783652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] PATH_INFO: `/v3/projects/d04e6a571c3f4af69d9995afb25b2fba/users/48cd0e20d8cf4e28bb635e9b0935294c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:33.807995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.809784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.821746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04e6a571c3f4af69d9995afb25b2fba, user_id=48cd0e20d8cf4e28bb635e9b0935294c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:33.824798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:33.881987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3573/7094] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:33.897328 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3522/7095] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:33 2022] PUT /identity/v3/projects/d04e6a571c3f4af69d9995afb25b2fba/users/48cd0e20d8cf4e28bb635e9b0935294c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:33.902044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:33.917748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ac336-8b9e-4380-a543-e83950f66688 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:33.974065 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:34.081039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:34.082686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:34.083050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:34.083399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:34.087575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:34.090238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2afb51-f1d7-40d7-9ced-626c58db54b2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:34.119384 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3574/7096] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:34.121148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:34.148707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b512-d401-4027-9b40-c7fad0cea300 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:34.167621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:34.168184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:34.168468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:34.168744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] PATH_INFO: `/v3/projects/d04e6a571c3f4af69d9995afb25b2fba/users/48cd0e20d8cf4e28bb635e9b0935294c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:34.177157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04e6a571c3f4af69d9995afb25b2fba, user_id=48cd0e20d8cf4e28bb635e9b0935294c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:34.182966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:34.220868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3523/7097] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:34 2022] PUT /identity/v3/projects/d04e6a571c3f4af69d9995afb25b2fba/users/48cd0e20d8cf4e28bb635e9b0935294c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:34.232953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:34.233246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:34.233526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:34.344137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] MFA Rules not processed for user `48cd0e20d8cf4e28bb635e9b0935294c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:34.345407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:34.567293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3575/7098] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:34.575546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:34.577278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:34.692611 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:34.761236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:34.762561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:34.822236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f75a58-88a8-4e8c-9545-4e9d18fcf58b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:34.832496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:34.833839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:34.837034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:34.837589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:34.868613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:34.870129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:34.893345 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3524/7099] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:34.953594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789797d4-7f3a-42bf-ba11-9ff3cd8ea73a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:34.984630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:34.987980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:34.988710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:34.989505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] PATH_INFO: `/v3/projects/d87190e6623c4f87b1933e489b33c42f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:34.992375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87190e6623c4f87b1933e489b33c42f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:34.994636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:35.131734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87190e6623c4f87b1933e489b33c42f', 'request_id': 'req-5988de96-addf-4029-999e-95c5627ffeb6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.155950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87190e6623c4f87b1933e489b33c42f', 'request_id': 'req-5988de96-addf-4029-999e-95c5627ffeb6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.158518 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:35.158999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:35.175341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87190e6623c4f87b1933e489b33c42f', 'request_id': 'req-5988de96-addf-4029-999e-95c5627ffeb6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.183000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980c11-008d-42e5-a4f6-12e797e2bd9a service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:35.195261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] The token cache is being invalidate because project d87190e6623c4f87b1933e489b33c42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:35.195560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.197729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.231244 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3576/7100] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:34 2022] DELETE /identity/v3/projects/d87190e6623c4f87b1933e489b33c42f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:35.233592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:35.238767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:35.386392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:35.388255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:35.388543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:35.388823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] PATH_INFO: `/v3/users/f70d47b1532a410d9d79a897d53b9ea9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:35.393664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70d47b1532a410d9d79a897d53b9ea9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:35.397165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988de96-addf-4029-999e-95c5627ffeb6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:35.399869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:35.408831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:35.410772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:35.412504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:35.414188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] PATH_INFO: `/v3/users/5bc83f7d296448dd9317951946404980` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:35.416398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc83f7d296448dd9317951946404980)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:35.420256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:35.529521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70d47b1532a410d9d79a897d53b9ea9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.543095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70d47b1532a410d9d79a897d53b9ea9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.543896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc83f7d296448dd9317951946404980'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.544645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc83f7d296448dd9317951946404980'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.561463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70d47b1532a410d9d79a897d53b9ea9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.568047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc83f7d296448dd9317951946404980'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.580090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc83f7d296448dd9317951946404980'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.619726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70d47b1532a410d9d79a897d53b9ea9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.619726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-816149fe-c76a-452a-abdd-f90c0e722c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70d47b1532a410d9d79a897d53b9ea9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.623624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc83f7d296448dd9317951946404980'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:35.635791 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3525/7102] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:35 2022] DELETE /identity/v3/users/f70d47b1532a410d9d79a897d53b9ea9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:35.636751 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3577/7102] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:35 2022] DELETE /identity/v3/users/5bc83f7d296448dd9317951946404980 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:35.641988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:35.641988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:35.641988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:35.703575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:35.704823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:35.809831 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:35.835785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3526/7103] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:35.857906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:35.859415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:36.060320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1fc17-2686-45ae-89ec-8a512c0caa20 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:36.109114 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:36.192409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:36.193234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:36.193526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:36.193826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:36.216277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:36.222586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45683fa8-199b-44be-a98e-102a30fc65d7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:36.255885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3578/7104] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:37.320844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:37.322286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:37.361522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e625f5-0d00-4ce2-bd87-b878192398e1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:37.380194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:37.381362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:37.381914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:37.382435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] PATH_INFO: `/v3/projects/f575c25ea879424fb9f4590ad1146e89` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:37.386672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f575c25ea879424fb9f4590ad1146e89)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:37.390615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:37.501883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f575c25ea879424fb9f4590ad1146e89', 'request_id': 'req-feb26458-0c53-4e1f-89e6-f8b169f04c7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:37.520281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f575c25ea879424fb9f4590ad1146e89', 'request_id': 'req-feb26458-0c53-4e1f-89e6-f8b169f04c7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:37.527602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f575c25ea879424fb9f4590ad1146e89', 'request_id': 'req-feb26458-0c53-4e1f-89e6-f8b169f04c7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:37.562307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] The token cache is being invalidate because project f575c25ea879424fb9f4590ad1146e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:37.563474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:37.566355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-feb26458-0c53-4e1f-89e6-f8b169f04c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:37.575476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3527/7105] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:37 2022] DELETE /identity/v3/projects/f575c25ea879424fb9f4590ad1146e89 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:37.577234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:37.577886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:37.577886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:37.622896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:37.624166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:37.793032 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3579/7106] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:37.794822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:37.795157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:37.795443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:37.829399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:37.830862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:37.860846 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3528/7107] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:37.863073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:37.885892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1da2cd-6e4b-4bb9-a71e-cfa380c0083f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:37.899065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:37.899779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:37.900037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:37.900316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:37.901350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:37.901658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:37.906820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:37.938362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3580/7108] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:37.942841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:37.960216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62853-1cac-4ab6-9d19-3d3eda261960 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:37.975086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:37.976461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:37.976969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:37.977519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:37.978554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:37.981901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:38.029736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3529/7109] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:37 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:38.034048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:38.048151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bc58-84b3-46c6-8230-50b3ebb11bf3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:38.176359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:38.177204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:38.177500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:38.177799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:38.178522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:38.180467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:38.237072 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3581/7110] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:38 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:38.238398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:38.253761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6879-ea5a-43d8-abc1-be6aeaa88b6e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:38.290355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:38.291480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:38.299775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:38.301072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:38.302475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:38.317642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:38.359835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3530/7111] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:38.361456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:38.435550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd56aa2-3ab1-47a2-8193-c78a9167d13e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:38.455429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:38.458286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:38.458791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:38.459293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:38.460265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:38.462312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0c11-f46e-4467-90fd-158b7af0aeaf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:38.482075 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3582/7112] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:38.482502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:38.500937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2b3b-96f9-4c97-9167-5d8a14805625 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:38.570490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:38.571528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:38.571823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:38.572108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] PATH_INFO: `/v3/projects/9ac21cfd01f143b0ae69f71a7b5b51c9/users/d01471a38a88420d9b03293fe656313b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:38.619887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac21cfd01f143b0ae69f71a7b5b51c9, user_id=d01471a38a88420d9b03293fe656313b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:38.623930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:38.687299 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3531/7113] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:38 2022] PUT /identity/v3/projects/9ac21cfd01f143b0ae69f71a7b5b51c9/users/d01471a38a88420d9b03293fe656313b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:38.689849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:38.690791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:38.693628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:38.781239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:38.783214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] MFA Rules not processed for user `d01471a38a88420d9b03293fe656313b`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:38.783519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:38.785752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:38.845607 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:39.033218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3583/7114] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:39.036014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:39.064510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072857-c841-4ae1-9a08-b3c4f30d52a8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.082725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.083159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.083573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.083973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] PATH_INFO: `/v3/projects/b7eb2124073d46e49650fd8fb20313a5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.086479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7eb2124073d46e49650fd8fb20313a5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.087998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:39.134214 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:39.194993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050cc54-445a-4a1f-8415-b410f1eab9d3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.227342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7eb2124073d46e49650fd8fb20313a5', 'request_id': 'req-460d6def-684e-4288-8c47-fc79f03f5a1d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.246375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7eb2124073d46e49650fd8fb20313a5', 'request_id': 'req-460d6def-684e-4288-8c47-fc79f03f5a1d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.271957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7eb2124073d46e49650fd8fb20313a5', 'request_id': 'req-460d6def-684e-4288-8c47-fc79f03f5a1d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.297720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] The token cache is being invalidate because project b7eb2124073d46e49650fd8fb20313a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:39.298185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.298966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.300800 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3532/7115] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:38 2022] DELETE /identity/v3/projects/b7eb2124073d46e49650fd8fb20313a5 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:39.309234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.310764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:39.311683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.312148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.312281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:39.312686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.316448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.321234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:39.339521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6def-684e-4288-8c47-fc79f03f5a1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.362715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.363617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.363901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.364177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] PATH_INFO: `/v3/users/48cd0e20d8cf4e28bb635e9b0935294c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.365430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cd0e20d8cf4e28bb635e9b0935294c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.367399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:39.368877 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3584/7116] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:39 2022] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:39.379099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:39.381207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:39.516737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cd0e20d8cf4e28bb635e9b0935294c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.528953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cd0e20d8cf4e28bb635e9b0935294c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.540716 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:39.551557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cd0e20d8cf4e28bb635e9b0935294c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.567171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cd0e20d8cf4e28bb635e9b0935294c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.568122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cd0e20d8cf4e28bb635e9b0935294c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:39.579302 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3533/7117] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:39 2022] DELETE /identity/v3/users/48cd0e20d8cf4e28bb635e9b0935294c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:39.594443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd769-b5cf-4bdb-a6bb-d869597087a9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.732104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.733589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.734058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.735251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.739752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.742683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:39.811098 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3585/7118] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:39 2022] POST /identity/v3/users => generated 290 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:39.816652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:39.818292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:39.848907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcf5-ba95-4dbf-bbfc-c9571a9af3ab admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.862202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.864940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.865764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.866491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.870263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.872789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:39.907312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3534/7119] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:39.914112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:39.926320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447741b5-4911-4c7d-9a06-bdcf6c941a84 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:39.950862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:39.952033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:39.952513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:39.952956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] PATH_INFO: `/v3/projects/8ddea69167134cbebe94feb952d0e232/users/beb859d230f844239bce37f099c52908/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:39.993443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddea69167134cbebe94feb952d0e232, user_id=beb859d230f844239bce37f099c52908, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:39.997559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:40.025455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3586/7120] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:39 2022] PUT /identity/v3/projects/8ddea69167134cbebe94feb952d0e232/users/beb859d230f844239bce37f099c52908/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:40.029440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:40.043065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88c724-17ba-40f8-8f49-c4c3e02ce717 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:40.283327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:40.286763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:40.311079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:40.314273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:40.314754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:40.321125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:40.322470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:40.324208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:40.331981 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:40.358263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3535/7121] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:40.361209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:40.385116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d555f49-43ec-44d6-a9c5-f018c25faae6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:40.399657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:40.400994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:40.401507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:40.402046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] PATH_INFO: `/v3/projects/8ddea69167134cbebe94feb952d0e232/users/beb859d230f844239bce37f099c52908/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:40.408834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddea69167134cbebe94feb952d0e232, user_id=beb859d230f844239bce37f099c52908, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:40.413812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf6ccd-86fc-4fcc-af2d-4e92c0734d32 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:40.466091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3536/7122] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:40 2022] PUT /identity/v3/projects/8ddea69167134cbebe94feb952d0e232/users/beb859d230f844239bce37f099c52908/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:40.469038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:40.469512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:40.470040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:40.558815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6a86-11a4-400a-b4cd-0665a6f78800 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:40.602288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] MFA Rules not processed for user `beb859d230f844239bce37f099c52908`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:40.603622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:40.721423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:40.722387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:40.722667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:40.722942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] PATH_INFO: `/v3/projects/d04e6a571c3f4af69d9995afb25b2fba` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:40.724545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04e6a571c3f4af69d9995afb25b2fba)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:40.726257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:40.753738 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:40.857866 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3537/7123] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:40.860132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:40.871382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04e6a571c3f4af69d9995afb25b2fba', 'request_id': 'req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:40.884917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce411e-fe6c-4ed1-817e-09f92b605fc2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:40.894293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04e6a571c3f4af69d9995afb25b2fba', 'request_id': 'req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:40.918037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04e6a571c3f4af69d9995afb25b2fba', 'request_id': 'req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:40.984997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] The token cache is being invalidate because project d04e6a571c3f4af69d9995afb25b2fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:40.984997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:40.985312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c3f7927-49b7-4ebd-a8f7-0c8dd67d48c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:40.989714 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3587/7124] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:40 2022] DELETE /identity/v3/projects/d04e6a571c3f4af69d9995afb25b2fba => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:41.003930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a390-d6d8-4476-9cc8-970537eae2dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.012851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a390-d6d8-4476-9cc8-970537eae2dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.013331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a390-d6d8-4476-9cc8-970537eae2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.122381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.123184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.123856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.123856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.125156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.127472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.140249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f4a2a390-d6d8-4476-9cc8-970537eae2dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:41.145385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f4a2a390-d6d8-4476-9cc8-970537eae2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:41.187424 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3538/7125] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:40 2022] POST /identity/v3/domains => generated 276 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:41.217210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.231291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:41.321989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3588/7126] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:41.326839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.327128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.327392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.367730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:41.374829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:41.446990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34d59c-9ce5-4cdb-9565-9610938ae826 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.462921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.464558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.465590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.466613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.468901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.471430 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:41.471430 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:41.471430 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:41.474951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.495544 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:41.549928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3539/7127] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:41 2022] POST /identity/v3/groups => generated 279 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:41.553647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.566925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3589/7128] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:41.571443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.600610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedd168-f957-499c-82af-a20e56e441f4 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.615006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.616135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.616433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.616772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.631964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:update_group(group_id=7f4d1371cea84acfbccdbf3c43e6fd5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.633619 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:41.633619 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:41.633619 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:41.635230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e2693-aa24-4ea4-bf4e-ff44d6ad2808 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.635378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.679126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.679962 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3540/7129] 10.222.0.27 () {60 vars in 1246 bytes} [Sun Jul 24 01:42:41 2022] PATCH /identity/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d => generated 293 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:41.680651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.681819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.683355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.684204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.685184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:41.686857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.688600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.710619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbed7d2-06da-499e-bee2-99b8fb3cb88c tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.725815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.730148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.730349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.730914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.731084 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3590/7130] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:41.734982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.748935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:get_group(group_id=7f4d1371cea84acfbccdbf3c43e6fd5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.750157 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:41.750157 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:41.750157 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:41.750695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b161-7cec-40ef-9436-e7055d2da7f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.758267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.759250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.759562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.759974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.760302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.760901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.762788 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3541/7131] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:41 2022] GET /identity/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d => generated 293 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:41.763379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.771945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.793623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f13a71-d96a-4c3c-8ed0-70725d78430a tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:41.801439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:41.803066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:41.803606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:41.804139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:41.806182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:update_group(group_id=7f4d1371cea84acfbccdbf3c43e6fd5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:41.808876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:41.823140 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3591/7132] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:41 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:41.824896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.867929 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:41.890394 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3542/7133] 10.222.0.27 () {60 vars in 1245 bytes} [Sun Jul 24 01:42:41 2022] PATCH /identity/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:41.894875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:41.941760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c027b-7f90-43bb-9854-4d64ebafa5cd tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.003683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4155d6-fd0a-4f98-8a87-438ebe79506e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.025360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.026097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.026362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.026639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.027343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.029293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.106858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3592/7134] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:41 2022] POST /identity/v3/users => generated 303 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:42.108086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.109017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.110076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.110503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.110891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.127067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7f4d1371cea84acfbccdbf3c43e6fd5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.129326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465aa4-e26d-46cf-9dd9-047f2dbdb3a0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.130070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.153016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.153704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.153704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.153976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.154733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.156312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.193892 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3593/7135] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:42.198886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.235360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3543/7136] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:41 2022] DELETE /identity/v3/groups/7f4d1371cea84acfbccdbf3c43e6fd5d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:42.240267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.241617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbb22-0671-4fd8-a380-8b3159b8875e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.381714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418cd2-604e-47cf-b2bf-6927988265c1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.389733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.390428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.390712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.390995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.391740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.393471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.398004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.399769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.400201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.400996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.403606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.409167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.425334 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=2,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:42.426681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3594/7137] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:42.430534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.436854 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3544/7138] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:42 2022] POST /identity/v3/groups => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:42.442000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.460348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92567831-f356-4e1c-8d88-f23753bfce03 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.469896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0f4f-78cc-4ca1-b2b0-f4199b8ff841 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.479958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.481141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.481704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.481704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] PATH_INFO: `/v3/projects/f082f211189341988f1d42ddee8fc71d/users/af04dab6d0cb44b8bc1fd824745da5fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.493926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.494896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.495287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.496496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.497331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.501239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.546495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f082f211189341988f1d42ddee8fc71d, user_id=af04dab6d0cb44b8bc1fd824745da5fe, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.549048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6582-0879-4a05-b9b2-8ee09714bfc0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.574089 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3545/7139] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:42 2022] POST /identity/v3/users => generated 321 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:42.585572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.602178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3595/7140] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:42 2022] PUT /identity/v3/projects/f082f211189341988f1d42ddee8fc71d/users/af04dab6d0cb44b8bc1fd824745da5fe/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:42.603956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.604253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.604530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.624845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9cefb-eaf2-4a72-bf69-479ddbfaca5b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.650688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:42.652073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:42.780989 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:42.807000 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3596/7141] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:42.821463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:42.823022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:42.863687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:42.864630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:42.864922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:42.865206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:42.912080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=3fca85f375e14b398f40be9f8ad9110e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:42.916643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:42.972735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661afde-7253-4f37-96e3-c52fd974c21a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:42.976453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3546/7142] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:42:42 2022] PUT /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:42.981618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.098638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.098994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.099278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.099555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.168467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7b11d-0cef-4ab5-861e-abf0a8cc2cce tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:43.188156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.193207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.193818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.193983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.198711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.208951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.286662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.288415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.290046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3547/7143] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:42 2022] POST /identity/v3/users => generated 323 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:43.293133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.334650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d16266-ce80-4eec-a159-6e0425e28823 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:43.335831 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3597/7144] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:42:43.354825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.356043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.356313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.356629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.411950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=039264a1d5484fd198a3f419a1d5930a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.421811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.443984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.445774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:43.473715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57705f8-007b-4d12-8dce-542d408c9875 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:43.485611 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3548/7145] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:42:43 2022] PUT /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:43.488871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.496850 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:43.643803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f3703-1d69-46b1-a43a-1ee77d55c2f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:43.660735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.663398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.663398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.663398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.664284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.667317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.689895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.691112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.692568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.693135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] PATH_INFO: `/v3/users/4611d01617d645579ae3529c8f8f9de2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.709644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4611d01617d645579ae3529c8f8f9de2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.712483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.731590 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:43.740496 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3549/7146] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:43 2022] POST /identity/v3/users => generated 323 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:43.751062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.778903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d7522-7b76-4e24-a799-8546e35344e2 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:43.790331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:43.793181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:43.793492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:43.795186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:43.840458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=8edc984f389b417689ef349e35cc1a5a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:43.844927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:43.845863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4611d01617d645579ae3529c8f8f9de2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:43.855900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4611d01617d645579ae3529c8f8f9de2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:43.876972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4611d01617d645579ae3529c8f8f9de2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:43.891823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4611d01617d645579ae3529c8f8f9de2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:43.930289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4611d01617d645579ae3529c8f8f9de2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:43.944762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3598/7147] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:43 2022] DELETE /identity/v3/users/4611d01617d645579ae3529c8f8f9de2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:43.959717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3550/7148] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:42:43 2022] PUT /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:43.961450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:43.970860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:44.167556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d844d47-15b6-4eca-86ca-a339510d8e9b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.181639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.184974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.185987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.186546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.192367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:44.193603 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:44.193603 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:42:44.193603 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:42:44.197814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:44.249941 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3599/7149] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:43 2022] GET /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users => generated 1083 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:44.254891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:44.465634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59347d5a-922e-4279-ae44-0fc6ad1b1070 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.475700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.476921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.479366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.479658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.483921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=3fca85f375e14b398f40be9f8ad9110e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:44.487094 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:44.487094 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:44.487094 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:44.488279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:44.526702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3551/7150] 10.222.0.27 () {58 vars in 1341 bytes} [Sun Jul 24 01:42:44 2022] HEAD /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:44.527348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:44.553509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91cae-6bb3-4865-ae60-c3cb3f77de24 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.573195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.574159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.574449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.582761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.595355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=3fca85f375e14b398f40be9f8ad9110e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:44.608683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:44.640688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:44.703465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3600/7151] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:42:44 2022] DELETE /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/3fca85f375e14b398f40be9f8ad9110e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:44.707654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:44.716777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:44.722414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888528-9cec-4262-9ad7-df99d9fe8218 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.722731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:44.835411 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:44.861796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.862551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.862877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.863163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.872717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=039264a1d5484fd198a3f419a1d5930a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:44.874806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:44.916994 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:44.931217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdec1e-4691-40d5-88d4-6ad0f2f98420 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.943018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.944084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.944455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.944841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] PATH_INFO: `/v3/projects/109467986076453b893b8720a2b1144a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.945478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3552/7152] 10.222.0.27 () {58 vars in 1341 bytes} [Sun Jul 24 01:42:44 2022] HEAD /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:44.949042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109467986076453b893b8720a2b1144a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:44.952769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:44.954542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:44.978631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364064-05c5-4a04-b3b9-740f3f1f2a42 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:44.991508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:44.992708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:44.993103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:44.993396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:44.999152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=039264a1d5484fd198a3f419a1d5930a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.003062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:45.022269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.049284 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3553/7153] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:42:44 2022] DELETE /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/039264a1d5484fd198a3f419a1d5930a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:45.050903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.076444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109467986076453b893b8720a2b1144a', 'request_id': 'req-25fafbb3-011a-4e19-bc4a-75af216c65f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.098361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109467986076453b893b8720a2b1144a', 'request_id': 'req-25fafbb3-011a-4e19-bc4a-75af216c65f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.127202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109467986076453b893b8720a2b1144a', 'request_id': 'req-25fafbb3-011a-4e19-bc4a-75af216c65f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.180119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] The token cache is being invalidate because project 109467986076453b893b8720a2b1144a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:45.180534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.182861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-25fafbb3-011a-4e19-bc4a-75af216c65f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.194605 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3601/7154] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:44 2022] DELETE /identity/v3/projects/109467986076453b893b8720a2b1144a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:45.199396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c13b-f6ce-41d1-add5-3f5aa42aa7a4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.200260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c13b-f6ce-41d1-add5-3f5aa42aa7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.200837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9c13b-f6ce-41d1-add5-3f5aa42aa7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.256885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e6b9c13b-f6ce-41d1-add5-3f5aa42aa7a4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:45.259444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e6b9c13b-f6ce-41d1-add5-3f5aa42aa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:45.306933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14461b7-ed98-4bde-a1c8-68b367f51810 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.425835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3602/7155] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:45.433233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.433951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.434485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.460215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:45.462682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:45.478570 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3603/7156] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:45.483015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.497403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f442-3177-4078-9cd9-107f89449a0a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.506866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:45.508176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.509784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:45.510719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.511231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.512440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:45.512873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.513270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.513512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.513831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.516367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:45.519984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=8edc984f389b417689ef349e35cc1a5a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.524077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:45.535111 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3604/7157] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:45.539223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.562646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed77c62-1e71-4d34-b3a6-a805c6854733 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.572297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3554/7158] 10.222.0.27 () {58 vars in 1341 bytes} [Sun Jul 24 01:42:45 2022] HEAD /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:45.576047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.578457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:45.589130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:45.593412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.594124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.598453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.599608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.603221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:45.618684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42bbe-7ba5-4743-85df-aaa19f521f83 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.633143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:45.634111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.634402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.634684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.637180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3, user_id=8edc984f389b417689ef349e35cc1a5a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.639693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:45.661107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:45.696417 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3605/7159] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:45 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:45.698038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.704168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3555/7160] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:42:45 2022] DELETE /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users/8edc984f389b417689ef349e35cc1a5a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:45.708966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:45.844257 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:45.852971 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:45.914725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b24046-2297-4b85-972b-f1c681188788 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.921513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa90e-9ba3-4321-a1d4-4b9758d982c6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:45.936410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:45.936410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:45.936410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:45.936410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:45.937254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:45.942325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.023712 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3606/7161] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:45 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:46.028181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.068535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09e6f-904e-4b30-ad59-43aa629df455 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.093421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.094402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.095889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.102568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.107223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.117769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.145882 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3607/7162] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:46.148425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.158737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.160363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.164577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.164577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.167344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.170069 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:46.170069 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:46.170069 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:46.171775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.178930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb2821-1688-4f42-9c1a-664d4097ca36 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.193325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.194142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.194536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.195751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.197354 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3556/7163] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:45 2022] GET /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3/users => generated 145 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:46.198263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.201249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.202162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.223080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a113f-5132-40dc-86be-26ba6e44a9ad tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.229008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3608/7164] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:46.240654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.250174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.251096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.251363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.251644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users/8edc984f389b417689ef349e35cc1a5a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.257405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8edc984f389b417689ef349e35cc1a5a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.260962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.271479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be064-ce6c-4241-a77a-44de61ed3d35 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.285835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.286767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.290768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.291072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] PATH_INFO: `/v3/projects/47be867d5c8a495d804defdce1c21af5/users/d9bcd46edeec4f9ca79ad9c934489bc6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.324073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47be867d5c8a495d804defdce1c21af5, user_id=d9bcd46edeec4f9ca79ad9c934489bc6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.328309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db85dc-ee5a-4328-a433-c9d59203aac4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.355906 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3609/7165] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:46 2022] PUT /identity/v3/projects/47be867d5c8a495d804defdce1c21af5/users/d9bcd46edeec4f9ca79ad9c934489bc6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:46.366046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.366213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.366491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.401406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:46.414422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] MFA Rules not processed for user `d9bcd46edeec4f9ca79ad9c934489bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:46.415491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:46.418965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:46.429454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:46.459132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:46.462202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d75ed71d-1a52-4230-8e20-71525fa41b97 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edc984f389b417689ef349e35cc1a5a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:46.471698 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3557/7166] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:46 2022] DELETE /identity/v3/users/8edc984f389b417689ef349e35cc1a5a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:46.473833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.474493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.474935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.542150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] MFA Rules not processed for user `af04dab6d0cb44b8bc1fd824745da5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:46.543525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:46.582294 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3610/7167] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:46.583284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.584795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:46.619257 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:46.683177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3558/7168] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:46.684060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.689476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:46.781597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96b29-3302-4928-80b4-7024f3341b4c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.829478 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:46.865136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51eb17-1358-4bab-a845-2bdce13f9f21 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:46.875165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.876699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.877260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.879643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.880479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.884022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.911419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:46.914789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:46.915224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:46.915617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users/039264a1d5484fd198a3f419a1d5930a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:46.918576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_user(user_id=039264a1d5484fd198a3f419a1d5930a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:46.921712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:46.943100 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3559/7169] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:46 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:46.943100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:46.950217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:47.061397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.063698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.085362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.100086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.138776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039264a1d5484fd198a3f419a1d5930a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.156429 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3611/7170] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:46 2022] DELETE /identity/v3/users/039264a1d5484fd198a3f419a1d5930a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:47.163310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.165060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02293d-ba5e-45d8-8591-7a069a1555b4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.166037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:47.338897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.352609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.353150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.353652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.354632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:47.357319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:47.358551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f6675-e9f7-4404-ad16-d6686c447568 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.365095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.366552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.367321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.367612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.368712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:47.370710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:47.395161 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:47.396977 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3612/7171] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:47 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:47.398421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.400862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:47.402999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3560/7172] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:46 2022] POST /identity/v3/projects => generated 405 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:47.404133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.455235 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:47.538467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb5bb9-98b7-4b53-bc86-71af63439764 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.718908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bae3c4-173f-4f44-8c48-0793e6b7b599 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.731409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.732101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.732380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.732655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.733404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:47.743982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:47.766013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3561/7173] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:47.766889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.770397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.771383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.771568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.771842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users/3fca85f375e14b398f40be9f8ad9110e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.773515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fca85f375e14b398f40be9f8ad9110e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:47.775541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:47.778041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:47.822301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106506-2eef-4eae-a320-94b0964e65bc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.838356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.839049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.839328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.839660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.840361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:47.843848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:47.921906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3562/7174] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:47 2022] POST /identity/v3/users => generated 309 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:47.922497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.923397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.924039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.929520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:47.939769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.953783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.955594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9cad-4286-4168-8707-567ccee73bdc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:47.967754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:47.968916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:47.969398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:47.969878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] PATH_INFO: `/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc/users/a61ac6c6ef5745e7a1cacdf84f800706/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:47.970009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fca85f375e14b398f40be9f8ad9110e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:47.982387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3613/7175] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:47 2022] DELETE /identity/v3/users/3fca85f375e14b398f40be9f8ad9110e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:47.983301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:47.985335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:48.027415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58127bc5ad4473183ef33f74bdbb2fc, user_id=a61ac6c6ef5745e7a1cacdf84f800706, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.030145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.066999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3563/7176] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:47 2022] PUT /identity/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc/users/a61ac6c6ef5745e7a1cacdf84f800706/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:48.067874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.070719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddea82-881e-4767-a421-712199aa016d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.071348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:48.075237 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:48.144911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.145575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.145892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.146221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.146960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.148752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.164695 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3614/7177] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:48.165697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.178849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948665b4-afed-4314-b0f4-38517352079a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.187259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.188001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.188291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.188572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.190412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.194930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.220512 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3615/7178] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:48.221910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.226517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4a16-97e6-4bfe-94d6-5a05cc7053e7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.238371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.239340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.239632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.239918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.241960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=de2ed6758f084bdd8d7b2567e6504ca3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.244439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.245209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b90c0-23af-4cda-b377-3061ad897b9d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.256312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.257912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.258358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.258798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] PATH_INFO: `/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e/users/9d904cb8632140dc9de3000a09f90c1c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.311624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a5d12af4c74982834c0f1f8a05fd3e, user_id=9d904cb8632140dc9de3000a09f90c1c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.314412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.343143 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3616/7179] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:48 2022] PUT /identity/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e/users/9d904cb8632140dc9de3000a09f90c1c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:48.343143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.405766 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3564/7180] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:48 2022] DELETE /identity/v3/groups/de2ed6758f084bdd8d7b2567e6504ca3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:48.406946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.435877 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:48.551794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efbfa3-e68f-4a90-87f7-444eb74ed855 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.561496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026249b5-7710-4785-b545-7008e22ba142 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.569940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.570662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.570947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.571303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.572088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.572925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.573869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.574160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.574440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] PATH_INFO: `/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc/users/a61ac6c6ef5745e7a1cacdf84f800706/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.574735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.589071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58127bc5ad4473183ef33f74bdbb2fc, user_id=a61ac6c6ef5745e7a1cacdf84f800706, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.589861 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3565/7181] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:48.592256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.606743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.626446 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3617/7182] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:48 2022] PUT /identity/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc/users/a61ac6c6ef5745e7a1cacdf84f800706/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:48.627749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:48.742299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5809c-a3a8-4685-9a16-077b1d20cf8e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.754944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:48.756353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.756788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.757235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] PATH_INFO: `/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e/users/9d904cb8632140dc9de3000a09f90c1c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.769630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a5d12af4c74982834c0f1f8a05fd3e, user_id=9d904cb8632140dc9de3000a09f90c1c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:48.773036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890494-8321-4e46-a594-265e77562747 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:48.778163 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:48.794248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbadf7-27f2-4570-aa9e-372c266245cd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:48.804440 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3618/7183] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:48 2022] PUT /identity/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e/users/9d904cb8632140dc9de3000a09f90c1c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:48.807434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:48.807839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:48.808280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:48.900263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] MFA Rules not processed for user `a61ac6c6ef5745e7a1cacdf84f800706`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:48.918099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:49.020484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.021854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.022247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.022583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.023425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.026373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.043638 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3566/7184] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:48 2022] POST /identity/v3/groups => generated 327 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:49.053169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.076200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebcc31-ff0e-42c5-957a-01ddad0472f5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.092173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.093456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.093853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.094205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.095167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.098398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.140401 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3567/7185] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:49 2022] POST /identity/v3/groups => generated 326 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:49.143921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.165634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9530f-9ea7-4942-a1f7-7b8d6372fdf7 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.194221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.195441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.196988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.198863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.199656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.204236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.214765 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3619/7186] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:49.222947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.230097 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3568/7187] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:49 2022] POST /identity/v3/groups => generated 326 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:42:49.249571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d538-37a8-4d6f-ab35-2195c7f73d55 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.256466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.259114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.262079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.262448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.263288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.269307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.270523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invalid input for field 'name': '' is too short Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: '' Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise error Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application '' Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.277921 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:42:49.280023 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application '' Jul 24 01:42:49.281446 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.291091 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3620/7188] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:49 2022] POST /identity/v3/domains => generated 283 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:42:49.292018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.296266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6272-0e8b-4acc-869e-5cd574e30bd1 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.310805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.311827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.313392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.314561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0dfa-7fad-4558-aeb9-a54371d34034 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.314714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.316968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.319754 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:42:49.319754 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:42:49.319754 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:42:49.322961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.331958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.332637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.332938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.333206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.333986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.337791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.342624 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3569/7189] 10.222.0.27 () {58 vars in 1124 bytes} [Sun Jul 24 01:42:49 2022] GET /identity/v3/groups => generated 1489 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:49.346609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise error Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.352529 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 24 01:42:49.354295 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:42:49.355953 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.364373 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3621/7190] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:49 2022] POST /identity/v3/domains => generated 412 bytes in 72 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:42:49.365176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.375880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40902d-7345-4dc3-bb25-898356ee58b5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.386117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7d7e-9921-47d7-9505-541e441ec3c0 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.399083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.399785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.400068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.400340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.401094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.402780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.409387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.416405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.417040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.418126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/03121bacae6848a788dc2665c12e7608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.433588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=03121bacae6848a788dc2665c12e7608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.438925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.439113 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3622/7191] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:49 2022] POST /identity/v3/domains => generated 277 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:49.440968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.454765 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:49.566759 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3570/7192] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:49 2022] DELETE /identity/v3/groups/03121bacae6848a788dc2665c12e7608 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:49.570628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.615029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a2ac-af74-472e-a19e-c55db19c1ab7 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.786250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c588a8-ecb9-4205-bb4e-c155ccba4012 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.803421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.804311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.804595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.804866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/b7d4282dbb8f42768faf54339abf2b09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.805651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.806669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.807711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.808094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/6bea022f16fd41928e73345f4bd3f2ad` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.820019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6bea022f16fd41928e73345f4bd3f2ad)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.821066 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:49.827817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.830431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b7d4282dbb8f42768faf54339abf2b09)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.833344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 24 01:42:49.887311 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 24 01:42:49.888643 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:49.896779 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3623/7193] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:49 2022] DELETE /identity/v3/domains/b7d4282dbb8f42768faf54339abf2b09 => generated 120 bytes in 455 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:49.897839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.916291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbfb0-fe61-489f-805f-30b842b7b80b tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:49.933583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:49.934514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:49.934799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:49.935073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/b7d4282dbb8f42768faf54339abf2b09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:49.936453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b7d4282dbb8f42768faf54339abf2b09)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:49.938108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:49.946779 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3571/7194] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:49 2022] DELETE /identity/v3/groups/6bea022f16fd41928e73345f4bd3f2ad => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:49.950744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:49.991407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:49.992886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.062782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697c9c-a8eb-469c-bed4-39900a6a50c3 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:50.068955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.069591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.080400 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3624/7195] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:49 2022] PATCH /identity/v3/domains/b7d4282dbb8f42768faf54339abf2b09 => generated 278 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:50.081404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:50.087919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:50.160741 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:50.273318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebb10-b62d-4265-b625-e94a814b8c09 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:50.278433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:50.279581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:50.282096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:50.284981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/249c901651a94ee99bacd0ed7dbe8674` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:50.297003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:50.297843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:50.298133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:50.298419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/b7d4282dbb8f42768faf54339abf2b09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:50.312291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=249c901651a94ee99bacd0ed7dbe8674)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:50.314270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:50.323936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b7d4282dbb8f42768faf54339abf2b09)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:50.325614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:50.382202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.414638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.429965 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3572/7196] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:49 2022] DELETE /identity/v3/groups/249c901651a94ee99bacd0ed7dbe8674 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:50.431268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:50.444312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:50.515015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.531276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.543185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.564372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] The token cache is being invalidate because project b7d4282dbb8f42768faf54339abf2b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:50.564601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.568885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.575508 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:50.585818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.590733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.591258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-11e21426-789b-483c-965b-820a50d47656 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b7d4282dbb8f42768faf54339abf2b09', 'request_id': 'req-11e21426-789b-483c-965b-820a50d47656'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:50.614786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3625/7197] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:50 2022] DELETE /identity/v3/domains/b7d4282dbb8f42768faf54339abf2b09 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:50.614786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:50.614786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:50.614786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:50.637466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c557356-f265-4b3f-8340-414d3f58729e tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:50.695649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] MFA Rules not processed for user `9d904cb8632140dc9de3000a09f90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:50.696912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:50.812360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:50.816736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:50.817036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:50.817322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:50.818071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:50.819959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:50.846483 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3626/7198] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:50.846483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:50.846483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:50.885931 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3573/7199] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:50 2022] POST /identity/v3/users => generated 323 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:50.890071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:50.895960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:50.927654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5479ca-c708-4e21-9e05-5b28e8334439 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:50.941329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:50.944564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:50.944976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:50.945263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:50.947225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:50.954052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:50.992575 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3574/7200] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:50 2022] POST /identity/v3/groups => generated 327 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:50.993702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.009803 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:51.023754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b395a3-f042-46c6-a678-abc9a7c45506 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.044176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.044676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fa198-8b41-4655-b5e9-74d9a92d36bc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.047211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.047342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.048460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/9b4460ba3c374bdfbce8c232a5eb3bfe/users/e84329b0843c4883b5061e7f475c1cb9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.056145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.060608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.060912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.062168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/6f69cd72a5cc45bfb00043e8fbebac33` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.090439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:42:51.112962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9b4460ba3c374bdfbce8c232a5eb3bfe, user_id=e84329b0843c4883b5061e7f475c1cb9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.117635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Could not find domain: 6f69cd72a5cc45bfb00043e8fbebac33.: keystone.exception.DomainNotFound: Could not find domain: 6f69cd72a5cc45bfb00043e8fbebac33. Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6f69cd72a5cc45bfb00043e8fbebac33. Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:51.121994 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:51.123074 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:42:51.124130 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6f69cd72a5cc45bfb00043e8fbebac33. Jul 24 01:42:51.125217 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.125217 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3627/7201] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:50 2022] DELETE /identity/v3/domains/6f69cd72a5cc45bfb00043e8fbebac33 => generated 112 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:42:51.130359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.179419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fe78d-3fcc-4ac1-af6a-4af51cdfb3bd tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.204456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.206014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.206711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.207175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.208125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.211312 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3575/7202] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:42:50 2022] PUT /identity/v3/groups/9b4460ba3c374bdfbce8c232a5eb3bfe/users/e84329b0843c4883b5061e7f475c1cb9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:51.213046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.214833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.248393 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3628/7203] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:51 2022] POST /identity/v3/domains => generated 252 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:51.252409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.466183 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:51.473007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed6c89-4275-472c-ab06-d221cfb3d3e9 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.481932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.482851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05be8-d834-44a7-8295-240147cac739 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.483375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.484751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.485356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.486494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.489909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.499377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.sql.core [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-488286975' for key 'project.ixu_project_name_domain_id'") Jul 24 01:42:51.499377 n-d-master-1 devstack@keystone.service[80590]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 01:42:51.499377 n-d-master-1 devstack@keystone.service[80590]: [parameters: {'id': '330e0c8c4b764b75880dfa55b54ab445', 'name': 'tempest-domain-dup-488286975', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 24 01:42:51.499377 n-d-master-1 devstack@keystone.service[80590]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80590) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-488286975.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-488286975. Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application conn.query(q) Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:42:51.543867 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result.read() Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-488286975' for key 'project.ixu_project_name_domain_id'") Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 24 01:42:51.544865 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application yield resource Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise self.value Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application session.commit() Jul 24 01:42:51.546606 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.session.flush() Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application compat.raise_( Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:42:51.547778 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 01:42:51.550404 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application conn.query(q) Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result.read() Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:42:51.553570 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-488286975' for key 'project.ixu_project_name_domain_id'") Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [parameters: {'id': '330e0c8c4b764b75880dfa55b54ab445', 'name': 'tempest-domain-dup-488286975', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.556247 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-488286975. Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:51.559266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-488286975. Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:51.562503 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3629/7204] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:42:51 2022] POST /identity/v3/domains => generated 211 bytes in 298 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:42:51.566116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.587278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358cd40-7228-4710-bc1a-11341e021d16 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.602210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.603101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.603390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.603670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/1415d349740143c188e701dbddb8f984` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.614986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.616144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.616676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.617210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.618541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.622440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.634459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1415d349740143c188e701dbddb8f984)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.636358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.657154 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3576/7205] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:42:51 2022] POST /identity/v3/groups => generated 326 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:51.662148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.695774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:51.697772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b4790-4463-449c-8b0d-20f28312f14d tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:51.698050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:51.712520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:51.714433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:51.715543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:51.716446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/b08958548dfd41f3b3f0eaedb42ba837/users/e84329b0843c4883b5061e7f475c1cb9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:51.741517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b08958548dfd41f3b3f0eaedb42ba837, user_id=e84329b0843c4883b5061e7f475c1cb9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:51.748273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:51.781081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:51.790255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:51.796890 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3630/7206] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:51 2022] PATCH /identity/v3/domains/1415d349740143c188e701dbddb8f984 => generated 253 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:51.798170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3577/7207] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:42:51 2022] PUT /identity/v3/groups/b08958548dfd41f3b3f0eaedb42ba837/users/e84329b0843c4883b5061e7f475c1cb9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:51.803810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.805231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:51.805379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:51.817622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:51.935615 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:51.978796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92133f7-6760-4d57-8e39-a7be0d723e32 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.015991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfd9f-2e68-4cfd-97e7-e49fb1240045 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.029730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.030870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.031329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.031758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users/e84329b0843c4883b5061e7f475c1cb9/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.033368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=e84329b0843c4883b5061e7f475c1cb9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:52.036258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:52.086726 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3578/7208] 10.222.0.27 () {58 vars in 1241 bytes} [Sun Jul 24 01:42:51 2022] GET /identity/v3/users/e84329b0843c4883b5061e7f475c1cb9/groups => generated 839 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:52.087940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:52.115771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f453-a562-44af-8a6f-9dfef7df5a95 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.129535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.130460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.130746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.131023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/b08958548dfd41f3b3f0eaedb42ba837` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.134512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b08958548dfd41f3b3f0eaedb42ba837)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:52.136468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:52.144524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.145834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.146299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.146589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/1415d349740143c188e701dbddb8f984` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.189957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1415d349740143c188e701dbddb8f984)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:52.191653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:52.260211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.286900 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3579/7209] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:52 2022] DELETE /identity/v3/groups/b08958548dfd41f3b3f0eaedb42ba837 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:52.288633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:52.300154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1415d349740143c188e701dbddb8f984'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.355034 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:52.425077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.436357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.460509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.495535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406b86-58f1-4da1-940d-1147ff8f932b tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.512293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] The token cache is being invalidate because project 1415d349740143c188e701dbddb8f984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:52.512888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.515245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.542579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.543486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.545465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1415d349740143c188e701dbddb8f984', 'request_id': 'req-f8b3895b-ae6a-4a9f-b017-42f54143792e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:52.573634 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3631/7210] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:51 2022] DELETE /identity/v3/domains/1415d349740143c188e701dbddb8f984 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:52.578827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:52.581733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:52.667069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.671044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.671340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.671626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/groups/9b4460ba3c374bdfbce8c232a5eb3bfe` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.677059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9b4460ba3c374bdfbce8c232a5eb3bfe)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:52.686674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:52.772727 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:52.800130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3895b-ae6a-4a9f-b017-42f54143792e tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.801266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3580/7211] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:42:52 2022] DELETE /identity/v3/groups/9b4460ba3c374bdfbce8c232a5eb3bfe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:52.803290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:52.808232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:52.902042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a61ac6c6ef5745e7a1cacdf84f800706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58127bc5ad4473183ef33f74bdbb2fc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.902931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.903226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.903518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] PATH_INFO: `/v3/domains/b7d4282dbb8f42768faf54339abf2b09` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.927911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Could not find domain: b7d4282dbb8f42768faf54339abf2b09.: keystone.exception.DomainNotFound: Could not find domain: b7d4282dbb8f42768faf54339abf2b09. Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b7d4282dbb8f42768faf54339abf2b09. Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:42:52.952977 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:42:52.954349 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:42:52.956329 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b7d4282dbb8f42768faf54339abf2b09. Jul 24 01:42:52.958095 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:42:52.958095 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3632/7212] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:52 2022] PATCH /identity/v3/domains/b7d4282dbb8f42768faf54339abf2b09 => generated 112 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:42:52.960176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d630a-122d-435d-a863-9c776ef20fe6 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:52.967662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:52.973125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:52.974359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:52.975271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:52.975556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:52.975867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/users/e84329b0843c4883b5061e7f475c1cb9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:52.977823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e84329b0843c4883b5061e7f475c1cb9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:52.983259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:53.137635 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:53.160862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84329b0843c4883b5061e7f475c1cb9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.183343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84329b0843c4883b5061e7f475c1cb9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.192195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84329b0843c4883b5061e7f475c1cb9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.214676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84329b0843c4883b5061e7f475c1cb9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.215529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84329b0843c4883b5061e7f475c1cb9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.218642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f709416-490d-4ca2-b889-ca97153552b4 tempest-DomainsNegativeTestJSON-684020255 tempest-DomainsNegativeTestJSON-684020255-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:53.225708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:53.226976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:53.227437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:53.227883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] PATH_INFO: `/v3/users/d9bcd46edeec4f9ca79ad9c934489bc6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:53.233134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3581/7213] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:52 2022] DELETE /identity/v3/users/e84329b0843c4883b5061e7f475c1cb9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:53.234151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:53.237164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:53.243363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bcd46edeec4f9ca79ad9c934489bc6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:53.247954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:53.427752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bcd46edeec4f9ca79ad9c934489bc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.429987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bcd46edeec4f9ca79ad9c934489bc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.444191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bcd46edeec4f9ca79ad9c934489bc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.458147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a433a22-13ce-4df3-885d-f29652faa3d9 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:53.460921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bcd46edeec4f9ca79ad9c934489bc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.473967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:53.474882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:53.475168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:53.475448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/domains/6821881b86074f988dc15cf031431b6e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:53.477177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6821881b86074f988dc15cf031431b6e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:53.478844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:53.488768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5316a4e6-6952-4978-8bfc-14a2f8246164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bcd46edeec4f9ca79ad9c934489bc6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.498652 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:53.504476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3633/7214] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:52 2022] DELETE /identity/v3/users/d9bcd46edeec4f9ca79ad9c934489bc6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:53.508971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:53.509270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:53.509544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:53.555402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.555551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.569122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:53.573351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:53.606965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.607605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.611510 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3582/7215] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:42:53 2022] PATCH /identity/v3/domains/6821881b86074f988dc15cf031431b6e => generated 277 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:53.616500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:53.622665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:53.800949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367eaf7-d227-456e-ae33-0aa91748e4d8 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:53.822540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb859d230f844239bce37f099c52908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ddea69167134cbebe94feb952d0e232', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:53.823484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:53.823779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:53.824057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] PATH_INFO: `/v3/domains/6821881b86074f988dc15cf031431b6e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:53.851426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3634/7216] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:53.852551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:53.856699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:53.867850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6821881b86074f988dc15cf031431b6e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:53.870127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:53.950744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.951523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd6ffe-b35d-4f42-9139-d42997ab98f6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:53.988839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6821881b86074f988dc15cf031431b6e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:53.990152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:53.991202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:53.991630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:53.992077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] PATH_INFO: `/v3/users/af04dab6d0cb44b8bc1fd824745da5fe` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:53.996337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=af04dab6d0cb44b8bc1fd824745da5fe)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:54.000153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:54.132451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.152116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.166709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.186956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af04dab6d0cb44b8bc1fd824745da5fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.188978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af04dab6d0cb44b8bc1fd824745da5fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.196695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] The token cache is being invalidate because project 6821881b86074f988dc15cf031431b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:54.196993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.197624 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:54.197799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.210183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af04dab6d0cb44b8bc1fd824745da5fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.227263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af04dab6d0cb44b8bc1fd824745da5fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.233642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.234373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.243804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6821881b86074f988dc15cf031431b6e', 'request_id': 'req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.254949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3583/7217] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:42:53 2022] DELETE /identity/v3/domains/6821881b86074f988dc15cf031431b6e => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:54.256225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:54.269151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af04dab6d0cb44b8bc1fd824745da5fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.273420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:54.300399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3635/7218] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:53 2022] DELETE /identity/v3/users/af04dab6d0cb44b8bc1fd824745da5fe => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:54.301497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:54.309348 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:54.310646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:54.523138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaf24e-0fb7-4871-b73b-0c399da6eae5 tempest-GroupsV3TestJSON-278820793 tempest-GroupsV3TestJSON-278820793-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:54.598089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6c67-6ac3-428c-a18e-da712f5c2afc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:54.611519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:54.613210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:54.613510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:54.613825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] PATH_INFO: `/v3/users/d01471a38a88420d9b03293fe656313b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:54.617021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01471a38a88420d9b03293fe656313b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:54.619520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:54.692924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:54.694927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:54.695331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:54.695481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:54.706489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:54.734270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:54.740006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01471a38a88420d9b03293fe656313b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.742453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716175-3bfe-43cc-a482-37aacca9c33e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:54.747041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01471a38a88420d9b03293fe656313b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.763144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01471a38a88420d9b03293fe656313b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.768516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3584/7219] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:54.776276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01471a38a88420d9b03293fe656313b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.811406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01471a38a88420d9b03293fe656313b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:54.822662 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3636/7220] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:54 2022] DELETE /identity/v3/users/d01471a38a88420d9b03293fe656313b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:54.824809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:54.825294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:54.825576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:54.852710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:54.854545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:54.883032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:54.887304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:54.974645 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:55.009661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d48ad-0006-4c47-a2d6-a46aecc3f261 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:55.028157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:55.029048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:55.029333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:55.029788 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3585/7221] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:55.032609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] PATH_INFO: `/v3/projects/f082f211189341988f1d42ddee8fc71d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:55.036531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f082f211189341988f1d42ddee8fc71d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:55.038633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:55.040991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:55.042843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:55.101964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f082f211189341988f1d42ddee8fc71d', 'request_id': 'req-346a8c1d-29cc-4525-906d-a82422b9a2f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.118035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f082f211189341988f1d42ddee8fc71d', 'request_id': 'req-346a8c1d-29cc-4525-906d-a82422b9a2f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.131816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f082f211189341988f1d42ddee8fc71d', 'request_id': 'req-346a8c1d-29cc-4525-906d-a82422b9a2f2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.148835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] The token cache is being invalidate because project f082f211189341988f1d42ddee8fc71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:55.149722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.150171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.156207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3637/7222] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:54 2022] DELETE /identity/v3/projects/f082f211189341988f1d42ddee8fc71d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:55.157220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:55.159296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:55.264372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746635e-a170-4d99-8ef8-77a664762178 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:55.320291 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:55.429452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8c1d-29cc-4525-906d-a82422b9a2f2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:55.457451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:55.461766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:55.465461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:55.470051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] PATH_INFO: `/v3/users/9d904cb8632140dc9de3000a09f90c1c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:55.472907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d904cb8632140dc9de3000a09f90c1c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:55.483876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:55.489745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:55.490233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:55.490630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:55.491022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:55.494944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:55.556417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:55.557892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:55.615242 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3586/7223] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:42:55.674495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d904cb8632140dc9de3000a09f90c1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.676877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d904cb8632140dc9de3000a09f90c1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.697297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d904cb8632140dc9de3000a09f90c1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.725845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d904cb8632140dc9de3000a09f90c1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.761968 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:55.764529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d904cb8632140dc9de3000a09f90c1c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:55.806121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3638/7224] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:55 2022] DELETE /identity/v3/users/9d904cb8632140dc9de3000a09f90c1c => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:56.524207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:56.552832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cd0b1-4074-4538-a672-b0cce7e6d452 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:56.735329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:56.736938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:56.795931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:56.796830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:56.797119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:56.797399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] PATH_INFO: `/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:56.805784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a5d12af4c74982834c0f1f8a05fd3e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:56.820060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:56.884645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45212fb-7790-4d12-88c5-a45089ce6a73 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:56.906685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:56.907786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:56.908177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:56.912481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] PATH_INFO: `/v3/projects/9ac21cfd01f143b0ae69f71a7b5b51c9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:56.914116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac21cfd01f143b0ae69f71a7b5b51c9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:56.927296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:56.967689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a5d12af4c74982834c0f1f8a05fd3e', 'request_id': 'req-931a5698-dfd7-4961-a99f-c8c1811f839a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:56.985901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a5d12af4c74982834c0f1f8a05fd3e', 'request_id': 'req-931a5698-dfd7-4961-a99f-c8c1811f839a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.030394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a5d12af4c74982834c0f1f8a05fd3e', 'request_id': 'req-931a5698-dfd7-4961-a99f-c8c1811f839a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.051288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] The token cache is being invalidate because project 64a5d12af4c74982834c0f1f8a05fd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:57.051902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.052758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-931a5698-dfd7-4961-a99f-c8c1811f839a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.054618 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3587/7225] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:56 2022] DELETE /identity/v3/projects/64a5d12af4c74982834c0f1f8a05fd3e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:57.054879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac21cfd01f143b0ae69f71a7b5b51c9', 'request_id': 'req-5709e471-b7be-45a3-8d25-533ea7ce8ec3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.067567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648de33-0220-4835-930e-949b2dcb957f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:57.073078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac21cfd01f143b0ae69f71a7b5b51c9', 'request_id': 'req-5709e471-b7be-45a3-8d25-533ea7ce8ec3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.076809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648de33-0220-4835-930e-949b2dcb957f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:57.077297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648de33-0220-4835-930e-949b2dcb957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:57.087898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac21cfd01f143b0ae69f71a7b5b51c9', 'request_id': 'req-5709e471-b7be-45a3-8d25-533ea7ce8ec3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.122737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] The token cache is being invalidate because project 9ac21cfd01f143b0ae69f71a7b5b51c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:57.123033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.131574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6648de33-0220-4835-930e-949b2dcb957f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:57.133027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6648de33-0220-4835-930e-949b2dcb957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:57.134271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.138657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3639/7226] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:56 2022] DELETE /identity/v3/projects/9ac21cfd01f143b0ae69f71a7b5b51c9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:57.140434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:57.141883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:57.247816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e471-b7be-45a3-8d25-533ea7ce8ec3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:57.253686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:57.254652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:57.254873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:57.255198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] PATH_INFO: `/v3/users/beb859d230f844239bce37f099c52908` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:57.256577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb859d230f844239bce37f099c52908)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:57.259053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:57.314244 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:57.321173 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:57.347187 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3588/7227] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:57.354164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:57.354458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:57.354740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:57.376027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb859d230f844239bce37f099c52908'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.377562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb859d230f844239bce37f099c52908'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.386842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:57.388011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:57.393942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb859d230f844239bce37f099c52908'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.419234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3589/7228] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:42:57.423660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:57.425717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb859d230f844239bce37f099c52908'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.445597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a3a4-dedc-4afb-896c-9e50a320d34f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:57.465941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:57.466647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:57.466931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:57.467203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:57.467959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:57.468267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:57.469926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:57.484525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb859d230f844239bce37f099c52908'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:57.503505 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3590/7229] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:57.507117 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3640/7230] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:57 2022] DELETE /identity/v3/users/beb859d230f844239bce37f099c52908 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:57.510499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:57.546678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11795-67a0-436d-a223-45f015a041dd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:57.670624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:57.672259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:57.723669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:57.724373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:57.724659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:57.724935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:57.725646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:57.727676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:57.832923 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3591/7231] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:57 2022] POST /identity/v3/projects => generated 365 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:57.836865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.031145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714a0a-6f4a-4680-b186-20eefd792101 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.042836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.043749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.044033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.044314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] PATH_INFO: `/v3/projects/47be867d5c8a495d804defdce1c21af5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.051713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47be867d5c8a495d804defdce1c21af5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.053768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.056693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940f959-bef2-4d41-826d-102e89c8541d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.071718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.072692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.073146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.073608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.074501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.076623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.116945 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3592/7232] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:57 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:58.120824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.146056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a9b-2d3f-4060-81f4-f5084adbc50e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.160810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.161778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.162230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.162672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.163763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.165632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.178314 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3593/7233] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:42:58.184564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.199350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47be867d5c8a495d804defdce1c21af5', 'request_id': 'req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.207461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ee1-726d-42a3-a0ee-b5e286601621 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.224671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47be867d5c8a495d804defdce1c21af5', 'request_id': 'req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.249371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47be867d5c8a495d804defdce1c21af5', 'request_id': 'req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.279917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] The token cache is being invalidate because project 47be867d5c8a495d804defdce1c21af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:58.280219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.285504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.291276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3641/7234] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:57 2022] DELETE /identity/v3/projects/47be867d5c8a495d804defdce1c21af5 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:58.296015 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:58.296272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.300971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:58.342429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.343374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.343509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.343682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.344435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.353945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.388315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3594/7235] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:58.394728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.396507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:58.416525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd439-bcdb-4d1f-aae2-5ef78e84af5c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.432273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.434791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7acfe-547f-4fb8-acbd-96269d26d079 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:58.435365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.436383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.437225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] PATH_INFO: `/v3/users/a61ac6c6ef5745e7a1cacdf84f800706` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.441907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61ac6c6ef5745e7a1cacdf84f800706)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.451803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.452819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:58.453847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.454209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.454566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] PATH_INFO: `/v3/projects/5feee4e4509b41849d94869be9fd3052/users/ad27578b7eb4434c928ede45749db112/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.488293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feee4e4509b41849d94869be9fd3052, user_id=ad27578b7eb4434c928ede45749db112, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:58.491137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbba5f0-8450-40b3-a8d1-34a4a4b9eeb2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:58.513612 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:58.518378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3595/7236] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:58 2022] PUT /identity/v3/projects/5feee4e4509b41849d94869be9fd3052/users/ad27578b7eb4434c928ede45749db112/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:58.527313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:58.527705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:58.528056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:58.562516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61ac6c6ef5745e7a1cacdf84f800706'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.564332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61ac6c6ef5745e7a1cacdf84f800706'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.581931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] MFA Rules not processed for user `ad27578b7eb4434c928ede45749db112`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:58.583586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:58.589504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61ac6c6ef5745e7a1cacdf84f800706'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.610917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61ac6c6ef5745e7a1cacdf84f800706'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.679339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61ac6c6ef5745e7a1cacdf84f800706'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:58.696218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3642/7237] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:42:58 2022] DELETE /identity/v3/users/a61ac6c6ef5745e7a1cacdf84f800706 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:42:58.758414 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3596/7238] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:58.762925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.763312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:58.765197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:58.765304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:58.969722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5a31a-32f0-4937-a4e9-231bfd628b27 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.119270 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:59.170547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.171525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.171770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.172020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] PATH_INFO: `/v3/projects/8ddea69167134cbebe94feb952d0e232` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.173353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddea69167134cbebe94feb952d0e232)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.176636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.186054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bde2ae-1b6c-49fe-af6b-6700f04bd6b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.211682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.212533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.213576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.213990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.220666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.225213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.305958 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3643/7239] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:58 2022] POST /identity/v3/projects => generated 363 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:59.306203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddea69167134cbebe94feb952d0e232', 'request_id': 'req-1c6a4945-e841-48f9-b916-64895b54240c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.307702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.314312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddea69167134cbebe94feb952d0e232', 'request_id': 'req-1c6a4945-e841-48f9-b916-64895b54240c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.338096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddea69167134cbebe94feb952d0e232', 'request_id': 'req-1c6a4945-e841-48f9-b916-64895b54240c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.367339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] The token cache is being invalidate because project 8ddea69167134cbebe94feb952d0e232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:42:59.367643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.368319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1c6a4945-e841-48f9-b916-64895b54240c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.376622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3597/7240] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:58 2022] DELETE /identity/v3/projects/8ddea69167134cbebe94feb952d0e232 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:59.378172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5753be-b8ea-40cc-a7a0-47e6448b7dee None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.378470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5753be-b8ea-40cc-a7a0-47e6448b7dee None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.378752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5753be-b8ea-40cc-a7a0-47e6448b7dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.419164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8d5753be-b8ea-40cc-a7a0-47e6448b7dee None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:59.422976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8d5753be-b8ea-40cc-a7a0-47e6448b7dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:59.495467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6235d-f95e-4b91-9ebb-f90a1e45930f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.508882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.510381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.512054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.513141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.518535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.521394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.558101 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3598/7241] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:59.566976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.567300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.567946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3644/7242] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:42:59 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:42:59.569058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.569754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.574171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:59.603820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c24ba-8735-4cb6-baa0-1eea31ce6d79 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.612636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.612854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:42:59.615309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:59.616277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.617077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.617599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.618764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.632142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.639869 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3599/7243] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:42:59.640789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.644622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:42:59.670174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3645/7244] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:42:59.676259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426da36-fde9-4972-bd67-ba5b64641f3c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.687148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.693156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.694077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.694363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.694643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] PATH_INFO: `/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.699847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58127bc5ad4473183ef33f74bdbb2fc)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.701823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.711259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5850c-ddfb-4bf0-8224-6c8df6bed038 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.723754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.724737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.725194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.725637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.726562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:42:59.727062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.729296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.738902 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:59.749784 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3646/7245] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:42:59.750534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.768809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6051f-e245-4b5b-a6ee-f5e911cb427b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.774054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:42:59.775054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:42:59.775343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:42:59.775620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] PATH_INFO: `/v3/projects/4760e0ba45334cb48f53854172a4aac4/users/43449102f11649b6be4ec0b2f8d06b50/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:42:59.792161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4760e0ba45334cb48f53854172a4aac4, user_id=43449102f11649b6be4ec0b2f8d06b50, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:42:59.795174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:42:59.820727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3647/7246] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:42:59 2022] PUT /identity/v3/projects/4760e0ba45334cb48f53854172a4aac4/users/43449102f11649b6be4ec0b2f8d06b50/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:42:59.821836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:42:59.843105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58127bc5ad4473183ef33f74bdbb2fc', 'request_id': 'req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.887644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58127bc5ad4473183ef33f74bdbb2fc', 'request_id': 'req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.916728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58127bc5ad4473183ef33f74bdbb2fc', 'request_id': 'req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:42:59.930731 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:42:59.957097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb40b63-79d4-4a3d-acb3-1a236c56d146 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:42:59.995063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] The token cache is being invalidate because project c58127bc5ad4473183ef33f74bdbb2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:00.003463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:00.006295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:00.012213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3600/7247] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:42:59 2022] DELETE /identity/v3/projects/c58127bc5ad4473183ef33f74bdbb2fc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:00.016292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.024141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:00.185538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.186943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.187510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.188007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.190985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.194347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3beab8-0463-468a-ab63-491d9c114b98 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.238878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbef14-d1bb-492f-a8e2-f0ea9dac3d4e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.262094 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3648/7248] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:42:59 2022] POST /identity/v3/projects => generated 365 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:00.270607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.271579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.273985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.275461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.276772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.278880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.279065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.280882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.281384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.317210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3601/7249] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:00.318646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.322740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:00.335763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:00.337859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:00.355030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea35acb-c672-4399-ad04-9ab03d37e34a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.494982 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3649/7250] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:00.495849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.506931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.507544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.507814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.508088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.508801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.511238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa083cc-c02d-4392-b5ec-75fc1e211288 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.520206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb96eb-7ce0-4610-8296-c6e801161170 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.530195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.531107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.531376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.531652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] PATH_INFO: `/v3/projects/4760e0ba45334cb48f53854172a4aac4/users/43449102f11649b6be4ec0b2f8d06b50/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.535985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4760e0ba45334cb48f53854172a4aac4, user_id=43449102f11649b6be4ec0b2f8d06b50, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.538694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.542679 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:00.557277 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3602/7251] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:00 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:00.558184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8a81-0ca4-4e02-8ce1-6edcfd894d21 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.559133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8a81-0ca4-4e02-8ce1-6edcfd894d21 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.559433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8a81-0ca4-4e02-8ce1-6edcfd894d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.571218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3650/7252] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:00 2022] PUT /identity/v3/projects/4760e0ba45334cb48f53854172a4aac4/users/43449102f11649b6be4ec0b2f8d06b50/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:00.571812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.601210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-619b8a81-0ca4-4e02-8ce1-6edcfd894d21 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:00.602793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-619b8a81-0ca4-4e02-8ce1-6edcfd894d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:00.823879 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3603/7253] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:00.825245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.825534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.825838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.827301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314221fd-fbd8-43b5-89a7-e017f039eee6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.834044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.835014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.835640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.836395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.837530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.839612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.852701 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3651/7254] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:00.853935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.865490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] MFA Rules not processed for user `43449102f11649b6be4ec0b2f8d06b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:00.867422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:00.878681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4feadd-f676-45ea-9275-00ce9ca927da admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.888749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.889531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.889905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.890442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.892829 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:00.893009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:00.893755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.898982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:00.934362 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3652/7255] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:00.937608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:00.963493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d89e-a709-41f5-a795-3f8c419b6f66 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:00.981365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:00.981902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:00.982038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:00.982276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:00.983128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:00.985949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.006777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3653/7256] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:01.008154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.021623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9261d9-327e-419f-8ce1-c5af6f5e92e9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.021980 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3604/7257] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:01.022745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.036695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.037893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.038417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.038926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.039871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.042421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.049029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0f0d-b8bc-4c93-81c9-694a8455c1b7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.063847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.066819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.067719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.068011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] PATH_INFO: `/v3/projects/6cc649825fe44a12af160d0643f2c5bb/users/8f525a08c163442daac526184565bb99/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.092174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3654/7258] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:01.093804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.097394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:01.115413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc649825fe44a12af160d0643f2c5bb, user_id=8f525a08c163442daac526184565bb99, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.120334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.168435 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3605/7259] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:01 2022] PUT /identity/v3/projects/6cc649825fe44a12af160d0643f2c5bb/users/8f525a08c163442daac526184565bb99/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:01.187308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.265765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66acf-5bda-455b-8135-7537b68399f9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.355753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db196c3-b6c0-4652-ace1-f84c756b674b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.365481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.366233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.366519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.366801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.367512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.369480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ec6c2-94df-4fd1-b7e8-db8bd9a4ffcc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.402296 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3606/7260] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:01.406868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.407101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.407320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.420732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.428423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.430684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.431138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.459500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] MFA Rules not processed for user `8f525a08c163442daac526184565bb99`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:01.460839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:01.489105 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:01.617404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.618906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.632156 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3607/7261] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:01.637206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.647531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3655/7262] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:01.650130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.651329 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:01.682331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b94dc-bb38-4748-80cb-ea806fc86ba4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.692997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f3e2-56f2-414f-8046-0c4967e49c9d service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.696044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.696747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.697032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.697310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.700226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.704834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.706546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.708209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.721560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.722930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.723919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.727536 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3608/7263] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:01.731044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.732176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.755601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eebf2-9bbf-4cc5-8906-54f7746ef2c8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.770783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.771478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.771758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.772091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.772821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.774445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.810700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3609/7264] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:01.813484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.839813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3372fe-121a-4182-a65c-706877beddd0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:01.853399 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3656/7265] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:01.857267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:01.857958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:01.858223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.858511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.858796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] PATH_INFO: `/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa/users/4987f1998f1d4fb7b30b12010aacbf65/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:01.902832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1af89ed73d4fd6a65beb24058d62aa, user_id=4987f1998f1d4fb7b30b12010aacbf65, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:01.906672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bdf4-9431-41ba-a5de-ad99a9836c1e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:01.949265 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3610/7266] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:01 2022] PUT /identity/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa/users/4987f1998f1d4fb7b30b12010aacbf65/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:01.956290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:01.956578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:01.956870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.017054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] MFA Rules not processed for user `4987f1998f1d4fb7b30b12010aacbf65`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:02.018907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:02.061564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc85f7-84bd-4d3f-a2cd-634450449ca5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.200067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.201190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.201875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.202934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.203643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.207180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3611/7267] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:02.208307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.211654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.234287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138583-b6bd-4102-a8e9-f936204912ea None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.240795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.241559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.241878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.242273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.243106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.245333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.257755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3657/7268] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:01 2022] POST /identity/v3/users => generated 289 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:02.277522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.291664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3612/7269] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:02 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:02.293050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.310389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfe37-0c14-417b-af9f-752e4ba936d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.350636 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:02.456405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.457119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.457408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.457708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.460834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e773db4-acd0-445c-99c3-f192ba1f9597 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.461040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.464985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.467236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.468039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.468443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.468823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.469626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.472459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.490300 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3658/7270] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:02.501508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.506999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3613/7271] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:02 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:02.508537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.524033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41058f7-4668-4d59-9a36-02e4e2b84b14 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.544469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.545104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.545403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.545738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.546484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.548339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.558227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633333af-9d41-4a23-849d-2110c8d3e829 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.567581 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3614/7272] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:02.567821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.567938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.568027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.568128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.568356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] PATH_INFO: `/v3/projects/942243356ae240929f0e2a28d3f77dc5/users/d0fb4a37d6814c0f99c1d967a01caf45/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.575670 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:02.606503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e336fa-5726-4538-8bb8-e5fbe7a89514 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.616421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.618654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.619070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.619357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] PATH_INFO: `/v3/users/ad27578b7eb4434c928ede45749db112` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:02.620676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad27578b7eb4434c928ede45749db112)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.623060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.623193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942243356ae240929f0e2a28d3f77dc5, user_id=d0fb4a37d6814c0f99c1d967a01caf45, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:02.625855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:02.662963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3659/7273] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:02 2022] PUT /identity/v3/projects/942243356ae240929f0e2a28d3f77dc5/users/d0fb4a37d6814c0f99c1d967a01caf45/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:02.663813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.724894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad27578b7eb4434c928ede45749db112'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:02.741320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad27578b7eb4434c928ede45749db112'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:02.757984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad27578b7eb4434c928ede45749db112'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:02.812265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad27578b7eb4434c928ede45749db112'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:02.815738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad27578b7eb4434c928ede45749db112'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:02.853893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3615/7274] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:02 2022] DELETE /identity/v3/users/ad27578b7eb4434c928ede45749db112 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:02.854902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:02.856616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:02.874338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299cd7-f975-46ce-bd3e-fba5fa168a72 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:02.971051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:02.972020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:02.972422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:02.973195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] PATH_INFO: `/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f/users/22f062539d214457a454856c075f3e52/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.003156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1f73db5bfe4dbaa970bcaba1df022f, user_id=22f062539d214457a454856c075f3e52, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.012301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0517542-ed0f-435e-ba04-ccc9959bef52 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.031341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877078c0-fbee-448b-9b65-56079e30de66 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.041900 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3660/7275] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:02 2022] PUT /identity/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f/users/22f062539d214457a454856c075f3e52/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:03.043335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.043631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.044330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.069614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:03.071417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:03.102357 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:03.208136 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3661/7276] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:03.208136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:03.209209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:03.231099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.232311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.233397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.233887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.235293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.238150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114feb5-d477-40cb-93e0-b6316d2173af None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.241170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.259596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.260279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.260561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.260833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.261723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.263649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.284311 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3662/7277] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:03.285300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:03.287457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:03.289142 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3616/7278] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:03.292530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:03.318493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf91d-04ad-4929-9a7d-dafe7521d5f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.324289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.325402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.331199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.331901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] PATH_INFO: `/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f/users/22f062539d214457a454856c075f3e52/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.335324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1f73db5bfe4dbaa970bcaba1df022f, user_id=22f062539d214457a454856c075f3e52, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.339566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.364422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3617/7279] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:03 2022] PUT /identity/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f/users/22f062539d214457a454856c075f3e52/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:03.365662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:03.375779 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:03.450177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569092f-1bb1-4166-ab52-181fa9c2ca16 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.541710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a5fa1-4438-4918-8f6a-6bd98923e9e8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.567626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.573899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.574286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.574840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.574974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.575288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.575672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.575961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] PATH_INFO: `/v3/projects/942243356ae240929f0e2a28d3f77dc5/users/d0fb4a37d6814c0f99c1d967a01caf45/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.585200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] RBAC: Authorizing `identity:create_grant(project_id=942243356ae240929f0e2a28d3f77dc5, user_id=d0fb4a37d6814c0f99c1d967a01caf45, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.592783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66115e2-2fae-4f56-aca3-ff41c75312be admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.602696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.604594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.618242 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3618/7280] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:03 2022] PUT /identity/v3/projects/942243356ae240929f0e2a28d3f77dc5/users/d0fb4a37d6814c0f99c1d967a01caf45/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:03.620396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d941-16b4-4f50-b2fc-3adddc383973 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.620865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d941-16b4-4f50-b2fc-3adddc383973 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.621475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d941-16b4-4f50-b2fc-3adddc383973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.627909 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3663/7281] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:03.633604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:03.635431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:03.665937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132f06a-1735-4a9e-82d9-160403fad9a0 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:03.670623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3c70d941-16b4-4f50-b2fc-3adddc383973 None None] MFA Rules not processed for user `22f062539d214457a454856c075f3e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:03.679101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c70d941-16b4-4f50-b2fc-3adddc383973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:03.822870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:03.825470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.826781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.827077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] PATH_INFO: `/v3/users/62f36c88b9f043cc948c3a385211994e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.831592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f36c88b9f043cc948c3a385211994e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:03.840110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:03.885519 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3619/7282] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:03.889428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7f97-58de-43ce-a586-b5693ddc4240 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:03.889749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7f97-58de-43ce-a586-b5693ddc4240 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:03.890051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7f97-58de-43ce-a586-b5693ddc4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:03.933313 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:04.000109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4dbf7f97-58de-43ce-a586-b5693ddc4240 None None] MFA Rules not processed for user `d0fb4a37d6814c0f99c1d967a01caf45`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:04.003828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4dbf7f97-58de-43ce-a586-b5693ddc4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:04.021112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f36c88b9f043cc948c3a385211994e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:04.022348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f36c88b9f043cc948c3a385211994e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:04.037493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f36c88b9f043cc948c3a385211994e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:04.054876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f36c88b9f043cc948c3a385211994e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:04.088948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f36c88b9f043cc948c3a385211994e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:04.111320 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3664/7283] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:03 2022] DELETE /identity/v3/users/62f36c88b9f043cc948c3a385211994e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:04.112780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.116320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:04.231893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3620/7284] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:04.233954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.234249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.234529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.287758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:04.290576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:04.296246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054b72-68aa-4f25-b639-e0c782557aa0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:04.302243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:04.303376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.303657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.303782 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:04.303937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.305445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f1af89ed73d4fd6a65beb24058d62aa)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:04.307824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:04.315492 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3665/7285] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:04 2022] GET /identity/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa => generated 385 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:04.315824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.428116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5ef7-8cc1-4281-b205-763f6becc699 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:04.433033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:04.433930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.434221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.434539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.436267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:04.449943 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3621/7286] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:04.451529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:04.452475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.478354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bd9e7-4b7c-4988-91cf-a42d54d2b8c6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:04.492610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:04.493431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.493877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.494271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.495296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:04.498838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:04.512256 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3666/7287] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:43:04 2022] POST /identity/v3/domains => generated 276 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:04.516858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.521136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:04.588907 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3622/7288] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:43:04 2022] POST /identity/v3/projects => generated 338 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:04.588907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.607256 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:04.680412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22459d-1bb6-4845-8c09-1e09225414ee tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:04.778903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f32b5-0a63-428c-9eb3-a25805edd7fd tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:04.790412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:04.791088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.791216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:04.791368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.791636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.791790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:04.792209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:04.792508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:04.793311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:04.795301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:04.882248 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3623/7289] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:04 2022] POST /identity/v3/users => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:04.883119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:04.891471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:04.929192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:04.930683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:04.950989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3667/7290] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:04.952114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.054729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a146-a42b-44d5-a260-daf64dd668a0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.073379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.074318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.074608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.074894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] PATH_INFO: `/v3/projects/5feee4e4509b41849d94869be9fd3052` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.078333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5feee4e4509b41849d94869be9fd3052)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.080534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.121312 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:05.122211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565f26-e36e-4a82-be23-37cf97c986d7 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.129351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.130150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.130361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.130672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.131687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.136881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.188506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3668/7291] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:43:04 2022] GET /identity/v3/projects => generated 6846 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:05.191668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.209825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5feee4e4509b41849d94869be9fd3052', 'request_id': 'req-00a633b2-86ed-4405-9058-97e0dfbe80a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.219235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb2e95-0fa2-4a82-b7ec-ed42d0f60eed tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.220469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5feee4e4509b41849d94869be9fd3052', 'request_id': 'req-00a633b2-86ed-4405-9058-97e0dfbe80a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.239737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5feee4e4509b41849d94869be9fd3052', 'request_id': 'req-00a633b2-86ed-4405-9058-97e0dfbe80a5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.286228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] The token cache is being invalidate because project 5feee4e4509b41849d94869be9fd3052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:05.286980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.287978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.290194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3624/7292] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:04 2022] DELETE /identity/v3/projects/5feee4e4509b41849d94869be9fd3052 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:05.291236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.293909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:05.324164 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:05.389611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.390337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.390835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.391125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.400019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.402430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.473712 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3669/7293] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:05 2022] POST /identity/v3/users => generated 323 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:05.474894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.486514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:05.538526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a633b2-86ed-4405-9058-97e0dfbe80a5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.557943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.559204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.568899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.569578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.571685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f1af89ed73d4fd6a65beb24058d62aa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.574321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.584326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3625/7294] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:05 2022] GET /identity/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa => generated 385 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:05.598679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.605282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:05.649401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94869-57a3-421c-9f3b-07c540306586 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.662776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b070-9875-4ce2-9d1c-75dc6795c7be tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.675413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.676444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.677177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.677465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.677828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] PATH_INFO: `/v3/users/43449102f11649b6be4ec0b2f8d06b50` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.678342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.678831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.679303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users/8d1e4ae42b894606abf9210a2ac203bb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.683090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43449102f11649b6be4ec0b2f8d06b50)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.685373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.713446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:get_user(user_id=8d1e4ae42b894606abf9210a2ac203bb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.717173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.726790 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3626/7295] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:43:05 2022] GET /identity/v3/users/8d1e4ae42b894606abf9210a2ac203bb => generated 346 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:05.728284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.753208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92e516-7ce2-4206-a256-f2f28beba0e3 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.764342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.765392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.765763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.766110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects/263647eecf4a448da091729a1b70dcd0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.768830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:get_project(project_id=263647eecf4a448da091729a1b70dcd0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.775130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.777298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3627/7296] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:05 2022] GET /identity/v3/projects/263647eecf4a448da091729a1b70dcd0 => generated 338 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:05.788039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.803409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43449102f11649b6be4ec0b2f8d06b50'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.804599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feb20b-7c96-43b1-a8ea-8d53c74ba9e8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:05.806649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43449102f11649b6be4ec0b2f8d06b50'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.816445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:05.817213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:05.817567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:05.817975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:05.819366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Adding query filter params (domain_id=3a5a3d967fe8474194b8bc1d5eb75bd1) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:05.819779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:05.823750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:05.826646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43449102f11649b6be4ec0b2f8d06b50'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.843192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43449102f11649b6be4ec0b2f8d06b50'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.865423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3628/7297] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Jul 24 01:43:05 2022] GET /identity/v3/users?domain_id=3a5a3d967fe8474194b8bc1d5eb75bd1 => generated 483 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:05.866359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.877953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:05.882010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43449102f11649b6be4ec0b2f8d06b50'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:05.896172 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3670/7298] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:05 2022] DELETE /identity/v3/users/43449102f11649b6be4ec0b2f8d06b50 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:05.896172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:05.915343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:05.921681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755729-b10e-4e4d-80b0-c7c2a11255e0 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.054499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.055430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.055711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.055987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] PATH_INFO: `/v3/projects/37e2878c337d4b92acb73d1937049161` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.059044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e2878c337d4b92acb73d1937049161)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.060364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.067155 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:06.106365 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:06.134979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d6d2-f87b-4094-b5c7-3d949d442846 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.152730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.154996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.155454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.156672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.157716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.166397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.217106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e2878c337d4b92acb73d1937049161', 'request_id': 'req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:06.229529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3671/7299] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:43:05 2022] GET /identity/v3/projects => generated 6142 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:06.232783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.239056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e2878c337d4b92acb73d1937049161', 'request_id': 'req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:06.241612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.266745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e2878c337d4b92acb73d1937049161', 'request_id': 'req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:06.318940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] The token cache is being invalidate because project 37e2878c337d4b92acb73d1937049161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:06.321024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:06.327156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:06.331974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3629/7300] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:05 2022] DELETE /identity/v3/projects/37e2878c337d4b92acb73d1937049161 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:06.340708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.350039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.433941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac62c0e-c391-4f15-89f3-6d0ac6c3a117 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.525518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6c68-d063-4999-8a8f-f6af77cdc20e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.546714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.547417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.547704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.547878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.548042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.548571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.549313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:06.549445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.549697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.549831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.550489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.551701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.552310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41c0c-f536-4771-a70f-4f6fa6005fb7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.610599 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3672/7301] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/users => generated 8022 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:06.612777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.613064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.613322 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3630/7302] 10.222.0.27 () {58 vars in 1165 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/projects?domain_id=default => generated 5811 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:06.613441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.614989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.634793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3574-b761-4fff-b807-c9f6390acd3f tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.651636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.652266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.652554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.652835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.653589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.655968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.658460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:06.659710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.702253 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3631/7303] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/projects => generated 6142 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:06.703293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.707103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.738878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001733d-2bf7-4d06-a274-96ffbefdcfe6 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.748680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.749376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.749961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.750551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.751560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Adding query filter params (name=tempest-test_user-274086801) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:06.752568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.758027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16317e83-d398-4a40-8661-6febcce09846 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.790330 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3673/7304] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:06.791217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.810534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ba669-e3a0-4326-9bf8-07bd9a22ed33 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.822886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.823759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.824176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.824457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.826367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:06.826679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.835016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.861825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3632/7305] 10.222.0.27 () {58 vars in 1186 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/users?name=tempest-test_user-274086801 => generated 473 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:06.866860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.867274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.867665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.887900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:06.900418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.902064 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3674/7306] 10.222.0.27 () {58 vars in 1165 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/projects?domain_id=default => generated 5811 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:06.903060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.904905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:06.916297 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:06.929864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3633/7307] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:06.930913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb2f4-aebf-487b-b18d-2a4a40ffecb8 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.931838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:06.937421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.938460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.938742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.939097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] PATH_INFO: `/v3/projects/4760e0ba45334cb48f53854172a4aac4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.945288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec50d-db90-44e1-a898-5b82624f8cce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:06.945999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4760e0ba45334cb48f53854172a4aac4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.947929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:06.951939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:06.952942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:06.953463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:06.954077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:06.955383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:06.955941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:06.958068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.019891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3634/7308] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:43:06 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:07.020751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.051603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4760e0ba45334cb48f53854172a4aac4', 'request_id': 'req-8e644441-7f99-499d-bbc9-54d34fdc9751'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.059655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4760e0ba45334cb48f53854172a4aac4', 'request_id': 'req-8e644441-7f99-499d-bbc9-54d34fdc9751'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.062806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3854f6-c59d-4c9a-a568-b96cf31706b7 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.071752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4760e0ba45334cb48f53854172a4aac4', 'request_id': 'req-8e644441-7f99-499d-bbc9-54d34fdc9751'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.098285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] The token cache is being invalidate because project 4760e0ba45334cb48f53854172a4aac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:07.098703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.101879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.107269 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3675/7309] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:06 2022] DELETE /identity/v3/projects/4760e0ba45334cb48f53854172a4aac4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:07.107909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.133948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.153507 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:07.179992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.181124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.181124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.181552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.182450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.195758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.241812 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3635/7310] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:43:07 2022] GET /identity/v3/projects => generated 5791 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:07.242958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.245020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.276059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644441-7f99-499d-bbc9-54d34fdc9751 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.281800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.282491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.282781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.284323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.285293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:07.285615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.290714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f944e-ee60-4f66-a4ea-bd87a8ad925a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.328601 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3676/7311] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:07.328601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212526e-88a6-463d-81f5-58114d988862 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.328601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212526e-88a6-463d-81f5-58114d988862 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.328601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212526e-88a6-463d-81f5-58114d988862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.366423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3212526e-88a6-463d-81f5-58114d988862 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:07.367823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3212526e-88a6-463d-81f5-58114d988862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.374132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c9795-a478-43a5-af26-29fbef5cd276 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.387288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.388336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.389188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.389188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users/2b5cb1c9c9cc4d9389b49441f7de5590` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.393490 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3677/7312] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:07.395140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212526e-88a6-463d-81f5-58114d988862 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.404466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3212526e-88a6-463d-81f5-58114d988862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.422770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b5cb1c9c9cc4d9389b49441f7de5590)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.425530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.434639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212526e-88a6-463d-81f5-58114d988862 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.451449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.452212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.452561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.452910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.454023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-33390329) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:07.454349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.456412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.507997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3678/7313] 10.222.0.27 () {58 vars in 1227 bytes} [Sun Jul 24 01:43:07 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-33390329 => generated 531 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:07.508554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.526740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5cb1c9c9cc4d9389b49441f7de5590'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.538182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e7586-66e1-4275-8202-7e62a3d4b2c1 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.538590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5cb1c9c9cc4d9389b49441f7de5590'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.547652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5cb1c9c9cc4d9389b49441f7de5590'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.550643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.552540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.552829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.553106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.553842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.561788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:07.570663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5cb1c9c9cc4d9389b49441f7de5590'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.571936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-70352fd4-b2f9-45e9-96af-02480232d36c tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5cb1c9c9cc4d9389b49441f7de5590'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:07.588834 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3636/7314] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:07 2022] DELETE /identity/v3/users/2b5cb1c9c9cc4d9389b49441f7de5590 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:07.593089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.593999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.594616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.625436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3679/7315] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:07.627281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:07.628974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.630199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.634353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.716603 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:07.761640 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3637/7316] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:07.766440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:07.769208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:07.957239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47b85-a88a-4341-a80f-138b20bda6a6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:07.969632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:07.970967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:07.971446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:07.971901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/users/8d1e4ae42b894606abf9210a2ac203bb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:07.976055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8d1e4ae42b894606abf9210a2ac203bb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:07.978376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.063963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1e4ae42b894606abf9210a2ac203bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.076157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1e4ae42b894606abf9210a2ac203bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.091566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1e4ae42b894606abf9210a2ac203bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.120947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1e4ae42b894606abf9210a2ac203bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.122657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1e4ae42b894606abf9210a2ac203bb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.138005 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3638/7317] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:07 2022] DELETE /identity/v3/users/8d1e4ae42b894606abf9210a2ac203bb => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:08.142066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.146540 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:08.146972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.198665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb89cd-97f7-45e9-95bb-57c70d2dfd80 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.248981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c81e-48bf-4064-bf2c-c3275e323b71 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.261218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.262176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.262991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.263522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.264570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.267478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.303639 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:08.311991 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3639/7318] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:08 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:08.313001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.315863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.337457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f58af-0e22-4eeb-82bf-6e80811b5c8a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.342680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.343558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.343697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.343922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.344915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:08.345232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.347960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.368277 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3640/7319] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:08.369241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.371120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.373700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f062539d214457a454856c075f3e52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e1f73db5bfe4dbaa970bcaba1df022f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.375831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.376114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.376390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] PATH_INFO: `/v3/projects/263647eecf4a448da091729a1b70dcd0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.382578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorizing `identity:delete_project(project_id=263647eecf4a448da091729a1b70dcd0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.384512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.513340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263647eecf4a448da091729a1b70dcd0', 'request_id': 'req-5dc92f71-0a54-4b77-8b68-845a7f17b741'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.526946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263647eecf4a448da091729a1b70dcd0', 'request_id': 'req-5dc92f71-0a54-4b77-8b68-845a7f17b741'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.546480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263647eecf4a448da091729a1b70dcd0', 'request_id': 'req-5dc92f71-0a54-4b77-8b68-845a7f17b741'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.566079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] The token cache is being invalidate because project 263647eecf4a448da091729a1b70dcd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:08.570896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.571980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.573768 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3680/7320] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:07 2022] DELETE /identity/v3/projects/263647eecf4a448da091729a1b70dcd0 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:08.577442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.584332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.641865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956592-df4e-403a-98b3-0e03fd5bdbb4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.663130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92f71-0a54-4b77-8b68-845a7f17b741 tempest-ListProjectsStaticTestJSON-316643268 tempest-ListProjectsStaticTestJSON-316643268-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.668333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.669239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.669705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.670139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.671276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.673391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.693990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3681/7321] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:08.695962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.713604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.714791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.715705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.715974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.716251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/domains/3a5a3d967fe8474194b8bc1d5eb75bd1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.717756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3a5a3d967fe8474194b8bc1d5eb75bd1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.719460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.746923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc770832-f2dd-4660-b810-407f2d88114c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.761619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.763130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.763523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.764034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.764880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.769353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.769817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.771571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.789458 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:08.820270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.821293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:08.825053 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3641/7322] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:43:08 2022] PATCH /identity/v3/domains/3a5a3d967fe8474194b8bc1d5eb75bd1 => generated 277 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:08.826390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.829075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.834164 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3682/7323] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:08 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:08.835218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.837769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.955634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b2fd-9eae-4d1d-917c-c4bcdcdcc805 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.962969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.964343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.964778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.965063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.965848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.967616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.973246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1401-7371-4bd0-bf68-f6e01e5bae29 tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:08.981439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:08.985230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:08.985230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:08.985472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3683/7324] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:08.985593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] PATH_INFO: `/v3/users/4987f1998f1d4fb7b30b12010aacbf65` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:08.985700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:08.986752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4987f1998f1d4fb7b30b12010aacbf65)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:08.988813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:08.989500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:08.991866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:09.073280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4987f1998f1d4fb7b30b12010aacbf65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.101809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94e151-b346-4f13-9c10-0b8d15289999 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:09.105969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4987f1998f1d4fb7b30b12010aacbf65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.113920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0fb4a37d6814c0f99c1d967a01caf45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942243356ae240929f0e2a28d3f77dc5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:09.114739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.115026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.115307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] PATH_INFO: `/v3/domains/3a5a3d967fe8474194b8bc1d5eb75bd1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.122148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4987f1998f1d4fb7b30b12010aacbf65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.141546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4987f1998f1d4fb7b30b12010aacbf65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.142701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3a5a3d967fe8474194b8bc1d5eb75bd1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:09.144417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:09.145775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4987f1998f1d4fb7b30b12010aacbf65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.157224 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3642/7325] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:08 2022] DELETE /identity/v3/users/4987f1998f1d4fb7b30b12010aacbf65 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:09.159897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.164191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.187014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.205903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.270756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.277915 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:09.279289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.291865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.312238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2b19-050c-4426-9c28-a6d2ecef9270 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:09.326187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] The token cache is being invalidate because project 3a5a3d967fe8474194b8bc1d5eb75bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:09.334865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.336303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.377538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.380643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.382189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3a5a3d967fe8474194b8bc1d5eb75bd1', 'request_id': 'req-a3d9c233-17d3-4417-8225-576a4527775d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.428363 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3684/7326] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:08 2022] DELETE /identity/v3/domains/3a5a3d967fe8474194b8bc1d5eb75bd1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:09.431437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.437337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.445616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:09.446520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.446848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.447268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.447996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:09.473518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c233-17d3-4417-8225-576a4527775d tempest-UsersV3TestJSON-129775474 tempest-UsersV3TestJSON-129775474-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:09.478317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee28b8-89f1-48b2-9a6b-4a9e51f4f310 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:09.483407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:09.484658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.485056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.485443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] PATH_INFO: `/v3/projects/e2d7da6eee884068adb42a735089bf08/users/3a37e2676b9e40dd852e0ccb6c81192b/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.519281 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3643/7327] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:09 2022] POST /identity/v3/users => generated 294 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:09.520749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.521033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.521309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.523288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d7da6eee884068adb42a735089bf08, user_id=3a37e2676b9e40dd852e0ccb6c81192b, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:09.526642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:09.557608 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3685/7328] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:09 2022] PUT /identity/v3/projects/e2d7da6eee884068adb42a735089bf08/users/3a37e2676b9e40dd852e0ccb6c81192b/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:09.558288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.567730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.572694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:09.574311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.598889 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:09.694221 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3644/7329] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:09.695498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.697201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.711176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337480a-f0b0-4a51-a6fe-c244c266be14 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:09.711971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbec630-b664-4eee-9bac-a51e1676f646 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:09.718202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:09.719199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.721063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.721225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.722533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:09.724408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3b968-22f2-4b69-b506-284b7730503d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:09.725059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:09.725978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.726258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.726532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] PATH_INFO: `/v3/users/8f525a08c163442daac526184565bb99` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.731857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f525a08c163442daac526184565bb99)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:09.733822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:09.737017 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3645/7330] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:09.738438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:09.738928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:09.739226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:09.774546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] MFA Rules not processed for user `3a37e2676b9e40dd852e0ccb6c81192b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:09.775948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.821079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f525a08c163442daac526184565bb99'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.822684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f525a08c163442daac526184565bb99'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.834068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f525a08c163442daac526184565bb99'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.851024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f525a08c163442daac526184565bb99'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.876465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f525a08c163442daac526184565bb99'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:09.882194 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3646/7331] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:09.885960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.894326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.894534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3686/7332] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:09 2022] DELETE /identity/v3/users/8f525a08c163442daac526184565bb99 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:09.895085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:09.897581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:09.927043 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:09.993750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48692ea-41f2-47a2-b791-fb937e8afbbb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.001014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.003256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.003690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.004043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.005041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.007740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.018884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feaf80-0917-4035-823a-573d77b8fdb9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.029993 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3687/7333] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:10.030908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:10.039344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:10.119383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.120074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.120358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.120636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.122608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:10.137634 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:10.148756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.150334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c45ac-3c7a-427a-8159-5d298a8e18d1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.157077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45c8de-17e5-4222-918e-a82d88c82d93 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.170849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.171531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.171814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.172095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.176864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3647/7334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:10.181550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.184363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.184770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.225527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:10.228511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:10.251147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3648/7335] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:10.253321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:10.266297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aa19d-61b3-46f7-9726-a84d396f85af None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.272839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.274860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.275431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.275936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] PATH_INFO: `/v3/projects/fc5d351416ae4c3d9e666f216fda253f/users/226255da09a0465c9e1d395a0a0ee4eb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.299149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d351416ae4c3d9e666f216fda253f, user_id=226255da09a0465c9e1d395a0a0ee4eb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.303736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.343044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3649/7336] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:10 2022] PUT /identity/v3/projects/fc5d351416ae4c3d9e666f216fda253f/users/226255da09a0465c9e1d395a0a0ee4eb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:10.346591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:10.347290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.348985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019d2b-48d8-4cb5-9153-dfe2ea9871e1 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.354417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:10.369509 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3688/7337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:10.370958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.371251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.371535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.432985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] MFA Rules not processed for user `226255da09a0465c9e1d395a0a0ee4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:10.434145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:10.537489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984bef3-8326-47cb-b1c3-d5944fe00b8f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.551901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.552813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.553235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.555391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.556091 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:10.569870 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3689/7338] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:10.575627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:10.696576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9d469-a4ac-456a-9f6c-a7e847196855 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.709057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.709766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.710054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.710335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.711053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.712976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.728803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.733048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.771353 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3650/7339] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:10.772985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3690/7340] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:10 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:10.776658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:10.798704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88f449-8b99-4561-8e57-bcfa614f22bd service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:10.968580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:10.969590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:10.970123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:10.973982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:10.977238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:10.979739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:10.998371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.000780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:11.023073 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3651/7341] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:10 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:11.028174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.037151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e88eb-9550-4780-a904-28ee08567033 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.047028 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:11.061424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a599d-2d78-464c-887b-fa8e2cb6952b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.070805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.071935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.073698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.074443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] PATH_INFO: `/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.081164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1af89ed73d4fd6a65beb24058d62aa)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.082697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.082850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.083508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.093172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.093607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.094671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.097138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.112404 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3652/7342] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:11.125789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.151493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516f927-eea4-4d2c-b965-0e0b1c45c5c4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.170745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.174713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.175224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.175814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] PATH_INFO: `/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff/users/d9d2b8b887e14fcc9156a423a9171b2b/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.238669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ca65dfbd154e3cb9d5f2f3281a35ff, user_id=d9d2b8b887e14fcc9156a423a9171b2b, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.244776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1af89ed73d4fd6a65beb24058d62aa', 'request_id': 'req-a620b079-505c-42f6-b563-dfb840c9e507'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.247198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.258604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1af89ed73d4fd6a65beb24058d62aa', 'request_id': 'req-a620b079-505c-42f6-b563-dfb840c9e507'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.271173 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3653/7343] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:11 2022] PUT /identity/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff/users/d9d2b8b887e14fcc9156a423a9171b2b/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:11.275059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1af89ed73d4fd6a65beb24058d62aa', 'request_id': 'req-a620b079-505c-42f6-b563-dfb840c9e507'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.284797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.318176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] The token cache is being invalidate because project 4f1af89ed73d4fd6a65beb24058d62aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:11.318780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.319569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.324735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3691/7344] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:10 2022] DELETE /identity/v3/projects/4f1af89ed73d4fd6a65beb24058d62aa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:11.326210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.331835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:11.415619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e563-49fa-4613-8e49-7f1d141814d2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.421773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.422745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.423037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.423319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.424637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.426481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.441292 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3654/7345] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:11.447391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.450095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:11.465395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d272e4-71c6-4176-8273-ed3c632d7110 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.475842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.477025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.477590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.478085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] PATH_INFO: `/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff/users/d9d2b8b887e14fcc9156a423a9171b2b/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.481172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ca65dfbd154e3cb9d5f2f3281a35ff, user_id=d9d2b8b887e14fcc9156a423a9171b2b, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.484464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e673b3-dda4-43ca-8d37-53845cae90f0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.509408 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3655/7346] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:11 2022] PUT /identity/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff/users/d9d2b8b887e14fcc9156a423a9171b2b/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:11.511901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.512248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.512534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.538005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620b079-505c-42f6-b563-dfb840c9e507 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:11.560812 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:11.582206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] MFA Rules not processed for user `d9d2b8b887e14fcc9156a423a9171b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:11.588454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:11.701386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:11.705982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:11.706326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:11.706612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] PATH_INFO: `/v3/users/22f062539d214457a454856c075f3e52` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:11.711627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f062539d214457a454856c075f3e52)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:11.717867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:11.832240 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3656/7347] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:11.844122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:11.847903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:11.874779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f062539d214457a454856c075f3e52'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.877762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f062539d214457a454856c075f3e52'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.907006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f062539d214457a454856c075f3e52'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.922437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f062539d214457a454856c075f3e52'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:11.954405 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:11.975171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f062539d214457a454856c075f3e52'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.001028 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3692/7348] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:11 2022] DELETE /identity/v3/users/22f062539d214457a454856c075f3e52 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:12.003505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:12.005403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02fbce-7026-4311-93f3-784bd776d12d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:12.009967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:12.142349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca435-bbb6-4d6f-95da-ea7e4cadba13 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:12.149024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:12.150228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:12.150653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:12.151227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] PATH_INFO: `/v3/projects/6cc649825fe44a12af160d0643f2c5bb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:12.152704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc649825fe44a12af160d0643f2c5bb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:12.154917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:12.188923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:12.190026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:12.190218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:12.190471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:12.194963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:12.221243 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:12.267064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc649825fe44a12af160d0643f2c5bb', 'request_id': 'req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.299000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc649825fe44a12af160d0643f2c5bb', 'request_id': 'req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.309438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc649825fe44a12af160d0643f2c5bb', 'request_id': 'req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.335713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] The token cache is being invalidate because project 6cc649825fe44a12af160d0643f2c5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:12.335957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.337214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.338966 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3693/7349] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:12 2022] DELETE /identity/v3/projects/6cc649825fe44a12af160d0643f2c5bb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:12.347114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:12.351784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:12.438379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:12.441644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:12.472123 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3657/7350] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:12.503214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e8a5b-2f8c-4393-9512-0f2f8ef5a4dd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:12.508624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:12.510019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:12.510499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:12.510991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] PATH_INFO: `/v3/users/d0fb4a37d6814c0f99c1d967a01caf45` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:12.513288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0fb4a37d6814c0f99c1d967a01caf45)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:12.515926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:12.581082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0fb4a37d6814c0f99c1d967a01caf45'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.582649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0fb4a37d6814c0f99c1d967a01caf45'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.597154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0fb4a37d6814c0f99c1d967a01caf45'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.608172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0fb4a37d6814c0f99c1d967a01caf45'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.654118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1fffef62-5bc0-4830-93f7-3c53eabeb6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0fb4a37d6814c0f99c1d967a01caf45'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:12.664915 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3694/7351] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:12 2022] DELETE /identity/v3/users/d0fb4a37d6814c0f99c1d967a01caf45 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:12.757480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:12.759004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:12.788491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df8ff9-86f1-4467-85ac-0846ce8192f4 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:12.900910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:12.902023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:12.902422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:12.902960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] PATH_INFO: `/v3/users/226255da09a0465c9e1d395a0a0ee4eb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:12.904657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=226255da09a0465c9e1d395a0a0ee4eb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:12.908207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:13.009465 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.014898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226255da09a0465c9e1d395a0a0ee4eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.027926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226255da09a0465c9e1d395a0a0ee4eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.040851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226255da09a0465c9e1d395a0a0ee4eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.059953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226255da09a0465c9e1d395a0a0ee4eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.060699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226255da09a0465c9e1d395a0a0ee4eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.068286 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3658/7352] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:12 2022] DELETE /identity/v3/users/226255da09a0465c9e1d395a0a0ee4eb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:13.072934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.073300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.073483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.104479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:13.106127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.128160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:13.130436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.186712 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.241801 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3695/7353] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:13.243069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:13.246540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.265724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb94f1-1165-46f2-98d6-d81ba9944176 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:13.271820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:13.272950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.273333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.273748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] PATH_INFO: `/v3/projects/942243356ae240929f0e2a28d3f77dc5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.275453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=942243356ae240929f0e2a28d3f77dc5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:13.278159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:13.323291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753f5d8-e3f7-4f4b-9d33-5a83625b7181 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:13.334412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:13.335640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.336116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.336572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] PATH_INFO: `/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.338389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1f73db5bfe4dbaa970bcaba1df022f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:13.340798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:13.395416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942243356ae240929f0e2a28d3f77dc5', 'request_id': 'req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.404876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942243356ae240929f0e2a28d3f77dc5', 'request_id': 'req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.416634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942243356ae240929f0e2a28d3f77dc5', 'request_id': 'req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.417374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1f73db5bfe4dbaa970bcaba1df022f', 'request_id': 'req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.430048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1f73db5bfe4dbaa970bcaba1df022f', 'request_id': 'req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.431866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] The token cache is being invalidate because project 942243356ae240929f0e2a28d3f77dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:13.432159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.432850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.435221 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3696/7354] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:13 2022] DELETE /identity/v3/projects/942243356ae240929f0e2a28d3f77dc5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:13.436605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:13.438607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.452173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1f73db5bfe4dbaa970bcaba1df022f', 'request_id': 'req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.479109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] The token cache is being invalidate because project 8e1f73db5bfe4dbaa970bcaba1df022f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:13.479403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.481085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8aa39b25-64e8-4b20-a1ba-d0a2dd149bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:13.484937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3659/7355] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:13 2022] DELETE /identity/v3/projects/8e1f73db5bfe4dbaa970bcaba1df022f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:13.487521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454baee-5d05-4b04-bc14-97939f31dab3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.487821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454baee-5d05-4b04-bc14-97939f31dab3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.490260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454baee-5d05-4b04-bc14-97939f31dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.527544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c454baee-5d05-4b04-bc14-97939f31dab3 None None] MFA Rules not processed for user `3a37e2676b9e40dd852e0ccb6c81192b`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:13.529615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c454baee-5d05-4b04-bc14-97939f31dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.561647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d7e9-2e3b-4c34-bcdd-475af08db56e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:13.657698 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.678537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3660/7356] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:13.702449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6a8b-543d-481a-89e8-46c5380ef3e2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.707279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6a8b-543d-481a-89e8-46c5380ef3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.707594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d6a8b-543d-481a-89e8-46c5380ef3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.745275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:13.748042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.748373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.749980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.757769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.772815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d16d6a8b-543d-481a-89e8-46c5380ef3e2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:13.775490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d16d6a8b-543d-481a-89e8-46c5380ef3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.844338 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:13.898086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:13.900125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d2814-9f63-4a78-9122-794b7da8b99b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:13.912021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3661/7357] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:13.918101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce450df-e619-438e-8c4e-468a28184026 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.918571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce450df-e619-438e-8c4e-468a28184026 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.918967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce450df-e619-438e-8c4e-468a28184026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.926494 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3697/7358] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:13.930114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:13.931101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:13.931588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:13.981841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:13.985459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:13.995823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dce450df-e619-438e-8c4e-468a28184026 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:14.001142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dce450df-e619-438e-8c4e-468a28184026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:14.022572 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3662/7359] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:14.031645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.032194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.032796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.034285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3698/7360] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:14.038098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.061020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030af44-c944-4cc5-96f8-d6d845106e9c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.073070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.073808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.075681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.076325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.078072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:14.078362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:14.079706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.079938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:14.083887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.098961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3663/7361] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:14.104106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.128251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635ff94-7fb3-4975-921d-0bd272a5c4b5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.140979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.144094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.144521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.146039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.147970 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3699/7362] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:14.148369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:14.149306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.150495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.154461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.177025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5227368-7050-4b9b-bf9f-6e5ee06329ab admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.181920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3664/7363] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:14.183845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.192076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.193525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.193841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.194126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.195485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.197547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.197960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c90bc9-532f-4e79-ac09-5f2fc36c1b30 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.206415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.207387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.207781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.208190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.209042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.212327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.260932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3665/7364] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:14.261286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3700/7365] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:14.264247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.264415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.366878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc6da4-a1c4-4a8e-b853-87c879004125 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.399432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c12d-12aa-4b92-87e3-b77e9c0a07d2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.405839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.406638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.407073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.407523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.408901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.411265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.443124 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3701/7366] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:14.445106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.471991 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:14.483287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53178893-dc90-4d64-b400-20adccef49c8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.488366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.489859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.490152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.490416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.490552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.491132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.491524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.492046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.492869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.493082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.493700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.496111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.513930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3702/7367] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:14.530531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.571150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee77192-77ce-48d8-a620-912b65577739 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.583027 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3666/7368] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:14.584972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.585660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.592265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.592871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.593247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.594201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.597281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.609247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50505-40e2-4b12-99c1-fd329705a2d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.629141 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3703/7369] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:14.630290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.632090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.632792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.633077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.633349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.634125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:14.635621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.641639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.665782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fb803-6c0e-4164-a858-a874776055eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.676771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3667/7370] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:14.677829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.682848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.696522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a091d-e430-4caf-91e4-d251ed61464b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.701852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.706400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.706732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] PATH_INFO: `/v3/projects/fc5d351416ae4c3d9e666f216fda253f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.709521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:14.713211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.713211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.713211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] PATH_INFO: `/v3/projects/3f987b54f28347dba3bf27726ee9eaf1/users/bd4a4b25579240a1895c6356522130ef/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:14.714740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5d351416ae4c3d9e666f216fda253f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.716740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.740221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f987b54f28347dba3bf27726ee9eaf1, user_id=bd4a4b25579240a1895c6356522130ef, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:14.744631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:14.770420 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3668/7371] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:14 2022] PUT /identity/v3/projects/3f987b54f28347dba3bf27726ee9eaf1/users/bd4a4b25579240a1895c6356522130ef/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:14.772738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:14.867342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5d351416ae4c3d9e666f216fda253f', 'request_id': 'req-58de079b-f157-4801-b2ea-4356976777d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:14.879023 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:14.885054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5d351416ae4c3d9e666f216fda253f', 'request_id': 'req-58de079b-f157-4801-b2ea-4356976777d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:14.888295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8ca9-2685-4de8-866c-2a2d88fea9e1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:14.896352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5d351416ae4c3d9e666f216fda253f', 'request_id': 'req-58de079b-f157-4801-b2ea-4356976777d0'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:14.935696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] The token cache is being invalidate because project fc5d351416ae4c3d9e666f216fda253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:14.936001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:14.937118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-58de079b-f157-4801-b2ea-4356976777d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:14.945929 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3704/7372] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:14 2022] DELETE /identity/v3/projects/fc5d351416ae4c3d9e666f216fda253f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:14.951692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:14.952023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:14.952262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.017617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] MFA Rules not processed for user `bd4a4b25579240a1895c6356522130ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:15.019167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:15.071503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.072199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.072481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.072761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.074866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:15.078498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:15.095833 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3669/7373] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:15.097555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.099710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:15.132097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56b9e-a671-4ee8-95b1-8d006cd0cca6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:15.143771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.146750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.147037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.147317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] PATH_INFO: `/v3/users/d9d2b8b887e14fcc9156a423a9171b2b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.151243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d2b8b887e14fcc9156a423a9171b2b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:15.154575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:15.197954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3705/7374] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:15.199586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.206163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:15.270787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d2b8b887e14fcc9156a423a9171b2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:15.272733 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:15.282392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d2b8b887e14fcc9156a423a9171b2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:15.301434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d2b8b887e14fcc9156a423a9171b2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:15.310643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc2335-007e-45d1-b867-a42909e4d855 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:15.316826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d2b8b887e14fcc9156a423a9171b2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:15.317714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d2b8b887e14fcc9156a423a9171b2b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:15.327687 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3670/7375] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:15 2022] DELETE /identity/v3/users/d9d2b8b887e14fcc9156a423a9171b2b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:15.327687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.327997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:15.329470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.331377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.331767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.332152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] PATH_INFO: `/v3/projects/8e2b66bba2bf4803b053bbe19717331d/users/31007d5bea0c454e8f2f3076c1c11e42/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.364663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2b66bba2bf4803b053bbe19717331d, user_id=31007d5bea0c454e8f2f3076c1c11e42, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:15.368217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f782-03d0-4b25-bb27-d94c245c00e4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:15.411409 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3706/7376] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:15 2022] PUT /identity/v3/projects/8e2b66bba2bf4803b053bbe19717331d/users/31007d5bea0c454e8f2f3076c1c11e42/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:15.420661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.421263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.421804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.427126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127683c-cad4-4232-9992-e9f32b67ec61 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:15.479954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:15.481463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:15.514405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.518379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.518781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.519328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.520051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:15.526449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:15.611885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3671/7377] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:15 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:15.613818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.692427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3707/7378] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:15.697292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.714152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc35ac-af25-4986-8381-6685a381d745 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:15.796808 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:15.812702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a9e48-8f69-49a3-a05a-50cdefc28788 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:15.830301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.830992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.831279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.831549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.832337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:15.834496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:15.839543 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:15.917827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:15.918827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:15.918827 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:15.919290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:15.963982 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3672/7379] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:15 2022] POST /identity/v3/users => generated 300 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:15.972609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:15.996718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7c90-e8cb-414b-a89e-4ef4e6f768bf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.016472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.018989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.018989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.018989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.022306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.025348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.030015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:16.059061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3708/7380] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:15 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:16.069396 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3673/7381] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:16.071202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.113158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea1b0-b8c6-424d-9765-16d59416daa7 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.128203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.129326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.129620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.129959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] PATH_INFO: `/v3/projects/262db36eddc7409dbbe189177c187207/users/91c81a4463e444bb9723181407e2a489/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.151785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262db36eddc7409dbbe189177c187207, user_id=91c81a4463e444bb9723181407e2a489, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.155418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.180989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3709/7382] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:16 2022] PUT /identity/v3/projects/262db36eddc7409dbbe189177c187207/users/91c81a4463e444bb9723181407e2a489/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:16.181521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.196252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c98e-4b14-4aaf-a136-9a14c1fd2c1f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.342552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.343215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.344121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.344343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.354307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.357826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5d8db-bc66-4699-9064-2587443df73a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.373527 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3674/7383] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:16.374713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.388622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc6bb6-de9a-4895-80d3-e6265c777030 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.395593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.396644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.396929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.397209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] PATH_INFO: `/v3/projects/262db36eddc7409dbbe189177c187207/users/91c81a4463e444bb9723181407e2a489/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.399363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262db36eddc7409dbbe189177c187207, user_id=91c81a4463e444bb9723181407e2a489, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.402415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.418078 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3710/7384] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:16 2022] PUT /identity/v3/projects/262db36eddc7409dbbe189177c187207/users/91c81a4463e444bb9723181407e2a489/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:16.428416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.428951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.428951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.475841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] MFA Rules not processed for user `91c81a4463e444bb9723181407e2a489`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:16.477285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:16.528049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.530676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:16.585731 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3675/7385] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:16.586868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.607241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42ed8c-1f6b-430a-8522-c10459aabd16 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.625401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.626308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.626848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.627314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.628369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.630896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.698488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70cb9-69d6-48e0-b571-ca7c070aa383 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.710821 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3676/7386] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:16 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:16.712409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:16.825660 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:16.842099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.842980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.843807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.843807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] PATH_INFO: `/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.844718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ca65dfbd154e3cb9d5f2f3281a35ff)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.847595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.875320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae0b3-25da-40c1-b57f-644a4b5beaf3 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:16.894641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:16.895830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:16.896306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:16.900180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-1903790464` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:16.902102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=100725df59c34e6796890d6324a1bf55, value=tempest-tag-1903790464)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:16.904567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:16.928768 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:16.959891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ca65dfbd154e3cb9d5f2f3281a35ff', 'request_id': 'req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:16.968878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ca65dfbd154e3cb9d5f2f3281a35ff', 'request_id': 'req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:16.990258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ca65dfbd154e3cb9d5f2f3281a35ff', 'request_id': 'req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:17.014828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] The token cache is being invalidate because project 24ca65dfbd154e3cb9d5f2f3281a35ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:17.015123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:17.015853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:17.019783 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-72059589-3c2d-4281-9256-3dcbcd136121 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1903790464. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:43:17.019783 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:43:17.019783 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:17.033546 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3677/7388] 10.222.0.27 () {60 vars in 1332 bytes} [Sun Jul 24 01:43:16 2022] PUT /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-1903790464 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Jul 24 01:43:17.033873 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3711/7388] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:16 2022] DELETE /identity/v3/projects/24ca65dfbd154e3cb9d5f2f3281a35ff => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:17.035526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a716b-2a5e-42d0-8641-4175dcd7562f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.035905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a716b-2a5e-42d0-8641-4175dcd7562f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.036310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a716b-2a5e-42d0-8641-4175dcd7562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.036443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.039849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:17.064020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ea7a716b-2a5e-42d0-8641-4175dcd7562f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:17.066392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea7a716b-2a5e-42d0-8641-4175dcd7562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:17.158949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3678/7389] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:17.160503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0df1d-eb57-4dee-a8ec-e2cbce42a0be None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.160823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0df1d-eb57-4dee-a8ec-e2cbce42a0be None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.161098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0df1d-eb57-4dee-a8ec-e2cbce42a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.179596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f609a-d4e7-4b80-8e3e-614ebde3a7b9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.183739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b7c0df1d-eb57-4dee-a8ec-e2cbce42a0be None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:17.185378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b7c0df1d-eb57-4dee-a8ec-e2cbce42a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:17.196998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.198213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.198405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.198623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-1903790464` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.207509 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3679/7390] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:17.207509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.207509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.207509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.227071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=100725df59c34e6796890d6324a1bf55, value=tempest-tag-1903790464)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.228270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:17.229797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:17.230132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ad903-17cc-4c3c-9b78-5fab969803fd tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.263412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3712/7391] 10.222.0.27 () {58 vars in 1313 bytes} [Sun Jul 24 01:43:17 2022] GET /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-1903790464 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:17.263620 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3680/7392] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:17.263731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720130-389f-42cc-9576-ad96446af12b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.263731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720130-389f-42cc-9576-ad96446af12b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.263731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720130-389f-42cc-9576-ad96446af12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.264370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.282032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab862f-9544-4ed2-806b-88e834f588ff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.297274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.298093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.298588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.298918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.300898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=100725df59c34e6796890d6324a1bf55)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.308917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ef720130-389f-42cc-9576-ad96446af12b None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:17.309655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.310984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef720130-389f-42cc-9576-ad96446af12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:17.406204 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3681/7393] 10.222.0.27 () {60 vars in 1264 bytes} [Sun Jul 24 01:43:17 2022] PUT /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags => generated 142 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:17.407161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.409035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3713/7394] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:17.410306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720130-389f-42cc-9576-ad96446af12b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.424534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef720130-389f-42cc-9576-ad96446af12b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.432180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.433777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.434255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.434640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.434897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5de4-a6ba-4132-aa08-e9a6bed4922c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.444891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.444891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.445243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.445422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.446219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:17.446532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.450535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.457945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=100725df59c34e6796890d6324a1bf55)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.462729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.479507 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3682/7395] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:17.481945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.488769 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3714/7396] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:43:17 2022] GET /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags => generated 142 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:17.489926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.513253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564e577-056c-4ce4-8ec5-e297c93d2f2a tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.515580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15698b79-d404-4f16-8318-3ed3d8d1b31a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.520854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.522552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.522846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.523129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.533052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.535832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.537774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.538183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.539072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.543112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.588419 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3715/7397] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:17.589492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.606989 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:17.658827 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 24 01:43:17.660093 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:17.664135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3683/7398] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 188 bytes in 184 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:43:17.667699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.692300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aaed2-349e-4f65-bf09-d41c542ea74b tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.693840 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:17.828341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af44b07-cf4e-461e-ae1b-ce3108503765 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:17.857243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.858325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.858665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.859022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-2058155945` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.862958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=100725df59c34e6796890d6324a1bf55, value=tempest-tag-2058155945)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.865240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.867974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:17.868672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:17.869082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:17.869362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:17.872652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:17.881143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:17.956009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3684/7399] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:17.960230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:17.980301 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2058155945. To ensure interoperability, identifiers should be a valid uuid. Jul 24 01:43:17.980301 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 24 01:43:17.980301 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:18.000530 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3716/7400] 10.222.0.27 () {58 vars in 1316 bytes} [Sun Jul 24 01:43:17 2022] DELETE /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-2058155945 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:18.004575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.024752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00e7b-3f07-4679-8567-d9bcc9c497a8 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.038679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.039554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.039916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.040307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.041197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.043856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.070902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3717/7401] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:18.072110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.104548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db2d21-cc19-4576-b2b2-d59321b3ed53 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.135763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.137437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.137996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.138649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-2058155945` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.141377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d91bdc-cec7-456c-adcc-d2062c2d36ac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.146495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.147379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.147667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.147947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.155331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=100725df59c34e6796890d6324a1bf55, value=tempest-tag-2058155945)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.159541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:18.200673 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 24 01:43:18.201821 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:18.212188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3685/7402] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:17 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 188 bytes in 255 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:43:18.214430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Could not find project tag: tempest-tag-2058155945.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2058155945. Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 24 01:43:18.246327 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2058155945. Jul 24 01:43:18.247569 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:18.249984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450209ea-8253-48f6-b6e4-1b98c7fe14bf tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.272771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3718/7403] 10.222.0.27 () {58 vars in 1313 bytes} [Sun Jul 24 01:43:18 2022] GET /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags/tempest-tag-2058155945 => generated 107 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:18.274108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.286868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.288131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.293014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.295462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.296485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.300102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.312308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce86f1-07c1-4e9c-b575-bf0fa835a559 tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.340544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.342676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.344220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.344595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.349885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3686/7404] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:18.350860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.392666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9a270-57fc-4135-aeb3-f12f4dea38f4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.414485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.415680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.417259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.417658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.421823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=100725df59c34e6796890d6324a1bf55)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.430111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.487973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:18.516030 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3719/7405] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:18 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:18.517592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.543135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696431b-0a1b-486e-b56d-2bc23a301dc4 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.569938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3687/7406] 10.222.0.27 () {58 vars in 1247 bytes} [Sun Jul 24 01:43:18 2022] DELETE /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:18.575166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.578088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.578403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.578683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.578957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] PATH_INFO: `/v3/projects/a800b0aa03e644eda1e52e98377ff9ca/users/073bf7a344db4f9a81e2dfea49e83321/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.607579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffc0ae-9afb-4f2a-8567-e7b85b71d33d tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.626448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.627397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.627687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.627975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55/tags` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.644152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a800b0aa03e644eda1e52e98377ff9ca, user_id=073bf7a344db4f9a81e2dfea49e83321, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.647085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021b331-673b-4dfb-9985-57650b0ef74b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.671769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=100725df59c34e6796890d6324a1bf55)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.679262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:18.695247 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3688/7407] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:43:18 2022] GET /identity/v3/projects/100725df59c34e6796890d6324a1bf55/tags => generated 66 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 24 01:43:18.696924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3720/7408] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:18 2022] PUT /identity/v3/projects/a800b0aa03e644eda1e52e98377ff9ca/users/073bf7a344db4f9a81e2dfea49e83321/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:18.706262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:18.710704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.711002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.711282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.759197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c137e46-c235-48e4-a453-f05cd0d96e4c tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:18.791602 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:18.799535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] MFA Rules not processed for user `073bf7a344db4f9a81e2dfea49e83321`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:18.804016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:18.899676 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:18.911161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91c81a4463e444bb9723181407e2a489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '262db36eddc7409dbbe189177c187207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:18.912068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:18.912355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:18.912635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] PATH_INFO: `/v3/projects/100725df59c34e6796890d6324a1bf55` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:18.916845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorizing `identity:delete_project(project_id=100725df59c34e6796890d6324a1bf55)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:18.918771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.034457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100725df59c34e6796890d6324a1bf55', 'request_id': 'req-2ee82dea-761b-4d73-9e36-7abfffa7816f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.035557 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3721/7409] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:19.043286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:19.050441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100725df59c34e6796890d6324a1bf55', 'request_id': 'req-2ee82dea-761b-4d73-9e36-7abfffa7816f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.069980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100725df59c34e6796890d6324a1bf55', 'request_id': 'req-2ee82dea-761b-4d73-9e36-7abfffa7816f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.093973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] The token cache is being invalidate because project 100725df59c34e6796890d6324a1bf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:19.094254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.095286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.103908 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3689/7410] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:18 2022] DELETE /identity/v3/projects/100725df59c34e6796890d6324a1bf55 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:19.105114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:19.111312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.234813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266c60-072b-4e7c-b339-ec851b714eeb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:19.296876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee82dea-761b-4d73-9e36-7abfffa7816f tempest-IdentityV3ProjectTagsTest-1970383467 tempest-IdentityV3ProjectTagsTest-1970383467-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:19.307779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:19.308579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.308988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.309526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] PATH_INFO: `/v3/users/bd4a4b25579240a1895c6356522130ef` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.313178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4a4b25579240a1895c6356522130ef)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:19.316824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.343123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:19.344998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.348508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.348839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.350345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:19.356525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.448411 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3722/7411] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:19 2022] POST /identity/v3/projects => generated 379 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:19.453456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:19.456221 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:19.459574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.461316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4a4b25579240a1895c6356522130ef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.478756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4a4b25579240a1895c6356522130ef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.492290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4a4b25579240a1895c6356522130ef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.522028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4a4b25579240a1895c6356522130ef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.528460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4a4b25579240a1895c6356522130ef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:19.546941 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3690/7412] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:19 2022] DELETE /identity/v3/users/bd4a4b25579240a1895c6356522130ef => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:19.546941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:19.549987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.612763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93927a-b3d4-41a1-a4b4-dbfaf584693d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:19.654364 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:19.714252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3964d70-4a52-4f2c-9f78-eaceccb3163c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:19.721881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:19.723075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.723568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.724021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.724892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:19.727518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d90ca-968f-40ed-8537-37689f67df90 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.749387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:19.750556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.750857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.751306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.758702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.780477 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3691/7413] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:19 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:19.780477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c737-844d-4eb2-ba57-fcbaebaab64f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.780477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c737-844d-4eb2-ba57-fcbaebaab64f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.780477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c737-844d-4eb2-ba57-fcbaebaab64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.843664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b325c737-844d-4eb2-ba57-fcbaebaab64f None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:19.845760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b325c737-844d-4eb2-ba57-fcbaebaab64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.858854 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3692/7414] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:19 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:19.860494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.868652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.870300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.914314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:19.918175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:19.933964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:19.935872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def657e1-af93-4cf0-90aa-fa9b27ffb469 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.937621 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3693/7415] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:19.938770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:19.958261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3723/7416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:19.959785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.960082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.960367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.962889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf29d3a-7cad-4138-8220-7367149da4b0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:19.976926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:19.978039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:19.978542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:19.979019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:19.979972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:19.981708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:19.982374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:19.983193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:20.011045 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3694/7417] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:20.012239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.015025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:20.046328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183309-56ab-43ff-85dd-57c1357320fc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:20.059611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:20.060651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.061170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.061688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.095434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:20.097496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:20.129814 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3695/7419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:20.130022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3724/7419] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:20.132453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.132603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.162571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86374-0d63-4051-acad-e8babe24041d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:20.167796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28395-aa63-44c2-9334-63fa9652796b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:20.182814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ba7b-987f-4918-a526-8b1c54e4f200 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:20.184112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba7b-987f-4918-a526-8b1c54e4f200 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.184596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba7b-987f-4918-a526-8b1c54e4f200 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.185065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba7b-987f-4918-a526-8b1c54e4f200 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.190369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:20.198011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.198441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.198832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.199702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:20.205226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:20.233777 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3696/7420] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:20.238504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.257058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ecb43-6661-4173-bbf9-13d115e69959 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:20.274467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:20.275544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.275979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.276366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] PATH_INFO: `/v3/projects/53469bb165cc4749966ead0333d49716/users/02fa63399da441a38f13eaa7ca0d5625/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.286247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0ec7ba7b-987f-4918-a526-8b1c54e4f200 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:20.316236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3725/7421] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:20 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:20.320707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53469bb165cc4749966ead0333d49716, user_id=02fa63399da441a38f13eaa7ca0d5625, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:20.323668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:20.354782 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3697/7422] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:20 2022] PUT /identity/v3/projects/53469bb165cc4749966ead0333d49716/users/02fa63399da441a38f13eaa7ca0d5625/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:20.365665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.366327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.366618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.430552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] MFA Rules not processed for user `02fa63399da441a38f13eaa7ca0d5625`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:20.430552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:20.473970 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:20.615505 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3726/7423] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:20.616701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.712439 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:20.760204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d64e4-140b-4c0d-a0ec-65db0e2cd545 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:20.782327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:20.783644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:20.783927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:20.784202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:20.784914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:20.786887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:20.843519 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3698/7424] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:20 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:20.846419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:20.869766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374a531-0aaa-45ae-8317-b4c2fbb53788 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.010143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.011008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.011399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.011778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.012591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:21.014850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:21.048561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3727/7425] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:20 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:21.053836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.068756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecaed8-e362-4056-89de-de0df8b34153 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.080174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.080994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.081387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.081997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.085347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:21.089499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:21.118198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.118885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3699/7426] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:21.136933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a04fce-a81c-4166-bf84-ea1eafb73309 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.148968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.150588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.150981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.151380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] PATH_INFO: `/v3/projects/9aeff62072a3443ca068793451f551af/users/032bf2ecb4d048cd84e0e8b6b707d58e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.192400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeff62072a3443ca068793451f551af, user_id=032bf2ecb4d048cd84e0e8b6b707d58e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:21.195494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cf038-857a-437c-bd8d-6e32ccd16ad3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:21.222688 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3728/7427] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:21 2022] PUT /identity/v3/projects/9aeff62072a3443ca068793451f551af/users/032bf2ecb4d048cd84e0e8b6b707d58e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:21.227759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.243666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d742fb-8ea2-4454-8a28-9807b192c730 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.321434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30a719-0fdc-407d-8ca1-b03699c91065 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.321853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30a719-0fdc-407d-8ca1-b03699c91065 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.322202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30a719-0fdc-407d-8ca1-b03699c91065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.361308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ef30a719-0fdc-407d-8ca1-b03699c91065 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:21.370599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef30a719-0fdc-407d-8ca1-b03699c91065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:21.386969 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3729/7428] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:21 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:21.390750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2cca-d895-4cee-882a-2186a95399a8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.390750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2cca-d895-4cee-882a-2186a95399a8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.390750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd2cca-d895-4cee-882a-2186a95399a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.436908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-adcd2cca-d895-4cee-882a-2186a95399a8 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:21.439855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-adcd2cca-d895-4cee-882a-2186a95399a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:21.461067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.462224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.462224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.463736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.464578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:21.467463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:21.488394 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3700/7429] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:21.494054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.515746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71996d0-1fdf-49be-8b09-d27381d63ef5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.528720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.529820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.530212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.530596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] PATH_INFO: `/v3/projects/9aeff62072a3443ca068793451f551af/users/032bf2ecb4d048cd84e0e8b6b707d58e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.534998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeff62072a3443ca068793451f551af, user_id=032bf2ecb4d048cd84e0e8b6b707d58e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:21.537813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:21.578245 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3701/7430] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:21 2022] PUT /identity/v3/projects/9aeff62072a3443ca068793451f551af/users/032bf2ecb4d048cd84e0e8b6b707d58e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:21.578498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3730/7431] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:21.579280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.580457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.580817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.581160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.637153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] MFA Rules not processed for user `032bf2ecb4d048cd84e0e8b6b707d58e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:21.638549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:21.661794 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:21.707942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a99e4-789b-4007-aaa5-c8a529a1d224 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.727087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.727087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.727087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.727425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:21.794251 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3731/7432] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:21.805916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.808152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:21.820574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:21.840269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3702/7433] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:21 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:21.974204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdcfe0-ea79-45c6-b706-a5d84218f74e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:21.974355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:21.976903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:21.986302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:21.986983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:21.987268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:21.987548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.004942 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:22.011530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:22.013925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:22.039428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3732/7434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:43:22.102777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:22.104849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:22.124464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0efe16-6b95-40cc-be2e-7789cf50654d tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:22.137084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395179f2-b909-478e-8a59-947cd5e66a10 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:22.138984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:22.139371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:22.140205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:22.140205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] PATH_INFO: `/v3/projects/3f987b54f28347dba3bf27726ee9eaf1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.142318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f987b54f28347dba3bf27726ee9eaf1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:22.144358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:22.149295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:22.150505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:22.150789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:22.151165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.153551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:22.249297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f987b54f28347dba3bf27726ee9eaf1', 'request_id': 'req-3cd2ad32-4134-4931-a28b-44a8cf634a03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.256994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f987b54f28347dba3bf27726ee9eaf1', 'request_id': 'req-3cd2ad32-4134-4931-a28b-44a8cf634a03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.277460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f987b54f28347dba3bf27726ee9eaf1', 'request_id': 'req-3cd2ad32-4134-4931-a28b-44a8cf634a03'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.299790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] The token cache is being invalidate because project 3f987b54f28347dba3bf27726ee9eaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:22.300235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.302083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.303011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:22.304595 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3703/7435] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:21 2022] DELETE /identity/v3/projects/3f987b54f28347dba3bf27726ee9eaf1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:22.304741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631072c-9ff7-4765-9811-38aed5c835b1 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:22.308128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:22.309611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:22.341772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3733/7436] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:22.461279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2ad32-4134-4931-a28b-44a8cf634a03 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:22.480710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:22.481733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:22.482083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:22.482446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] PATH_INFO: `/v3/users/91c81a4463e444bb9723181407e2a489` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.483875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c81a4463e444bb9723181407e2a489)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:22.486495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:22.580702 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:22.585241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c81a4463e444bb9723181407e2a489'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.603154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c81a4463e444bb9723181407e2a489'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.617359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c81a4463e444bb9723181407e2a489'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.659246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c81a4463e444bb9723181407e2a489'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.660064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-609b5a55-7439-4fbf-b576-20caafd751ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c81a4463e444bb9723181407e2a489'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:22.680009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3704/7437] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:22 2022] DELETE /identity/v3/users/91c81a4463e444bb9723181407e2a489 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:22.844374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:22.844659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:22.846125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.885362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:22.886667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:22.902727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3734/7438] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:22 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:22.908390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:22.909710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:22.910373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:22.950732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:22.952148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:23.168424 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3705/7439] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:23.172885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:23.191785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4ce2b-6835-4e22-b97f-ecca2a322fe7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:23.203965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabe348-094e-4fb0-9e27-2e1049871d89 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:23.206856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe348-094e-4fb0-9e27-2e1049871d89 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:23.210179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe348-094e-4fb0-9e27-2e1049871d89 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:23.210656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabe348-094e-4fb0-9e27-2e1049871d89 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:23.324756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-baabe348-094e-4fb0-9e27-2e1049871d89 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.341574 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3735/7440] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:23 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:23.470910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:23.472604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:23.593017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6885-0618-411a-8991-5fb565dbf817 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:23.598681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:23.599793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:23.600260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:23.600720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] PATH_INFO: `/v3/projects/262db36eddc7409dbbe189177c187207` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:23.602161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=262db36eddc7409dbbe189177c187207)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:23.604430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:23.682532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262db36eddc7409dbbe189177c187207', 'request_id': 'req-6ab9de26-ab9c-4a98-a847-5822075bbe4b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.696066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262db36eddc7409dbbe189177c187207', 'request_id': 'req-6ab9de26-ab9c-4a98-a847-5822075bbe4b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.703121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262db36eddc7409dbbe189177c187207', 'request_id': 'req-6ab9de26-ab9c-4a98-a847-5822075bbe4b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.739784 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:23.748563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] The token cache is being invalidate because project 262db36eddc7409dbbe189177c187207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:23.749569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.750880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ab9de26-ab9c-4a98-a847-5822075bbe4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:23.755832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3706/7441] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:23 2022] DELETE /identity/v3/projects/262db36eddc7409dbbe189177c187207 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:23.760633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:23.761237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:23.761995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:23.773307 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:23.800275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:23.802042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:23.910068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3736/7442] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:23.911867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:23.912335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:23.912437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:23.936591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:23.938353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:23.955144 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3707/7443] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:23.956684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:23.974830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8590-7441-47b1-8be2-97c6704ac53a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:23.982098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:23.985204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:23.986626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:23.987285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:23.988132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:23.988618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:23.990658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.013246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:24.024891 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3737/7444] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:24.025112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8c87-e4e8-4c38-81b5-941760e5fb36 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:24.031330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:24.032016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.032374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.032852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.033565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:24.035512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.088605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:24.091325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3708/7445] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:24 2022] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:24.115788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33badb-2165-4c98-b3b9-669459409ee5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:24.219328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:24.222027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.223224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.223688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.224922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:24.227469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42088-f42e-4f0a-a4ec-a23d27c32814 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.317835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3738/7446] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:24 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:24.320183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:24.338556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84c01-f988-496a-8b64-fb5ff11a23a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:24.347709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.348358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.348835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.355244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:24.356700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.357158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.357601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.358536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:24.360673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.379949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3709/7447] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:24.381421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:24.402119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:24.403898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:24.427022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3739/7448] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:24 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 01:43:24.476752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72382fb8-7a66-42df-ae6c-587ac44779e7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:24.492843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:24.494380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.495297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.495748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.497952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:24.500764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515927b8-05d6-4099-92d5-c662b5a7c9b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.528271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3710/7449] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:24.533106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:24.566163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264e9a-c72b-4f95-ab4c-6ab849f1f65f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:24.594562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:24.596197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.596658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.597139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] PATH_INFO: `/v3/projects/094ceb79abef4ea1af89c43f91bef902/users/b6bd6330da444614aa5bc7a1bcbbab9c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.640676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=094ceb79abef4ea1af89c43f91bef902, user_id=b6bd6330da444614aa5bc7a1bcbbab9c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:24.645285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:24.715352 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3740/7450] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:24 2022] PUT /identity/v3/projects/094ceb79abef4ea1af89c43f91bef902/users/b6bd6330da444614aa5bc7a1bcbbab9c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:24.727274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:24.727977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:24.728451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:24.795563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] MFA Rules not processed for user `b6bd6330da444614aa5bc7a1bcbbab9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:24.797035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:25.018388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3711/7451] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:25.020080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:25.160574 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:25.189616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fa74-aebe-485b-a7b0-ad297356c23f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:25.202383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:25.203972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.206027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.206313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.210369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:25.214069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d16f4-1efc-47a7-b8ea-9e3d33643b56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:25.279486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:25.284732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3741/7452] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/projects => generated 395 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:25.330235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d216b-3c8c-49a7-8051-80a5201702be None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:25.432806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff9d6-0a86-400e-80b3-e4b1718db6da None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.433130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff9d6-0a86-400e-80b3-e4b1718db6da None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.433507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ff9d6-0a86-400e-80b3-e4b1718db6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.468864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3a2ff9d6-0a86-400e-80b3-e4b1718db6da None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:25.470571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a2ff9d6-0a86-400e-80b3-e4b1718db6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:25.558434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:25.564795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.565148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.567102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.568531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:25.571005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:25.622985 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3742/7453] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:25.635096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04369-4b18-4333-92d5-ef2f65d66252 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.636597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04369-4b18-4333-92d5-ef2f65d66252 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.640622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04369-4b18-4333-92d5-ef2f65d66252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.642768 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3712/7454] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/users => generated 304 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:25.648094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:25.679919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46e1d-2679-45f2-87e6-70e4e35eec1b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:25.691793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:25.692711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.693180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.693644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.694930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:25.710018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:25.711151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-72a04369-4b18-4333-92d5-ef2f65d66252 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:25.715401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-72a04369-4b18-4333-92d5-ef2f65d66252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:25.731456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3743/7455] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:25.735216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794587-48c3-4a22-a28d-e6c0b4876781 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.736066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794587-48c3-4a22-a28d-e6c0b4876781 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.736383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794587-48c3-4a22-a28d-e6c0b4876781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.748299 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3713/7456] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:25.749869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:25.767485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e85fb-396a-432f-bc62-1e725f1d3a46 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:25.804143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086b723-e572-407a-9608-564c53696185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:25.805492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b723-e572-407a-9608-564c53696185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.807103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b723-e572-407a-9608-564c53696185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.807665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086b723-e572-407a-9608-564c53696185 admin admin] PATH_INFO: `/v3/projects/89e619b9d4cf4aed904b7e274001bbee/users/91b827f57c334dcd8b327b6db92b37a4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.842324 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:25.853160 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.server.flask.application [None req-36794587-48c3-4a22-a28d-e6c0b4876781 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:43:25.855142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3744/7457] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 121 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 24 01:43:25.861114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1962-a718-4643-9eaf-249f9ec7e556 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.861114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1962-a718-4643-9eaf-249f9ec7e556 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.861114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1962-a718-4643-9eaf-249f9ec7e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:25.861653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086b723-e572-407a-9608-564c53696185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e619b9d4cf4aed904b7e274001bbee, user_id=91b827f57c334dcd8b327b6db92b37a4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:25.868005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086b723-e572-407a-9608-564c53696185 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:25.908763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3714/7458] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:25 2022] PUT /identity/v3/projects/89e619b9d4cf4aed904b7e274001bbee/users/91b827f57c334dcd8b327b6db92b37a4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:25.913227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086b723-e572-407a-9608-564c53696185 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:25.935914 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.server.flask.application [None req-ed6b1962-a718-4643-9eaf-249f9ec7e556 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:43:25.943918 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3745/7459] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 82 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Jul 24 01:43:25.945800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:25.946109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:25.946559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.004734 n-d-master-1 devstack@keystone.service[80590]: WARNING keystone.server.flask.application [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:43:26.005861 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3746/7460] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:25 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 64 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 24 01:43:26.105170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086b723-e572-407a-9608-564c53696185 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.114472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.116410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.116934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.117593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.118753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.121388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f9d87-9a37-4666-8f15-1e6779a6f0b8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.142503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3715/7461] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:26.146256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.187811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a02d7-b189-4a89-9bc8-f56082a19ce9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.202586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.203513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.203797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.204112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] PATH_INFO: `/v3/projects/89e619b9d4cf4aed904b7e274001bbee/users/91b827f57c334dcd8b327b6db92b37a4/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.206732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e619b9d4cf4aed904b7e274001bbee, user_id=91b827f57c334dcd8b327b6db92b37a4, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.209404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.260989 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3747/7462] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:26 2022] PUT /identity/v3/projects/89e619b9d4cf4aed904b7e274001bbee/users/91b827f57c334dcd8b327b6db92b37a4/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:26.261149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.261149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.261149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.318236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] MFA Rules not processed for user `91b827f57c334dcd8b327b6db92b37a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:26.319473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:26.518085 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3716/7463] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:26.522767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.541251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.543168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:26.600013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4e8c-5a9f-41cb-8586-61f5cb35cd4d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.604942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6bd6330da444614aa5bc7a1bcbbab9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094ceb79abef4ea1af89c43f91bef902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.606193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.606659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.607117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.608182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 24 01:43:26.622205 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 24 01:43:26.623590 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.625815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3748/7464] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:43:26 2022] POST /identity/v3/projects => generated 136 bytes in 104 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:26.633066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.662853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4fa8a-23ef-44ab-bf98-34371f712cc0 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.682999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.684700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.685066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ecb6-4ba3-43b5-b2f2-958af409a1ab None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.686329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.686785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.689490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.693386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.698753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.699545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.699943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.700331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.708518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invalid input for field 'name': '' is too short Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: '' Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise error Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application '' Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.716839 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:43:26.718891 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application '' Jul 24 01:43:26.721151 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.724777 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3749/7465] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:43:26 2022] POST /identity/v3/projects => generated 283 bytes in 92 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 24 01:43:26.730702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.743322 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:26.757967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d4f7d-ac6a-4df5-bf36-b8ba7d8436f3 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.771765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.775725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.776267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.776766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.777705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.779784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: On instance['name']: Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise error Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:43:26.804110 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:26.805526 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application On instance['name']: Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 24 01:43:26.806781 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.807652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.807652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.810175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3750/7466] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:43:26 2022] POST /identity/v3/projects => generated 412 bytes in 80 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 24 01:43:26.814986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.823189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3717/7467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:26.828202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8ece-9343-4614-84a6-f4bb6edd43bb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.835064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.835769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.836126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.836474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects/dc4512b0a11440f0ab8f6f654f336146` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.839715 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:26.847206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc4512b0a11440f0ab8f6f654f336146)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.849720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Could not find project: dc4512b0a11440f0ab8f6f654f336146.: keystone.exception.ProjectNotFound: Could not find project: dc4512b0a11440f0ab8f6f654f336146. Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 24 01:43:26.891000 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dc4512b0a11440f0ab8f6f654f336146. Jul 24 01:43:26.892973 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:26.897387 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3751/7468] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:26 2022] DELETE /identity/v3/projects/dc4512b0a11440f0ab8f6f654f336146 => generated 113 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:26.902595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.917022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4302ca5-aeef-4eda-96c0-704573eeb6b6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.922007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6bd6330da444614aa5bc7a1bcbbab9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '094ceb79abef4ea1af89c43f91bef902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.923482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.923808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.924154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.925467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 24 01:43:26.935711 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._list_projects() Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 24 01:43:26.937163 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:26.939976 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3718/7469] 10.222.0.27 () {58 vars in 1130 bytes} [Sun Jul 24 01:43:26 2022] GET /identity/v3/projects => generated 135 bytes in 38 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:26.945181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:26.961287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934d97-2c45-4c47-b98e-099e4d7a24b4 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:26.968598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:26.969216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:26.969520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:26.970583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:26.971311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:26.973267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:27.028382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3752/7470] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:26 2022] POST /identity/v3/projects => generated 359 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:27.030671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:27.062611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc83e7-f295-49df-a8a2-63eca75d9166 tempest-ProjectsNegativeStaticTestJSON-869542611 tempest-ProjectsNegativeStaticTestJSON-869542611-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:27.237281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:27.238096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:27.238458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:27.238846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:27.239825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:27.242013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:27.270495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.sql.core [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1439691353' for key 'project.ixu_project_name_domain_id'") Jul 24 01:43:27.270495 n-d-master-1 devstack@keystone.service[80591]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 01:43:27.270495 n-d-master-1 devstack@keystone.service[80591]: [parameters: {'id': '6063dd972cdf46269a24d0016405e2b2', 'name': 'tempest-project-dup-1439691353', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 01:43:27.270495 n-d-master-1 devstack@keystone.service[80591]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80591) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1439691353, project id 6063dd972cdf46269a24d0016405e2b2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1439691353, project id 6063dd972cdf46269a24d0016405e2b2. Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:43:27.285125 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1439691353' for key 'project.ixu_project_name_domain_id'") Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 01:43:27.286357 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application yield resource Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application next(self.gen) Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise self.value Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 01:43:27.287729 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application session.commit() Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.session.flush() Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application compat.raise_( Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 01:43:27.289176 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 01:43:27.290680 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application conn.query(q) Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application result.read() Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 01:43:27.292004 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1439691353' for key 'project.ixu_project_name_domain_id'") Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [parameters: {'id': '6063dd972cdf46269a24d0016405e2b2', 'name': 'tempest-project-dup-1439691353', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:27.293390 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1439691353 at domain ID default. Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:27.294664 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1439691353, project id 6063dd972cdf46269a24d0016405e2b2. Jul 24 01:43:27.295890 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:27.300405 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3719/7471] 10.222.0.27 () {60 vars in 1151 bytes} [Sun Jul 24 01:43:27 2022] POST /identity/v3/projects => generated 285 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:43:27.302373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:27.315201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc349f-2325-4757-acd8-b7384cbe47eb tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:27.320279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b827f57c334dcd8b327b6db92b37a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e619b9d4cf4aed904b7e274001bbee', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:27.321197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:27.321483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:27.321799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] PATH_INFO: `/v3/projects/5f45b166ec074c7394b71c468144859f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:27.322992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f45b166ec074c7394b71c468144859f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:27.325631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:27.490807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f45b166ec074c7394b71c468144859f', 'request_id': 'req-13629d10-3421-4339-9a22-e88f80357e7a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:27.498995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f45b166ec074c7394b71c468144859f', 'request_id': 'req-13629d10-3421-4339-9a22-e88f80357e7a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:27.519578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f45b166ec074c7394b71c468144859f', 'request_id': 'req-13629d10-3421-4339-9a22-e88f80357e7a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:27.554970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] The token cache is being invalidate because project 5f45b166ec074c7394b71c468144859f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:27.555671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:27.578313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-13629d10-3421-4339-9a22-e88f80357e7a tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:27.584450 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3753/7472] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:27 2022] DELETE /identity/v3/projects/5f45b166ec074c7394b71c468144859f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:27.585651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:27.587817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:27.780831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616af4e-f4f2-4587-9abf-a6df1d72b295 tempest-ProjectsNegativeStaticTestJSON-887941040 tempest-ProjectsNegativeStaticTestJSON-887941040-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:27.908846 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:27.943016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:27.947124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:27.948079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:27.948848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] PATH_INFO: `/v3/users/b6bd6330da444614aa5bc7a1bcbbab9c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:27.950342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bd6330da444614aa5bc7a1bcbbab9c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:27.955376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:28.110624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bd6330da444614aa5bc7a1bcbbab9c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:28.127301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bd6330da444614aa5bc7a1bcbbab9c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:28.143930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bd6330da444614aa5bc7a1bcbbab9c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:28.174528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bd6330da444614aa5bc7a1bcbbab9c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:28.175863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bd6330da444614aa5bc7a1bcbbab9c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:28.195268 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3720/7473] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:27 2022] DELETE /identity/v3/users/b6bd6330da444614aa5bc7a1bcbbab9c => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:28.205877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:28.207064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:28.207064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:28.276350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:28.278184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:28.441119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3754/7474] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:28.458128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:28.461666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:28.610046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9c02-3c11-40e2-bc00-9e78fb8d3e99 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:28.621375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:28.622764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:28.623051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:28.623329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:28.636545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:28.638050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:28.650809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3721/7475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:29.162609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:29.164194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:29.187305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b7853-e19f-468c-9747-2b1a302c4199 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:29.199624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:29.201502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:29.202047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:29.202559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] PATH_INFO: `/v3/projects/094ceb79abef4ea1af89c43f91bef902` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:29.205427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=094ceb79abef4ea1af89c43f91bef902)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:29.230126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:29.342981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094ceb79abef4ea1af89c43f91bef902', 'request_id': 'req-be304d9d-d768-413b-9179-cd751054a1da'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.346190 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:29.354770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094ceb79abef4ea1af89c43f91bef902', 'request_id': 'req-be304d9d-d768-413b-9179-cd751054a1da'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.368546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094ceb79abef4ea1af89c43f91bef902', 'request_id': 'req-be304d9d-d768-413b-9179-cd751054a1da'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.386103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] The token cache is being invalidate because project 094ceb79abef4ea1af89c43f91bef902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:29.386845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.387909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.390812 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3755/7476] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:29 2022] DELETE /identity/v3/projects/094ceb79abef4ea1af89c43f91bef902 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:29.395960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:29.415777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cd2fd-1783-49f1-bf0f-2bb22d357e06 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:29.458317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:29.460112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:29.569639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:29.570124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:29.570297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:29.570573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] PATH_INFO: `/v3/users/91b827f57c334dcd8b327b6db92b37a4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:29.573295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b827f57c334dcd8b327b6db92b37a4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:29.575710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:29.600719 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:29.603260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304d9d-d768-413b-9179-cd751054a1da admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:29.615885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:29.618838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:29.619346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:29.621789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] PATH_INFO: `/v3/users/073bf7a344db4f9a81e2dfea49e83321` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:29.627041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073bf7a344db4f9a81e2dfea49e83321)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:29.629648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:29.672132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b827f57c334dcd8b327b6db92b37a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.684933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b827f57c334dcd8b327b6db92b37a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.706865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b827f57c334dcd8b327b6db92b37a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.748553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073bf7a344db4f9a81e2dfea49e83321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.749714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073bf7a344db4f9a81e2dfea49e83321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.773822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b827f57c334dcd8b327b6db92b37a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.774913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073bf7a344db4f9a81e2dfea49e83321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.775426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e0bbeaf2-dcfe-4f34-9e2e-bd19f93b97d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b827f57c334dcd8b327b6db92b37a4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.786334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073bf7a344db4f9a81e2dfea49e83321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.805544 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3722/7477] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:29 2022] DELETE /identity/v3/users/91b827f57c334dcd8b327b6db92b37a4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:29.827705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073bf7a344db4f9a81e2dfea49e83321'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:29.850246 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3756/7478] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:29 2022] DELETE /identity/v3/users/073bf7a344db4f9a81e2dfea49e83321 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:29.852182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:29.852810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:29.853301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:29.891470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:29.895809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:30.079826 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3723/7479] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:30.105900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:30.107667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:30.289631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cb0d-d5cd-4624-a97e-8ce950a9b201 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:30.303353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:30.304454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:30.304947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:30.305402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:30.333260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:30.335219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:30.374016 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3757/7480] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:30.388571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:30.390458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:30.424424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dde9c-7b8c-4fd3-81b4-d0aa89e614b3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:30.436805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:30.438190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:30.438837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:30.439467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] PATH_INFO: `/v3/projects/89e619b9d4cf4aed904b7e274001bbee` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:30.442953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e619b9d4cf4aed904b7e274001bbee)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:30.450682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:30.504118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:30.506068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:30.512732 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:30.706232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e619b9d4cf4aed904b7e274001bbee', 'request_id': 'req-408bfbd8-5d27-4272-ba06-7bf64d86c76a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:30.719275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e619b9d4cf4aed904b7e274001bbee', 'request_id': 'req-408bfbd8-5d27-4272-ba06-7bf64d86c76a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:30.758154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc960-d0ea-4656-b78d-ccc574cd2940 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:30.778411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e619b9d4cf4aed904b7e274001bbee', 'request_id': 'req-408bfbd8-5d27-4272-ba06-7bf64d86c76a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:30.806221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] The token cache is being invalidate because project 89e619b9d4cf4aed904b7e274001bbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:30.806531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:30.808500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-408bfbd8-5d27-4272-ba06-7bf64d86c76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:30.821369 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3724/7481] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:30 2022] DELETE /identity/v3/projects/89e619b9d4cf4aed904b7e274001bbee => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:30.827638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918b9c-4641-4f12-b926-62a567c67410 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:30.828001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918b9c-4641-4f12-b926-62a567c67410 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:30.828297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7918b9c-4641-4f12-b926-62a567c67410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:30.856256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f7918b9c-4641-4f12-b926-62a567c67410 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:30.858685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f7918b9c-4641-4f12-b926-62a567c67410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:30.876622 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:30.997437 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3725/7482] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:31.006162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.006430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.008380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.014690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.015664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.015664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.016012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.018385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:31.068483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:31.069765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:31.107873 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3726/7483] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:31.108753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.110881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:31.172384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f18d6-4a3c-47b4-9c16-84086dd7e097 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.174925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.176562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.193805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.194692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.194978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.195253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] PATH_INFO: `/v3/projects/a800b0aa03e644eda1e52e98377ff9ca` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.203573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a800b0aa03e644eda1e52e98377ff9ca)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.205763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.218048 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3758/7484] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:43:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:31.222628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.462797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c735a1-937a-4ed5-a166-5a9f69303f90 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.462797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.462797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.462797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.471151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.471151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:31.471151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.471151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.471151 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3759/7485] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:31.471889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a800b0aa03e644eda1e52e98377ff9ca', 'request_id': 'req-d4e49561-6391-4fb4-9c83-88f0da484557'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:31.472102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.472320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a800b0aa03e644eda1e52e98377ff9ca', 'request_id': 'req-d4e49561-6391-4fb4-9c83-88f0da484557'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:31.472543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3a2a-d0d1-4ae2-89de-54bd2bdd4d8b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.472770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a800b0aa03e644eda1e52e98377ff9ca', 'request_id': 'req-d4e49561-6391-4fb4-9c83-88f0da484557'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:31.510457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] The token cache is being invalidate because project a800b0aa03e644eda1e52e98377ff9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:31.510860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:31.513160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:31.523815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3727/7486] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:31 2022] DELETE /identity/v3/projects/a800b0aa03e644eda1e52e98377ff9ca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:31.528151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.529486 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:31.531398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:31.597222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.598083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.598477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.598863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.599668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.601861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.706445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3760/7487] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:31 2022] POST /identity/v3/projects => generated 367 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:31.707506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.709723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:31.710238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e49561-6391-4fb4-9c83-88f0da484557 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.794046 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:31.826392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029b10-3371-4cd1-994e-ff888689805a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.836008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.836718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.837004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.837285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.838030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.841892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.843174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.844235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.845839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.846133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] PATH_INFO: `/v3/users/02fa63399da441a38f13eaa7ca0d5625` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.848281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fa63399da441a38f13eaa7ca0d5625)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.852087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:31.905366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3761/7488] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:31 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:31.906561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:31.959466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ed38f-d70f-47b1-8dde-f815d763e4b1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:31.967744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:31.977836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:31.980868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:31.981166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:31.996568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:31.998275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:32.027227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fa63399da441a38f13eaa7ca0d5625'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:32.042897 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3762/7489] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:32.044163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fa63399da441a38f13eaa7ca0d5625'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:32.046347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:32.068231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fa63399da441a38f13eaa7ca0d5625'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:32.083116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876a5c-070f-4b90-967c-6ad378446f3f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:32.097196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:32.099089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:32.099387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:32.099671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:32.100430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:32.105184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fa63399da441a38f13eaa7ca0d5625'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:32.107273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426c4b-99df-4efd-a78b-8ce0af07221a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:32.108317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fa63399da441a38f13eaa7ca0d5625'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:32.127763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3728/7490] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:31 2022] DELETE /identity/v3/users/02fa63399da441a38f13eaa7ca0d5625 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:32.149966 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3763/7491] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:32.151170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:32.152624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:32.325713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd0f0-52e4-4222-ae30-deafa227efe4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:32.332408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:32.333649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:32.334155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:32.334783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] PATH_INFO: `/v3/projects/11288988e5e04a63a792695353e17b31/users/223a8d5510844f6a8f5a5be83cca55b8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:32.355948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11288988e5e04a63a792695353e17b31, user_id=223a8d5510844f6a8f5a5be83cca55b8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:32.361511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:32.389713 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3729/7492] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:32 2022] PUT /identity/v3/projects/11288988e5e04a63a792695353e17b31/users/223a8d5510844f6a8f5a5be83cca55b8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:32.404402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:32.404402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:32.404402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:32.492061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] MFA Rules not processed for user `223a8d5510844f6a8f5a5be83cca55b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:32.493515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:32.697624 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3764/7493] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:32.704351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:32.762896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:32.764677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:32.803085 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:32.840905 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:32.925710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6415929-cb06-4203-bfed-56d8e2e7b561 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:32.934463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8e2f8-a137-42ab-bf3b-2725d09bf6e7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:32.940008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:32.940969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:32.941441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:32.941866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] PATH_INFO: `/v3/projects/53469bb165cc4749966ead0333d49716` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:32.943159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53469bb165cc4749966ead0333d49716)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:32.945296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:32.945626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:32.946517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:32.947004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:32.947812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:32.949626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:32.951752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.017384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53469bb165cc4749966ead0333d49716', 'request_id': 'req-26edbf73-67bc-410c-9f67-314a9b0e4311'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.026542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53469bb165cc4749966ead0333d49716', 'request_id': 'req-26edbf73-67bc-410c-9f67-314a9b0e4311'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.037480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53469bb165cc4749966ead0333d49716', 'request_id': 'req-26edbf73-67bc-410c-9f67-314a9b0e4311'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.040289 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3730/7494] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:32 2022] POST /identity/v3/projects => generated 367 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:33.044194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.055553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] The token cache is being invalidate because project 53469bb165cc4749966ead0333d49716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:33.055915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.056609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.062771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3765/7495] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:32 2022] DELETE /identity/v3/projects/53469bb165cc4749966ead0333d49716 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:33.065493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.067503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:33.207060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbf73-67bc-410c-9f67-314a9b0e4311 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.211135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71abd1-a33d-40c6-804a-9308d9a7f623 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.217902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.219124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.220495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.221036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.223195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.227359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.228039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.229512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.229902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.231098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] PATH_INFO: `/v3/users/032bf2ecb4d048cd84e0e8b6b707d58e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.232643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032bf2ecb4d048cd84e0e8b6b707d58e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.236176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.278511 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3731/7496] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:33 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:33.283167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.288289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:33.309579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eead3e-6ceb-49fe-8111-9fdb5675503a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.313074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032bf2ecb4d048cd84e0e8b6b707d58e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.314790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032bf2ecb4d048cd84e0e8b6b707d58e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.316945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.318138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.318516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.318968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.319803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.320413 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:33.323847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.339647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032bf2ecb4d048cd84e0e8b6b707d58e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.347836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032bf2ecb4d048cd84e0e8b6b707d58e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.351849 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3732/7497] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:33.356969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.359053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:33.370806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032bf2ecb4d048cd84e0e8b6b707d58e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:33.378863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c8b1-5c78-4483-8a4e-b6f1a0b2d8f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.380698 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3766/7498] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:33 2022] DELETE /identity/v3/users/032bf2ecb4d048cd84e0e8b6b707d58e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:33.475737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.476654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.476938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.477213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] PATH_INFO: `/v3/projects/43063a0934f647ac8fb5a495b83462ea/users/6260cefc34e84e16b83f93d940f3f390/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.511553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=43063a0934f647ac8fb5a495b83462ea, user_id=6260cefc34e84e16b83f93d940f3f390, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.520138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.544687 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3733/7499] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:33 2022] PUT /identity/v3/projects/43063a0934f647ac8fb5a495b83462ea/users/6260cefc34e84e16b83f93d940f3f390/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:33.548717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.568651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2fef8-9c5a-495b-b008-a6b680f36342 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.738929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.739865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.740226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.741331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.741483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.743211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.771991 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3767/7500] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:33.772976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.788720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2d3d-6832-4b90-81b4-c797b21bfbcf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.804471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:33.805454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.805921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.806204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] PATH_INFO: `/v3/projects/43063a0934f647ac8fb5a495b83462ea/users/6260cefc34e84e16b83f93d940f3f390/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.808865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43063a0934f647ac8fb5a495b83462ea, user_id=6260cefc34e84e16b83f93d940f3f390, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:33.812739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb2434-b19f-4c37-bee9-daa9fc26fcb0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:33.831177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:33.833440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:33.850256 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3734/7501] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:33 2022] PUT /identity/v3/projects/43063a0934f647ac8fb5a495b83462ea/users/6260cefc34e84e16b83f93d940f3f390/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:33.869516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:33.869910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:33.870123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:33.874484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefb361-a3f9-43cd-a5a1-83acc5e3c472 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:33.893910 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:33.909500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] MFA Rules not processed for user `6260cefc34e84e16b83f93d940f3f390`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:33.910806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:34.055079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.056027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.056243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.056530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] PATH_INFO: `/v3/projects/9aeff62072a3443ca068793451f551af` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.058981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aeff62072a3443ca068793451f551af)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.062276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.065004 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3735/7502] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:34.069660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.103189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc0f0-16a9-4b4a-b678-02e7d054b42a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.135273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aeff62072a3443ca068793451f551af', 'request_id': 'req-47729f88-2f9a-4efe-9874-a347e150bca2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:34.143110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aeff62072a3443ca068793451f551af', 'request_id': 'req-47729f88-2f9a-4efe-9874-a347e150bca2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:34.146495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.147324 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:34.147898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.148194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.148556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.149333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.151281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.155413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aeff62072a3443ca068793451f551af', 'request_id': 'req-47729f88-2f9a-4efe-9874-a347e150bca2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:34.177928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] The token cache is being invalidate because project 9aeff62072a3443ca068793451f551af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:34.178520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:34.179195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47729f88-2f9a-4efe-9874-a347e150bca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:34.194184 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3768/7503] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:33 2022] DELETE /identity/v3/projects/9aeff62072a3443ca068793451f551af => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:34.201038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af051ce-e22b-42a5-827d-085baa6e88c1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.201038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af051ce-e22b-42a5-827d-085baa6e88c1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.201038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af051ce-e22b-42a5-827d-085baa6e88c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.203018 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3736/7504] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/roles => generated 235 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:34.204407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.226379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:34.240145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3af051ce-e22b-42a5-827d-085baa6e88c1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:34.243511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3af051ce-e22b-42a5-827d-085baa6e88c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:34.251869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac66a1f-c2e1-4657-b4dc-1c92cefee8e4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.322179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.322983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.323199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.323482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.324509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.327164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.355746 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3737/7505] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/roles => generated 235 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:34.358600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.389704 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3769/7506] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:34.389837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530c055-f20e-4267-a9d4-ef78ce4564ca tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.394934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.400446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.400446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.400446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.400446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.400446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.404552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.408003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.409502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.427691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3738/7507] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/roles => generated 235 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:34.431548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.449802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35705d9a-1ceb-4034-bc3e-82d1a7197ced tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.450029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:34.451206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:34.466076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.466780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.467091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.467349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.468102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.470461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.472067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3770/7508] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:34.473315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.487504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d4c42-4ed6-44a9-94d7-3150d55fe0fd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.494214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.494998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.495291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.495629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.497037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:34.497353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.499542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.521472 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3739/7509] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/domains => generated 275 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:34.522523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.523138 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3771/7510] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:34.527580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.541321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-9d3c-40c3-8a9a-2a721b4b619c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.602384 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:34.630969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826710-fc35-48d6-9e9f-1afe585ab2e2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.646755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.648148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.648148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.648467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.649284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.667615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.707900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.708730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.709028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.709412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.710125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.712220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.723339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3740/7511] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/projects => generated 400 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:34.729151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.765473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3772/7512] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:34.769857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.850139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7359-2185-469d-99b1-8f1de7fec638 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.891146 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:34.896392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64a5da-4489-4d51-8f37-11022621ab4e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.929248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.931268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.934175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.934711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.935678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.938823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:34.971607 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3773/7513] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:34.974267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:34.986720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009c9e9-6b85-4052-8509-d615ce89a0a3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:34.992073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:34.992904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:34.993292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:34.993713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:34.994570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:34.996366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.019965 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3774/7514] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:34 2022] GET /identity/v3/roles => generated 2098 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:35.024639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.030496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.031189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.031490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.031770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/groups` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.033056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.040565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.048722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94482a-5668-4b49-8948-0c98cb7b73d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.068985 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3741/7515] 10.222.0.27 () {60 vars in 1146 bytes} [Sun Jul 24 01:43:34 2022] POST /identity/v3/groups => generated 300 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:35.071452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.073084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.073362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.076300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.078048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.079214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.083129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.101568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3775/7516] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:35 2022] GET /identity/v3/roles => generated 2098 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:35.104809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fbd45-2112-48bc-9e7f-d1dd83bdff71 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.109620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.122116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.122788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.122923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.123149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.123861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.125483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.131481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb76fa-797b-4665-804f-ea58cdeec047 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.138635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.139584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.139878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.140210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] PATH_INFO: `/v3/projects/100fdf80931a43bf87a0e8aa934dfef3/users/e35dff0e8793481a907ef2d6b1e31e0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.171729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3742/7517] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/roles => generated 234 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:35.176621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.177433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=100fdf80931a43bf87a0e8aa934dfef3, user_id=e35dff0e8793481a907ef2d6b1e31e0e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.180137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d055-d404-4b10-8b08-0ee04ec9aa4a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.198990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428b5ec-6a92-4bff-a4d2-f2d8587948e3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.208502 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3776/7518] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:35 2022] PUT /identity/v3/projects/100fdf80931a43bf87a0e8aa934dfef3/users/e35dff0e8793481a907ef2d6b1e31e0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:35.221760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.222084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.222338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.294715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] MFA Rules not processed for user `e35dff0e8793481a907ef2d6b1e31e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:35.295982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:35.345520 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:35.362409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.363569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.363569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.363987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.364403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.367632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.436650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3743/7519] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/users => generated 442 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:35.438966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.462042 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3777/7520] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:35.462360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50116a-0db8-448f-8a08-58bcb5572e49 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.466216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.474571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.475725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.475725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.475985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.476564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.477610 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:35.477610 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:35.477610 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:35.478538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.505717 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3744/7521] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/roles => generated 269 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:35.510736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.539198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7642526-6679-4393-aa43-f1fa15faea7d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.558853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.559788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.560083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.560368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/49f4d23f7a284daa8d50a986600a3d57` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.585409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=49f4d23f7a284daa8d50a986600a3d57)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.590373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.618113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030d59f-3eef-4c18-915e-dc78207d17c2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.625423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3745/7522] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:35 2022] PUT /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/49f4d23f7a284daa8d50a986600a3d57 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:35.643415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.661704 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:35.718108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.718935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.722234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.722658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.723498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.725773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.748467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44fdb2-ce36-4aa9-af8d-d5de6d9af2f4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.753829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.754658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.754954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.755235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.756094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Adding query filter params (scope.project.id=f17f471b5368454d8e75d5158ab8ae7f, user.id=68fad852a63248c18c4b2959105a7c27) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:35.756409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.758534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.794664 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3778/7523] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:35.798533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.898959 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3746/7524] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:43:35 2022] GET /identity/v3/role_assignments?scope.project.id=f17f471b5368454d8e75d5158ab8ae7f&user.id=68fad852a63248c18c4b2959105a7c27&effective => generated 228 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:35.901028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:35.919440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5b21-bb05-48ff-a1cf-4d1defa5f309 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.948805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c475eb-5283-4c6d-a750-6fd903074a58 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:35.955256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.955946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.956416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.956690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.957402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.959533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.988237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:35.989232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:35.989524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:35.989840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/49f4d23f7a284daa8d50a986600a3d57` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:35.993271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=49f4d23f7a284daa8d50a986600a3d57)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:35.996047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:35.999921 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3779/7525] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:35 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:36.005781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.008509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 49f4d23f7a284daa8d50a986600a3d57 was removed from user 68fad852a63248c18c4b2959105a7c27 on project f17f471b5368454d8e75d5158ab8ae7f. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:36.009866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:36.010924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:36.015292 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:36.026247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bd690-926f-46d6-871a-17252c1bf38b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.031570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.032353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.032849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.033120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.033980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.035732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.050345 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3747/7526] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:43:35 2022] DELETE /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/49f4d23f7a284daa8d50a986600a3d57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:36.051431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.052968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:36.069618 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3780/7527] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:36 2022] GET /identity/v3/roles => generated 2323 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:36.070774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.073066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:36.096161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810ec84-8659-4ffa-854b-64df1f40eada admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.200147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269ad3-672b-4f42-ba6a-025ad23ab66f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.212728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.214032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.214543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.215141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/49f4d23f7a284daa8d50a986600a3d57` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.217277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=49f4d23f7a284daa8d50a986600a3d57)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.240620 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:36.240620 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:36.240620 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:36.240620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.300205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.310026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.310335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.310671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] PATH_INFO: `/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a/users/082abe6e1b6d4ecb88313a335e5b14b7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.343999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 49f4d23f7a284daa8d50a986600a3d57 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:36.349693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:36.353380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:36.359793 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3748/7528] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:36 2022] DELETE /identity/v3/roles/49f4d23f7a284daa8d50a986600a3d57 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:36.365737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.369233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:36.377353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cf9f6bb5e04c95adf97506f739c12a, user_id=082abe6e1b6d4ecb88313a335e5b14b7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.381429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.411002 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3781/7529] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:36 2022] PUT /identity/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a/users/082abe6e1b6d4ecb88313a335e5b14b7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:36.412997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.417412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:36.471999 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:36.559386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cf148-27b3-4fc0-bde6-d7ab8f6b8b4f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.572517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e4b14-dfb3-4f32-8436-4d3802988905 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.589273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.590010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.590295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.590667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.591311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.603932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.644334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3782/7530] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:36 2022] GET /identity/v3/roles => generated 2323 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:36.667110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.710108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659360-154f-4d85-be53-65eb023e2689 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:36.726741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.727678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.727965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.728243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] PATH_INFO: `/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a/users/082abe6e1b6d4ecb88313a335e5b14b7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.746083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cf9f6bb5e04c95adf97506f739c12a, user_id=082abe6e1b6d4ecb88313a335e5b14b7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.746577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:36.747695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.748684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.748684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/0e2171ed24284418880a91d573e49ec7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.748974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d18a8-5e48-4704-90f2-a2c6af10586a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.754887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=0e2171ed24284418880a91d573e49ec7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:36.757970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:36.789014 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3783/7531] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:36 2022] PUT /identity/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a/users/082abe6e1b6d4ecb88313a335e5b14b7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:36.791216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebac0-7398-4f87-9569-cd3d433a2ed3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:36.791368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebac0-7398-4f87-9569-cd3d433a2ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:36.791748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebac0-7398-4f87-9569-cd3d433a2ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:36.799558 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3749/7532] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:36 2022] PUT /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/0e2171ed24284418880a91d573e49ec7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:36.803901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:36.813637 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:36.889539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-579ebac0-7398-4f87-9569-cd3d433a2ed3 None None] MFA Rules not processed for user `082abe6e1b6d4ecb88313a335e5b14b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:36.891256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-579ebac0-7398-4f87-9569-cd3d433a2ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:37.004200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b10a57-4973-4129-87ae-df232b4022dc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.016921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.018003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.018628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.019039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.020865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.022213 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:37.022213 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:37.022213 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:37.023179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.060395 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3784/7533] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:37.060395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.060395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.068305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.082477 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3750/7534] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:36 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 521 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:37.083444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.085180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:37.164548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:37.165884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:37.183068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3785/7535] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:37.186699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.217654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e4c60-0234-480f-bc51-6b316fdf3348 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.223185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.224150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.224746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.225180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.227612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:37.345664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42acd8-3e46-4bcc-8ac2-96d5a97a2f8c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.350051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.352124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.358485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.359167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.359451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.359728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.361641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Adding query filter params (scope.project.id=f17f471b5368454d8e75d5158ab8ae7f, user.id=68fad852a63248c18c4b2959105a7c27) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:37.361986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.363859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.381138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3751/7536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:37.382103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.386426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:37.394882 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:37.489955 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:37.531042 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3786/7537] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:43:37 2022] GET /identity/v3/role_assignments?scope.project.id=f17f471b5368454d8e75d5158ab8ae7f&user.id=68fad852a63248c18c4b2959105a7c27&effective => generated 1061 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:37.532893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.554674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5e7ff-08bd-4a03-b576-9cff6829ad80 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.566698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6511e-e3f6-4df6-852e-33b45ea6e03a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.569354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.570267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.570547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.570820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.589756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.591342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.591873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.592698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.601114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.602223 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:37.602223 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:37.602223 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:37.603126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.623326 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3787/7538] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:37 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:37.630488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.688321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:37.709326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3752/7539] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:37 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:37.728722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bd2a-d6c6-48e3-abd0-119dd96ba4c9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.736369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.737233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.737578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.737946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.739128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Adding query filter params (scope.project.id=f17f471b5368454d8e75d5158ab8ae7f, user.id=68fad852a63248c18c4b2959105a7c27) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:37.739561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.741693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.874097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3788/7540] 10.222.0.27 () {58 vars in 1355 bytes} [Sun Jul 24 01:43:37 2022] GET /identity/v3/role_assignments?scope.project.id=f17f471b5368454d8e75d5158ab8ae7f&user.id=68fad852a63248c18c4b2959105a7c27&effective => generated 577 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:37.875080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:37.898934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d933c-6ff8-4884-b165-d374c3fe3807 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:37.911392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:37.913376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:37.914599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:37.915938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:37.920332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:37.921701 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:37.921701 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:37.921701 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:37.926761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e.: keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = query.one() Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._iter().one() Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._only_one_row( Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:37.981571 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:37.983026 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 24 01:43:37.984367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 24 01:43:37.984367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 24 01:43:37.984367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 24 01:43:37.984367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:37.984367 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:37.988159 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3753/7541] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:37 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 137 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:43:37.992057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:38.016500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdad4c-3a51-4c84-a6a9-3fc20c2c6892 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:38.044651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:38.045814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.046273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.046926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/0e2171ed24284418880a91d573e49ec7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.056294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=0e2171ed24284418880a91d573e49ec7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:38.059041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:38.082707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 0e2171ed24284418880a91d573e49ec7 was removed from user 68fad852a63248c18c4b2959105a7c27 on project f17f471b5368454d8e75d5158ab8ae7f. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:38.083017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:38.089783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:38.127562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3789/7542] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:43:37 2022] DELETE /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/0e2171ed24284418880a91d573e49ec7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:38.133165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:38.136689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:38.154493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31926-6d11-4a66-83fb-07bb4d5c7131 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:38.296424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:38.297119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.297604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.298107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.299036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:38.300752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:38.325864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3754/7543] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:38 2022] POST /identity/v3/roles => generated 271 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:38.327566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:38.354280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c6b0b-19d7-49e5-8c5e-477f89314542 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:38.379393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:38.380671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.380791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.381030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.381878 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Adding query filter params (domain_id=0c52dfe7c0664adc8d6edb8b249c0011) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:38.382187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:38.383440 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:38.383440 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:38.383440 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:38.384401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:38.406345 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3790/7544] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Jul 24 01:43:38 2022] GET /identity/v3/roles?domain_id=0c52dfe7c0664adc8d6edb8b249c0011 => generated 408 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:38.408517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:38.421386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445c641-d07b-47fc-b718-5e985f640d89 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:38.441013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:38.442351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.443422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.447045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/89ca89b5525840c8ac0a22b64cd75ae0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.449083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=89ca89b5525840c8ac0a22b64cd75ae0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:38.450951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:38.539219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 89ca89b5525840c8ac0a22b64cd75ae0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:38.539523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:38.540304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-24b76d2e-6615-457a-b6e8-14ad7c98d212 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:38.554984 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3755/7545] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:38 2022] DELETE /identity/v3/roles/89ca89b5525840c8ac0a22b64cd75ae0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:38.556045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:38.558324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:38.579077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478309-18fc-43cb-a5b0-a30a85166234 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:38.715300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9201-8c04-4709-a0cd-a1c2d6f99026 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.715741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9201-8c04-4709-a0cd-a1c2d6f99026 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.716137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9201-8c04-4709-a0cd-a1c2d6f99026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.755170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-724b9201-8c04-4709-a0cd-a1c2d6f99026 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:38.756713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-724b9201-8c04-4709-a0cd-a1c2d6f99026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:38.768534 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3756/7546] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:38 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 01:43:38.775254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab594c-e4e4-4698-a0de-45954856a554 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.775739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab594c-e4e4-4698-a0de-45954856a554 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.776064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab594c-e4e4-4698-a0de-45954856a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.778838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dcab594c-e4e4-4698-a0de-45954856a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:38.878924 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:38.910100 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:38.948178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:38.948966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.954453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.954891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.956068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Adding query filter params (domain_id=0c52dfe7c0664adc8d6edb8b249c0011) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:38.956436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:38.958605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-dcab594c-e4e4-4698-a0de-45954856a554 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 24 01:43:38.964730 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:38.966364 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:43:38.968801 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:38.973180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3757/7547] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:38 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:43:38.977543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904413-caea-4dc2-97aa-9bda0069c492 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:38.978041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904413-caea-4dc2-97aa-9bda0069c492 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:38.978556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904413-caea-4dc2-97aa-9bda0069c492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:38.979872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3791/7548] 10.222.0.27 () {58 vars in 1206 bytes} [Sun Jul 24 01:43:38 2022] GET /identity/v3/roles?domain_id=0c52dfe7c0664adc8d6edb8b249c0011 => generated 148 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:38.996730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.017416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0d51b-e237-4d78-9d27-41143c2cf680 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.033698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.034815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.035279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.035647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/89ca89b5525840c8ac0a22b64cd75ae0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.058896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Could not find role: 89ca89b5525840c8ac0a22b64cd75ae0.: keystone.exception.RoleNotFound: Could not find role: 89ca89b5525840c8ac0a22b64cd75ae0. Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 24 01:43:39.079143 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:43:39.080846 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 89ca89b5525840c8ac0a22b64cd75ae0. Jul 24 01:43:39.082266 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:39.091732 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3792/7549] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:38 2022] DELETE /identity/v3/roles/89ca89b5525840c8ac0a22b64cd75ae0 => generated 110 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:39.092745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.099041 n-d-master-1 devstack@keystone.service[80591]: WARNING keystone.server.flask.application [None req-40904413-caea-4dc2-97aa-9bda0069c492 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 24 01:43:39.101715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3758/7550] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 125 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 24 01:43:39.107372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.107872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.108320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.147549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3d6c-3fa2-4136-9a8c-91b917975b10 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.153198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.154266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.154669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.155050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.173519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:39.177256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:39.209740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:39.211253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:39.213261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3793/7551] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:39 2022] PUT /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:39.214305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.354879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a292e3a-d6ec-47a2-8bf6-bea0768022b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.376594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.377599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.377926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.378203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.380683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, group_id=1ef54c40c56f4025b98b11e11b6e14c3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:39.383266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:39.403535 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3794/7552] 10.222.0.27 () {58 vars in 1364 bytes} [Sun Jul 24 01:43:39 2022] GET /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles => generated 409 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:39.408147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.428084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3759/7553] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:39.435653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.446262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eca34-5a8c-4aab-af4d-918e8d1ef7fa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.457448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b692-2e33-47bf-88b1-6218569381fe tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.479731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.479731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.479731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.480197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.480197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:39.486508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:39.489060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.490375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.491461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3795/7554] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Jul 24 01:43:39 2022] HEAD /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:39.491943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.492235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.498254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.534141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f01f-c77e-4582-8540-1e8c03741d2b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.558081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.559094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.559490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.559833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.563426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:39.568347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:39.574958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 9d7fdae1d7154409885fe3d6ab472608 was removed from group 1ef54c40c56f4025b98b11e11b6e14c3 on domain 0c52dfe7c0664adc8d6edb8b249c0011. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:39.576447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:39.577531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:39.618132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3796/7555] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:43:39 2022] DELETE /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:39.619507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.621365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:39.624147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:39.654809 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3760/7556] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:39 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:39.826566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dcde0-89e9-4766-b9f5-c3c4ef495852 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:39.844398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:39.846677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:39.846677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:39.847070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:39.849646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:39.853462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:39.889013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3797/7557] 10.222.0.27 () {60 vars in 1485 bytes} [Sun Jul 24 01:43:39 2022] PUT /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:39.893322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:39.905990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dd404-6dfb-4762-b2d0-4f48c641fad5 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:40.003759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:40.004290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.009698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.010067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.012116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_grants(project_id=f17f471b5368454d8e75d5158ab8ae7f, group_id=1ef54c40c56f4025b98b11e11b6e14c3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:40.016220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a80b0-99be-46a0-90c3-fd9bb5b553f2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:40.036054 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3761/7558] 10.222.0.27 () {58 vars in 1367 bytes} [Sun Jul 24 01:43:39 2022] GET /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles => generated 410 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:40.040101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:40.061337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4a31c-d042-4342-91a4-1ba52b64b8a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:40.085106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:40.086065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.086354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.086632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3/users/68fad852a63248c18c4b2959105a7c27` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.090288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3, user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:40.091337 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:40.091337 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:40.091337 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:40.092611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:40.132822 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:40.201498 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3798/7559] 10.222.0.27 () {60 vars in 1359 bytes} [Sun Jul 24 01:43:40 2022] PUT /identity/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3/users/68fad852a63248c18c4b2959105a7c27 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:40.203276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7774-9487-4f97-8230-65345a154162 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.204122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7774-9487-4f97-8230-65345a154162 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.204545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda7774-9487-4f97-8230-65345a154162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.295336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ecda7774-9487-4f97-8230-65345a154162 None None] MFA Rules not processed for user `68fad852a63248c18c4b2959105a7c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:40.297346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ecda7774-9487-4f97-8230-65345a154162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:40.314487 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:40.534614 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3762/7560] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:40.539982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:40.661029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdcd2-4d9c-4014-9a08-24ce5db37304 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.661499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdcd2-4d9c-4014-9a08-24ce5db37304 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.662173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdcd2-4d9c-4014-9a08-24ce5db37304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.693169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffb93d-b3e7-4daf-8fd8-a85cec86d7df tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:40.704372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:40.705864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.706353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.706814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.711015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:40.715045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:40.719175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-174fdcd2-4d9c-4014-9a08-24ce5db37304 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:40.722695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-174fdcd2-4d9c-4014-9a08-24ce5db37304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:40.724562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3799/7561] 10.222.0.27 () {58 vars in 1467 bytes} [Sun Jul 24 01:43:40 2022] HEAD /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:40.730751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:40.732243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3763/7562] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:40.740556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.741057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.741614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.749020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0da98-3fbe-48d0-a3e1-271d7472ec08 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:40.758312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:40.759435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:40.760046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:40.760511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:40.768149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:40.772422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:40.782924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 9d7fdae1d7154409885fe3d6ab472608 was removed from group 1ef54c40c56f4025b98b11e11b6e14c3 on project f17f471b5368454d8e75d5158ab8ae7f. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:40.783227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:40.784086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:40.815871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:40.818750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:40.821834 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3800/7563] 10.222.0.27 () {58 vars in 1469 bytes} [Sun Jul 24 01:43:40 2022] DELETE /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:40.826687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:40.829333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:41.038787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3764/7564] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:41.068061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.104476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8124-500f-4d31-8627-173b5f8d49e7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.108389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559e79-20f0-4e2a-9d26-4aeb267057fd tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.122614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.123805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.124999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.126805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.127220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.127784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.128132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.128881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3/users/68fad852a63248c18c4b2959105a7c27` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.137358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3, user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.139622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.159432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:41.214934 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3801/7565] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:43:40 2022] DELETE /identity/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3/users/68fad852a63248c18c4b2959105a7c27 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.216267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.303427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:41.340055 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3765/7566] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:41 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.356949 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:41.363726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db4c25-20b0-45ba-82c1-5da069e04311 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.387233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.388121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.388776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.388776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.390712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.394013 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:41.394013 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:41.394013 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:41.395179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.424339 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3802/7567] 10.222.0.27 () {60 vars in 1380 bytes} [Sun Jul 24 01:43:41 2022] PUT /identity/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.428544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.441913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864e69-0dd9-4ed3-a729-b7d81c89ac27 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.459006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.462199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.462848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.463070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.465579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.466794 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:41.466794 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:41.466794 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:41.468273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.486775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3766/7568] 10.222.0.27 () {58 vars in 1262 bytes} [Sun Jul 24 01:43:41 2022] GET /identity/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles => generated 375 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:41.490708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.507772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0514d-75d7-4a6c-ac92-8897060d7ba5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.514489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.517495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.517801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.518344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.520754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.522166 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:41.522166 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:41.522166 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:41.524243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.537392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3803/7569] 10.222.0.27 () {58 vars in 1362 bytes} [Sun Jul 24 01:43:41 2022] HEAD /identity/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:41.538624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.550939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe911-e655-4097-ae6f-07d694d0d0b1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.561971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.564908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.566646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.567161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.570624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.572098 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:41.572098 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:41.572098 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:41.574742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.591934 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3767/7570] 10.222.0.27 () {58 vars in 1364 bytes} [Sun Jul 24 01:43:41 2022] DELETE /identity/v3/system/groups/1ef54c40c56f4025b98b11e11b6e14c3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.597481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.612420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639728d-4015-47c6-987a-f85778ce7e50 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.620025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.622308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.623115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.623897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.630408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.639922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.708168 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3804/7571] 10.222.0.27 () {60 vars in 1479 bytes} [Sun Jul 24 01:43:41 2022] PUT /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.712530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.725550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0bd78-9284-469e-af7b-04a92076558b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.832604 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:41.892086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.892895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.893180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.893458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.895795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.899057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.926285 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3768/7572] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Jul 24 01:43:41 2022] GET /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles => generated 408 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:41.929881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.941616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e962-7090-49a4-b05f-5e0ebec2ed97 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.946928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:41.947928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:41.948296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:41.948652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:41.951245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:41.954669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:41.963063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3805/7573] 10.222.0.27 () {58 vars in 1461 bytes} [Sun Jul 24 01:43:41 2022] HEAD /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:41.967141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:41.980744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94148f4-b771-49fb-897e-a8bea8c81f6f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:41.997992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.001203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.001662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.002141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.014058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0c52dfe7c0664adc8d6edb8b249c0011, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.018247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.054298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 9d7fdae1d7154409885fe3d6ab472608 was removed from user 68fad852a63248c18c4b2959105a7c27 on domain 0c52dfe7c0664adc8d6edb8b249c0011. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:42.054513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:42.062268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:42.090984 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3769/7574] 10.222.0.27 () {58 vars in 1463 bytes} [Sun Jul 24 01:43:41 2022] DELETE /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:42.096576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.099118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:42.124911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe545-88de-4b97-b441-f33fea41de83 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.260547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.261400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.261793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.262284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.264748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.268610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ae38c-7f53-453b-ae12-62b885872151 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.308531 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3806/7575] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:42 2022] PUT /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:42.312721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.336385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b3057-8af5-4dbb-a3da-3a0b830d0ed6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.345027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869909-65ca-4a1a-8217-fdfa0d030b0b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.345797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869909-65ca-4a1a-8217-fdfa0d030b0b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.346152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869909-65ca-4a1a-8217-fdfa0d030b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.378909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-42869909-65ca-4a1a-8217-fdfa0d030b0b None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:42.380279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42869909-65ca-4a1a-8217-fdfa0d030b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:42.388823 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3807/7576] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:42 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 01:43:42.392414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.392785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.393068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.483814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:42.485773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:42.507039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.508085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.508367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.509136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.511018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_grants(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.514233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.541862 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3770/7577] 10.222.0.27 () {58 vars in 1364 bytes} [Sun Jul 24 01:43:42 2022] GET /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles => generated 409 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:42.542891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.554675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385b3ce-bdbc-4683-872d-cb9e060c1fd7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.559924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.560918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.561259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.561629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.566102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.569151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.583593 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3771/7578] 10.222.0.27 () {58 vars in 1464 bytes} [Sun Jul 24 01:43:42 2022] HEAD /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:42.587835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.619285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b87d-7784-4092-b0e1-1ab9fdcc015b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.633396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.634672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.634672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.635601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.644914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=f17f471b5368454d8e75d5158ab8ae7f, user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.652625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.653123 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3808/7579] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:42.655456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.673575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 9d7fdae1d7154409885fe3d6ab472608 was removed from user 68fad852a63248c18c4b2959105a7c27 on project f17f471b5368454d8e75d5158ab8ae7f. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:42.675813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd2a24-fab0-41ac-9b1d-5d16567f1fd8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.676225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:42.678155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:42.702623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31007d5bea0c454e8f2f3076c1c11e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2b66bba2bf4803b053bbe19717331d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.706021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.707954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.709333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.715406 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3772/7580] 10.222.0.27 () {58 vars in 1466 bytes} [Sun Jul 24 01:43:42 2022] DELETE /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:42.721181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:42.723309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:42.883459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:42.896543 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3809/7581] 10.222.0.27 () {60 vars in 1268 bytes} [Sun Jul 24 01:43:42 2022] POST /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42/password => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:42.943120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60797d-c911-441f-b6be-364e92c20cec tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:42.972086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:42.973409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:42.973778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:42.976818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:42.979078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:42.983666 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:42.983666 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:42.983666 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:42.984775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:42.997649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3773/7582] 10.222.0.27 () {60 vars in 1377 bytes} [Sun Jul 24 01:43:42 2022] PUT /identity/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:43.002846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.039422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006fcb-5ec0-4958-84ec-5d60b1a96c93 tempest-IdentityV3UsersTest-591806160 tempest-IdentityV3UsersTest-591806160-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.082259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.083100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.083384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.083660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.085014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.086067 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:43.086067 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:43.086067 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:43.086957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.108187 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3810/7583] 10.222.0.27 () {58 vars in 1259 bytes} [Sun Jul 24 01:43:43 2022] GET /identity/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles => generated 374 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:43.113058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.122098 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:43.140802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ddd6f-bc16-4628-8fbb-b82d66c5f6cf tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.164073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.164980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.165261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.165546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.176296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.177370 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:43.177370 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:43.177370 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:43.180976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.200732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3774/7584] 10.222.0.27 () {58 vars in 1359 bytes} [Sun Jul 24 01:43:43 2022] HEAD /identity/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:43.204759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.212573 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:43.219983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1b0b-e489-4655-8f84-3155ec840159 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.230814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.232019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.237714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.238171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.241349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=68fad852a63248c18c4b2959105a7c27, role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.242564 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:43.242564 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:43.242564 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:43.243720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.284548 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3811/7585] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Jul 24 01:43:43 2022] DELETE /identity/v3/system/users/68fad852a63248c18c4b2959105a7c27/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:43.289509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.311249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c499c-8889-4b98-8ffe-e1718d284d7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.323512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.325931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.326223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.326510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.327710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.335420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.389378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3775/7586] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:43 2022] POST /identity/v3/roles => generated 269 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:43.391822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.412649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415d0f-1248-4ce2-85a2-1f8f99b8f490 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.418528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.419214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.419556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.419845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.420824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.422224 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:43.422224 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:43.422224 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:43.423125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.453257 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3812/7587] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:43 2022] POST /identity/v3/roles => generated 269 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:43.455191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.479151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763136ad-a1f3-43bd-80eb-0c683ce8d124 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.489071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.490317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.490603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.490851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/f964d683e2364428bf3bddfb2026a844` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.497403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=f964d683e2364428bf3bddfb2026a844)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.499237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.582566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3776/7588] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:43 2022] PUT /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/f964d683e2364428bf3bddfb2026a844 => generated 529 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:43.586480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.601310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88408-0664-45f3-92cc-9168488befda tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.708138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.708858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.709142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.709416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.710335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.712238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15ccf-2d3b-46e9-88f5-d8d84eb3bc57 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.739687 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3813/7589] 10.222.0.27 () {60 vars in 1148 bytes} [Sun Jul 24 01:43:43 2022] POST /identity/v3/domains => generated 277 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:43.743376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.768364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be14e-5a1a-4752-a1ec-7b7bd0f2ce7b tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.902236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.902482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.902633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.902889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.903355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.903652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.904479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.906692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.915195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:43.926990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:43.929586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:43.935231 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3814/7590] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:43 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:43:43.944434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3777/7591] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:43 2022] POST /identity/v3/roles => generated 270 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:43.951121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:43.973912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c163399-9159-416c-bc6c-5b1524e96c8f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:43.982658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:43.983610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:43.983865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:43.984140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/0e06719aef4c43eb921a7ac9bbe085b9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:43.986795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=0e06719aef4c43eb921a7ac9bbe085b9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:43.987834 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:43.987834 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:43.987834 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:43.989011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.052247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3815/7592] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:43 2022] PUT /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/0e06719aef4c43eb921a7ac9bbe085b9 => generated 530 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:44.053543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.088025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692da80-3928-4635-a656-dbb087941e4d tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:44.310680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:44.311631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.312125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.312411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.316843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:44.324791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658ce99-5785-4644-b15f-d03862bb44d4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.375891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3778/7593] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:44 2022] PUT /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 524 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:44.379796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.396388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae4e7f-1a52-4520-b0d3-d73d9a08c1d6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:44.468631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.468997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.469296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.494429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:44.495308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:44.526377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:44.528212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.528734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.529330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/9d7fdae1d7154409885fe3d6ab472608/implies/199505dbb35c4b16b1d4c225dd766ef1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.532588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9d7fdae1d7154409885fe3d6ab472608, implied_role_id=199505dbb35c4b16b1d4c225dd766ef1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:44.534526 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:44.534818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] 199505dbb35c4b16b1d4c225dd766ef1 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 199505dbb35c4b16b1d4c225dd766ef1 cannot be an implied roles. Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 24 01:43:44.566026 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 199505dbb35c4b16b1d4c225dd766ef1 cannot be an implied roles. Jul 24 01:43:44.567359 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:43:44.570488 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3816/7594] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:44 2022] PUT /identity/v3/roles/9d7fdae1d7154409885fe3d6ab472608/implies/199505dbb35c4b16b1d4c225dd766ef1 => generated 116 bytes in 191 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:44.575760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.593445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f36ca6-c3e1-4709-8719-aee563deb933 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:44.597238 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3779/7595] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:44.600882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:44.601853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.602437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.602756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.604551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:44.606793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.618032 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3817/7596] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:44 2022] DELETE /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:44.622233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.637330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74219e-5ec7-4025-93bd-063752cd09c7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:44.661022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.663659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:44.722468 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:44.814665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ddc03-eac4-4182-904e-71c7145c3b2e tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:44.820706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:44.821564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.822055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.822677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.838742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:44.841465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.842879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.842879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/0e06719aef4c43eb921a7ac9bbe085b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:44.850951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=0e06719aef4c43eb921a7ac9bbe085b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:44.852956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.878143 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3780/7597] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:44 2022] DELETE /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/0e06719aef4c43eb921a7ac9bbe085b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:44.883933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:44.943322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:44.950660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10ee7b-5546-4d56-9c23-cd941a0bafba service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:44.962157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3818/7598] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:43:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:44.963603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:44.964403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:44.964772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.011483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] MFA Rules not processed for user `31007d5bea0c454e8f2f3076c1c11e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:45.012735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:45.017737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0160-7b91-401a-afac-cf56706e5108 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:45.024147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:45.025702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:45.026110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:45.026648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e06719aef4c43eb921a7ac9bbe085b9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.028137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0e06719aef4c43eb921a7ac9bbe085b9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:45.029980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:45.129616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 0e06719aef4c43eb921a7ac9bbe085b9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:45.129976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.130888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.133344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3781/7599] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:44 2022] DELETE /identity/v3/roles/0e06719aef4c43eb921a7ac9bbe085b9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:45.137389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:45.139179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:45.171600 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3819/7600] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:45.175353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:45.181177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:45.293501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a898a95-2628-4f52-9973-69821b643a84 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:45.347076 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:45.354613 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:45.393358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c553d-eb4d-4ad2-8f2a-e2b93cd088a4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:45.399738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:45.401296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:45.401588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:45.401900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/4429ea6860f344e6be30b15ebd73dede` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.435134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4429ea6860f344e6be30b15ebd73dede)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:45.446424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:45.494613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.501624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.545609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:45.548391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:45.548674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:45.548953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] PATH_INFO: `/v3/users/31007d5bea0c454e8f2f3076c1c11e42` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.556336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31007d5bea0c454e8f2f3076c1c11e42)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:45.560976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:45.615941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.618139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.642498 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3782/7601] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:43:45 2022] PATCH /identity/v3/domains/4429ea6860f344e6be30b15ebd73dede => generated 278 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:45.650440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:45.658998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:45.701635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.703110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.730088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.754749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.799700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8221dd-81b7-4243-ad19-4b5e692100fc tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:45.806314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:45.807221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:45.807608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:45.807895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/4429ea6860f344e6be30b15ebd73dede` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.822639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4429ea6860f344e6be30b15ebd73dede)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:45.827582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:45.837937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bb046e01-a0b1-4e97-bcb0-6e4e8062ac1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31007d5bea0c454e8f2f3076c1c11e42'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.861134 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3820/7602] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:45 2022] DELETE /identity/v3/users/31007d5bea0c454e8f2f3076c1c11e42 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:45.865514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:45.867173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:45.867698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:45.915978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:45.917219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:45.929333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:45.981986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4429ea6860f344e6be30b15ebd73dede'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.086016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.131563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3821/7603] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:46.136557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.142563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:46.144158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.153943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.157839 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:46.185950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] The token cache is being invalidate because project 4429ea6860f344e6be30b15ebd73dede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:46.189037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.191221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.214361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.215151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.224036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4429ea6860f344e6be30b15ebd73dede', 'request_id': 'req-c4fe22e0-1deb-46e4-affb-c4248ca59eb1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:46.234602 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3783/7604] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:45 2022] DELETE /identity/v3/domains/4429ea6860f344e6be30b15ebd73dede => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:46.239304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:46.239612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:46.239824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:46.243605 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:46.268618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:46.270612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.279561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672767-4be2-49c3-bf66-6ee4ea15d7eb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:46.387196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:46.388612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:46.394111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:46.395056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:46.403429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.476278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3784/7605] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:43:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:46.477992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:46.480547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.617158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:46.618742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:46.621337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909482a-e5fd-4b9e-ba8e-b96c2b58cbfd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:46.629836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:46.630811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:46.631099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:46.631374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/f964d683e2364428bf3bddfb2026a844` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:46.633153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3822/7606] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:43:46.633297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=199505dbb35c4b16b1d4c225dd766ef1, implied_role_id=f964d683e2364428bf3bddfb2026a844)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:46.634266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:46.635104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:46.635751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.649189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3785/7607] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:46 2022] DELETE /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1/implies/f964d683e2364428bf3bddfb2026a844 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:46.653098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:46.655855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.803947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886549e-ac92-4fdc-8eb6-791ce646a919 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:46.824460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6c97-d465-49f1-8e00-e836c66db3a5 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:46.834548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:46.836627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:46.837127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:46.839384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:46.852694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:46.916485 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:46.921191 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:46.975293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:46.977726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:46.977726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:46.977726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:47.036074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:47.037582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:47.053641 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3786/7608] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:47.054701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:47.143072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:47.144732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:47.167726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3823/7609] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:43:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:47.277392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d52d66-65e7-4804-8d89-90faeca1649a service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:47.290793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:47.293111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:47.294736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:47.295022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/f964d683e2364428bf3bddfb2026a844` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:47.305782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f964d683e2364428bf3bddfb2026a844)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:47.308649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:47.457605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role f964d683e2364428bf3bddfb2026a844 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:47.459456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:47.460703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-615917e5-457e-49ec-8be1-0bf88850edc0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:47.470326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3787/7610] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:47 2022] DELETE /identity/v3/roles/f964d683e2364428bf3bddfb2026a844 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:47.474049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:47.490576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e42c86-153d-46a5-8824-95b8e98b5e9e service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:47.593327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:47.596048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:47.596899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:47.644169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:47.645065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:47.645353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:47.645637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/199505dbb35c4b16b1d4c225dd766ef1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:47.648158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=199505dbb35c4b16b1d4c225dd766ef1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:47.649130 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:47.649130 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:47.649130 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:47.653035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:47.653248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:47.658789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:47.802132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 199505dbb35c4b16b1d4c225dd766ef1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:47.804832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:47.805830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:47.816619 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3824/7611] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:47 2022] DELETE /identity/v3/roles/199505dbb35c4b16b1d4c225dd766ef1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:47.817621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:47.821644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:47.881857 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3788/7612] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:47.902619 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:47.916080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:47.919368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:47.946467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c901ac-d47f-4ef9-92dd-ffa276e541da tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:47.962758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:47.963913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:47.964204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:47.967073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] PATH_INFO: `/v3/projects/8e2b66bba2bf4803b053bbe19717331d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:47.974461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2b66bba2bf4803b053bbe19717331d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:47.978460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:47.987848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabf10d-d5fe-401d-8775-c37794e638cd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:48.071269 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:48.143073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2b66bba2bf4803b053bbe19717331d', 'request_id': 'req-420814a7-746b-46ce-8daa-bef1986d76c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:48.157638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:48.160060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.162932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.163647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2b66bba2bf4803b053bbe19717331d', 'request_id': 'req-420814a7-746b-46ce-8daa-bef1986d76c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:48.166257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.170021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.182932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af545-b720-4148-a749-7affcac83294 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:48.195534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2b66bba2bf4803b053bbe19717331d', 'request_id': 'req-420814a7-746b-46ce-8daa-bef1986d76c6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:48.219427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] The token cache is being invalidate because project 8e2b66bba2bf4803b053bbe19717331d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:48.220194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:48.221319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:48.223960 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3825/7613] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:47 2022] DELETE /identity/v3/projects/8e2b66bba2bf4803b053bbe19717331d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:48.227154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:48.229796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:48.265205 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3789/7614] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:47 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 521 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:48.270804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.270804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.270804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.330374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:48.331772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:48.420704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420814a7-746b-46ce-8daa-bef1986d76c6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:48.498334 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3790/7615] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:48.499544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:48.501046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:48.641831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:48.641831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.641831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.642409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.644055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:48.707565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9f598-be5a-4ad6-b625-9e660935d82f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:48.736048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:48.737043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.737327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.737603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.741986 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:48.742544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.743518 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:48.743518 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:48.743518 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:48.748552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:48.749621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.751015 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:48.751015 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:48.751015 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:48.751865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973ecb-b579-4c54-a4d0-ec83a4514581 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:48.776772 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3791/7616] 10.222.0.27 () {58 vars in 1344 bytes} [Sun Jul 24 01:43:48 2022] HEAD /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:48.777834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.778121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.778394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.834286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:48.836533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:48.863167 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3792/7617] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:48.867310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:48.900477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.902453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:48.915699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430df7-836d-4c2e-af90-0ae3e0665077 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:48.919795 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3826/7618] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:43:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:48.921135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:48.928125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:48.932678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.932678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.932678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.936108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.941202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:48.949074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f968f0f-f084-40d4-8183-01144d0fcf9e service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:48.960924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3793/7619] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:43:48 2022] GET /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 521 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:48.965159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:48.969725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:48.970426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:48.970711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:48.970989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:48.971744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:43:48.972045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:48.988213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3631-1dec-41cb-9c67-fa553fec9862 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.006054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.012317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.014065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.014479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.014767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.023885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.037205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.059166 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3794/7620] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:48 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:49.060944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.070233 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3827/7621] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:49.075203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.142803 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:49.152916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5c82-071a-43ef-8897-b70e5c307a13 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.241779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a95e8-32f2-4f01-b2ae-0b9172789262 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.298491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.300490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.300490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.300490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.303503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.305619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.330402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.331102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.331390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.331668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.332710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.334777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e.: keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = query.one() Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._iter().one() Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._only_one_row( Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:49.408423 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 24 01:43:49.409749 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 24 01:43:49.410916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 24 01:43:49.410916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:49.410916 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.414839 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3795/7622] 10.222.0.27 () {58 vars in 1343 bytes} [Sun Jul 24 01:43:49 2022] GET /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 137 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:49.427710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.447656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3828/7623] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:49 2022] POST /identity/v3/projects => generated 395 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:49.451440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.458677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a704-6f1d-4de8-a33a-c555b47eed64 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.712337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b74661-4cff-47b5-ae20-8faffc1f8feb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.713037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.714104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.714448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.715442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.720543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.722400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.727525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.728464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.728813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.729153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.732740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.734246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e.: keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = query.one() Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._iter().one() Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._only_one_row( Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:49.757628 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 24 01:43:49.759210 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 24 01:43:49.760570 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 24 01:43:49.760570 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 24 01:43:49.760570 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 24 01:43:49.760570 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e2171ed24284418880a91d573e49ec7 does not imply b8d2facd23154664bbd3f7a420dfdb2e. Jul 24 01:43:49.760570 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:49.764321 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3796/7624] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:49 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 137 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:49.768707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.787085 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3829/7625] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:49 2022] POST /identity/v3/users => generated 304 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:49.790824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:49.798280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3a48-50f8-4fc7-8760-49e6a2f90ae7 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.821901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.823914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cdf10-6ce4-4ca0-95a6-3aca5a633c02 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:49.824193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.827017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.829260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.833833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:49.835632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.835765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.836479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.837024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.838153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:49.840657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9740d8e-c922-45f5-b187-b50953b5c0d4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.857956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:49.866099 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3830/7626] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:49 2022] GET /identity/v3/roles => generated 2323 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:49.871067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:49.872110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:49.872637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:49.948727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:49.950245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:49.983244 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3797/7627] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:49 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 521 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:49.986293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:50.023203 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:50.204366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3831/7628] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:43:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:50.206908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:50.233367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1c15e-ace1-44dc-9949-9c17ee0366fd None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:50.244407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79ed9-112f-424e-9cc3-c8f3a7bcd1c1 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:50.258495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:50.259421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:50.259702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:50.259984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] PATH_INFO: `/v3/projects/8d511f78873040e7afe04b5b9c49fab1/users/f042fcd9a7d44a42a862e0ca8eb06c3a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:50.311836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d511f78873040e7afe04b5b9c49fab1, user_id=f042fcd9a7d44a42a862e0ca8eb06c3a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:50.351334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:50.392183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3798/7629] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:49 2022] PUT /identity/v3/projects/8d511f78873040e7afe04b5b9c49fab1/users/f042fcd9a7d44a42a862e0ca8eb06c3a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:50.392183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:50.411048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:50.412003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:50.412291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:50.412568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:50.418287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:50.420745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:50.446482 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:50.523442 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3832/7630] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:50 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c => generated 521 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:50.524588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:50.591177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb2d65-c6de-4a24-ab41-59cd0d1aca35 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:50.707279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116d01-d1dc-4ff5-bea5-99809e3e8d70 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:50.731183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:50.732233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:50.733099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:50.734122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:50.736065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:50.738464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:50.754530 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3833/7631] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:50 2022] GET /identity/v3/roles => generated 2323 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:50.756590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:50.827966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:50.828681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:50.829008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:50.829242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:50.843661 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:50.948126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545607d-773d-4258-bad3-6870c415b301 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:50.979263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:50.985628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:50.990803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:50.991614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:50.998724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4ad5525c920f47a48c1e4e52d81ee44c, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:51.006742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:51.122497 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3834/7632] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:50 2022] PUT /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 520 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:51.123625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:51.135241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:51.137038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:51.169590 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3799/7633] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:43:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:43:51.170402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:51.202926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f12d3-fc40-41f0-a040-34756bf2885b service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:51.436891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:51.437776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:51.438271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:51.438785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:51.439682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:51.442431 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:51.442431 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:51.442431 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:51.443838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba617-ea56-4003-8503-c2be87dfb385 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:51.457327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870df9-e68c-4ae7-a665-738c8b5a238a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:51.460951 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:51.472627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:51.480668 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:51.481039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:51.482233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] PATH_INFO: `/v3/projects/8d511f78873040e7afe04b5b9c49fab1/users/f042fcd9a7d44a42a862e0ca8eb06c3a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:51.485206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d511f78873040e7afe04b5b9c49fab1, user_id=f042fcd9a7d44a42a862e0ca8eb06c3a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:51.488500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:51.517483 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3835/7634] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:51 2022] PUT /identity/v3/projects/8d511f78873040e7afe04b5b9c49fab1/users/f042fcd9a7d44a42a862e0ca8eb06c3a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:51.541042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:51.552308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3800/7635] 10.222.0.27 () {58 vars in 1151 bytes} [Sun Jul 24 01:43:51 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:51.648701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:51.649221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:51.649703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:51.703294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] MFA Rules not processed for user `f042fcd9a7d44a42a862e0ca8eb06c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:51.704540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:51.853217 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3801/7636] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:51.854372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748c21-6c3a-40d1-842e-9e85d5fc2171 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:51.854820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:51.870412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:51.871369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:51.871683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:51.872133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:51.880697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4ad5525c920f47a48c1e4e52d81ee44c, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:51.882812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:51.905368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3836/7637] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:51 2022] DELETE /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:51.909628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:51.990289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbcd43-5331-49d9-a623-7be2fdfa32a4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.131657 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:52.204722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c9deb-b5dc-440b-b3b5-2adc5a645856 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.230724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.232533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.232936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.233281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.233798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.233943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.234207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.234750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.236192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.239205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.241110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.241306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.270294 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3837/7638] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:51 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:52.275946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.313515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3802/7639] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:43:51 2022] POST /identity/v3/projects => generated 397 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:52.317644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.354933 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:52.440897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118340f-99d6-4b5c-9401-6414d0a8e71c tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.534906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.535881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.536164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.536440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.538394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.540290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.544268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d07c0-e0c1-4c10-8f60-cebe583e74a2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.565585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3838/7640] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:52 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:52.566794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.567781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.568691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.569157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.569624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.571001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.573591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.642283 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3803/7641] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:43:52 2022] POST /identity/v3/users => generated 299 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:52.647618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.672620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ddbba-a861-46a1-b922-481dfaee50c4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.785251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d401-391f-4d28-9bc5-cfcea40c0fa3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.813230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.814183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.814714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.815184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.816149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.818007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.836935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.838925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.842768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.848459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.855894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.860453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.871072 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3839/7642] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:52 2022] GET /identity/v3/roles => generated 2323 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:43:52.873161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.904999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7322-0b9b-4aaf-95b0-2fc5aebbb7a9 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.915489 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3804/7643] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:52 2022] GET /identity/v3/roles => generated 2323 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:52.918809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:52.938117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.939159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.939648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.940418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.941533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.943497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:52.959986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870616f1-034b-4dcf-8a56-bc863bb668b2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:52.982112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:52.984775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:52.986823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:52.987536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:52.991402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:52.994580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.001515 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3840/7644] 10.222.0.27 () {60 vars in 1142 bytes} [Sun Jul 24 01:43:52 2022] POST /identity/v3/roles => generated 234 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:53.005358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.042468 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3805/7645] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:52 2022] GET /identity/v3/roles => generated 2548 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:53.053230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.055860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613eeb6-f753-44a6-8427-d258fee08013 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.067707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.068715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.071239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.071614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/f552f706387c4fe889d24baa6a158700` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.076845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:update_role(role_id=f552f706387c4fe889d24baa6a158700)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.090473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd11a1-f9cd-420a-a55b-99794bff4280 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.090663 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:53.090663 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:53.090663 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:53.091438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.103189 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:53.107708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.108568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.108845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.109273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] PATH_INFO: `/v3/projects/891fd3386419434180b40a36c49ccc46/users/dde2b0c1b63c49589d01e638911ce477/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.155097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891fd3386419434180b40a36c49ccc46, user_id=dde2b0c1b63c49589d01e638911ce477, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.167527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3841/7646] 10.222.0.27 () {60 vars in 1242 bytes} [Sun Jul 24 01:43:53 2022] PATCH /identity/v3/roles/f552f706387c4fe889d24baa6a158700 => generated 237 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:53.168759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616eea0-8ebc-467b-ac92-372479a89ba1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.171569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.184511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c57bba-e7ca-440a-a88e-2ff85ead031a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.192130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.207698 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3806/7647] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:43:53 2022] PUT /identity/v3/projects/891fd3386419434180b40a36c49ccc46/users/dde2b0c1b63c49589d01e638911ce477/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:53.214730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.217507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.218057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.218591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.222352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.222650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/f552f706387c4fe889d24baa6a158700` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.249103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:get_role(role_id=f552f706387c4fe889d24baa6a158700)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.251618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.256271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3842/7648] 10.222.0.27 () {58 vars in 1220 bytes} [Sun Jul 24 01:43:53 2022] GET /identity/v3/roles/f552f706387c4fe889d24baa6a158700 => generated 237 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:53.257157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.284317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a863ff7-e937-4060-9836-ba36f4fc5ab0 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.293793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] MFA Rules not processed for user `dde2b0c1b63c49589d01e638911ce477`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:53.298359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:53.467005 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:53.493553 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3807/7649] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:53.512151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.514112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:53.566038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.576967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.576967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.576967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.576967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.576967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.633285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3843/7650] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:43:53 2022] GET /identity/v3/roles => generated 2551 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:43:53.634219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.660313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f6afb-3efb-4e50-82a1-afe2ff89dc49 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.664769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.665583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.665904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.666178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.669138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abee43-a8e6-4e11-ab60-77ba6e11e056 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:53.694821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:53.695809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:53.696106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:53.696387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/f552f706387c4fe889d24baa6a158700` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:53.700977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f552f706387c4fe889d24baa6a158700)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.710760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.792152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:53.794556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:53.808561 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3808/7651] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:43:53.852530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role f552f706387c4fe889d24baa6a158700 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:53.852864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:53.853826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:53.867640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3844/7652] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:53 2022] DELETE /identity/v3/roles/f552f706387c4fe889d24baa6a158700 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:53.869091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:53.903479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad284-95c8-4545-9f84-f370db770978 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:54.121164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:54.121164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:54.121164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:54.121592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:54.130449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:54.136228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:54.233447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3809/7653] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:53 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 521 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:54.237870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:54.239589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:54.263337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f1c30-1777-4c20-b2d2-f44f5da8d79f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:54.460792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:54.462672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:54.462967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:54.463343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:54.466469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:54.468110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:54.561228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:54.574611 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3845/7654] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:54 2022] PUT /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c => generated 521 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:43:54.591860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c32a2d-500e-4d3e-88e2-ddc07ed9ee88 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:54.672415 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:54.706458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:54.708506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:54.747354 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:54.806932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:54.808502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:54.808791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:54.809071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:54.811086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4ad5525c920f47a48c1e4e52d81ee44c, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:54.813699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:54.845549 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3810/7655] 10.222.0.27 () {60 vars in 1362 bytes} [Sun Jul 24 01:43:54 2022] PUT /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 520 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:43:54.849519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:54.933396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d1f1-7198-407e-b4dc-2febdd291c45 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:54.939784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:54.941238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:54.941629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:54.942030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:54.943814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:54.944955 n-d-master-1 devstack@keystone.service[80591]: WARNING py.warnings [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:54.944955 n-d-master-1 devstack@keystone.service[80591]: warnings.warn(msg) Jul 24 01:43:54.944955 n-d-master-1 devstack@keystone.service[80591]: Jul 24 01:43:54.946227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:54.956360 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3811/7656] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:43:54 2022] GET /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies => generated 489 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:54.960290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:54.978583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ac0f6-62d7-4d8b-b9f1-42581d005550 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:54.992228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:54.994456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.007653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.007653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.007653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=0e2171ed24284418880a91d573e49ec7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:55.007653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:55.038276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c3f-065c-4e2d-9734-70fc01b5b2a3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:55.039769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3812/7657] 10.222.0.27 () {58 vars in 1244 bytes} [Sun Jul 24 01:43:54 2022] GET /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies => generated 661 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:43:55.043683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:55.073624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9833b-011b-4899-87c0-c6b47d128285 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:55.088107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:55.089300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.089892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.090372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.093461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4ad5525c920f47a48c1e4e52d81ee44c, implied_role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:55.102058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:55.131433 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3813/7658] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:55 2022] DELETE /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c/implies/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:55.132786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:55.306030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a112609-3e6f-41ff-80c7-3522c9c1d9ee tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:55.311785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:55.313036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.313326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.313608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.316001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:55.317618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:55.324442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:55.325425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.327147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.327465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] PATH_INFO: `/v3/users/f042fcd9a7d44a42a862e0ca8eb06c3a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.332134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f042fcd9a7d44a42a862e0ca8eb06c3a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:55.338924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3814/7659] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:55 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/4ad5525c920f47a48c1e4e52d81ee44c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:55.342165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:55.346141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:55.434026 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:55.480685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f042fcd9a7d44a42a862e0ca8eb06c3a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:55.481047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f042fcd9a7d44a42a862e0ca8eb06c3a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:55.540421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f042fcd9a7d44a42a862e0ca8eb06c3a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:55.578379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f042fcd9a7d44a42a862e0ca8eb06c3a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:55.587406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ab1d-c367-44d6-ac3e-d929aebbaae3 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:55.600296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:55.603498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.603498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.612763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.618523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e2171ed24284418880a91d573e49ec7, implied_role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:55.624306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:55.635088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bec834f7-dd95-40c1-a1b4-b7ab38606dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f042fcd9a7d44a42a862e0ca8eb06c3a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:55.652397 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3815/7660] 10.222.0.27 () {58 vars in 1346 bytes} [Sun Jul 24 01:43:55 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7/implies/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:55.653896 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3846/7661] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:54 2022] DELETE /identity/v3/users/f042fcd9a7d44a42a862e0ca8eb06c3a => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:55.663883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:55.666561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:55.674709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:55.675407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:55.675755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:55.705873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:55.707082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:55.780321 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:55.898526 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3847/7662] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:43:55.898738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a19ef-26a5-4d3f-9ac1-7b7a0796147f tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:55.916135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:55.917738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:56.139010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:56.140003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:56.140422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:56.140792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/4429ea6860f344e6be30b15ebd73dede` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:56.155067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821e198-feb5-478a-889b-2e968e9d36b2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:56.166513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:43:56.184441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:56.185593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:56.186121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:56.186696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Could not find domain: 4429ea6860f344e6be30b15ebd73dede.: keystone.exception.DomainNotFound: Could not find domain: 4429ea6860f344e6be30b15ebd73dede. Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4429ea6860f344e6be30b15ebd73dede. Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:43:56.202140 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:43:56.203795 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application with Lock( Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4429ea6860f344e6be30b15ebd73dede. Jul 24 01:43:56.205577 n-d-master-1 devstack@keystone.service[80591]: ERROR keystone.server.flask.application Jul 24 01:43:56.207128 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3816/7663] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:43:55 2022] PATCH /identity/v3/domains/4429ea6860f344e6be30b15ebd73dede => generated 112 bytes in 551 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:43:56.210007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:56.226312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689adba7-08d1-47bb-adc8-51b3101147ff tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:56.242059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:56.243666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:56.243859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:56.245547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:56.245547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:56.245547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/users/68fad852a63248c18c4b2959105a7c27` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:56.248564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_user(user_id=68fad852a63248c18c4b2959105a7c27)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:56.276172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:56.302153 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3848/7664] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:56.355907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.376134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.378796 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:56.387781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.420837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.422698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fad852a63248c18c4b2959105a7c27'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.468060 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3817/7665] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:56 2022] DELETE /identity/v3/users/68fad852a63248c18c4b2959105a7c27 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:56.473276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:56.491268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2c0c-1f5c-4c4b-99d6-7717e60d73bc service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:56.703081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:56.705098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:56.705429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:56.709009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/9d7fdae1d7154409885fe3d6ab472608` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:56.717637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9d7fdae1d7154409885fe3d6ab472608)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:56.726840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:56.759690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:56.761400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:56.845630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 9d7fdae1d7154409885fe3d6ab472608 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:56.845891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.847820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:56.853551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3849/7666] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:56 2022] DELETE /identity/v3/roles/9d7fdae1d7154409885fe3d6ab472608 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:56.857574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:56.860744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:56.975233 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:57.011057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c99f3-3c92-4236-9795-ac306342d5ae tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:57.028369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d91c-ccae-4f71-bf97-93d453699545 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:57.036927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:57.038458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:57.039353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:57.040163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:57.041958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1ef54c40c56f4025b98b11e11b6e14c3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:57.045021 n-d-master-1 devstack@keystone.service[80590]: WARNING py.warnings [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:43:57.045021 n-d-master-1 devstack@keystone.service[80590]: warnings.warn(msg) Jul 24 01:43:57.045021 n-d-master-1 devstack@keystone.service[80590]: Jul 24 01:43:57.045504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:57.192486 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3850/7667] 10.222.0.27 () {58 vars in 1226 bytes} [Sun Jul 24 01:43:56 2022] DELETE /identity/v3/groups/1ef54c40c56f4025b98b11e11b6e14c3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:57.193589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:57.198208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:57.199934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:57.200837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:57.201118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:57.201397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] PATH_INFO: `/v3/users/562ec59ea7ce4a2a826c681069dc2318` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:57.206173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ec59ea7ce4a2a826c681069dc2318)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:57.208121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:57.376173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ec59ea7ce4a2a826c681069dc2318'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.392781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ec59ea7ce4a2a826c681069dc2318'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.405385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ec59ea7ce4a2a826c681069dc2318'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.429599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ec59ea7ce4a2a826c681069dc2318'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.435410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ec59ea7ce4a2a826c681069dc2318'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.438534 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:57.443497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3818/7668] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:56 2022] DELETE /identity/v3/users/562ec59ea7ce4a2a826c681069dc2318 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:57.448047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:57.457337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:57.486767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9479b6d-c545-48ca-91dd-490dcf25c9b2 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:57.616388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318768ce-2ab4-44ea-91b1-f3a95daee3b4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:57.631848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:57.633511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:57.633511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:57.633511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/projects/f17f471b5368454d8e75d5158ab8ae7f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:57.634814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f17f471b5368454d8e75d5158ab8ae7f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:57.636764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:57.699873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17f471b5368454d8e75d5158ab8ae7f', 'request_id': 'req-b4e10f96-b06a-4553-98b6-0c0ded1746f6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.708442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17f471b5368454d8e75d5158ab8ae7f', 'request_id': 'req-b4e10f96-b06a-4553-98b6-0c0ded1746f6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.716923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17f471b5368454d8e75d5158ab8ae7f', 'request_id': 'req-b4e10f96-b06a-4553-98b6-0c0ded1746f6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.734016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] The token cache is being invalidate because project f17f471b5368454d8e75d5158ab8ae7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:57.734016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.735474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b4e10f96-b06a-4553-98b6-0c0ded1746f6 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.737230 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3819/7669] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:57 2022] DELETE /identity/v3/projects/f17f471b5368454d8e75d5158ab8ae7f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:57.742355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:57.742913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:57.743202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:57.754009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:57.754920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:57.755642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:57.755642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] PATH_INFO: `/v3/projects/8d511f78873040e7afe04b5b9c49fab1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:57.761485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d511f78873040e7afe04b5b9c49fab1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:57.763527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:57.764262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:57.766188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:57.880962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d511f78873040e7afe04b5b9c49fab1', 'request_id': 'req-d794865a-36e7-45b3-8037-ae698e1267fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.887681 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:57.898607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d511f78873040e7afe04b5b9c49fab1', 'request_id': 'req-d794865a-36e7-45b3-8037-ae698e1267fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.915932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d511f78873040e7afe04b5b9c49fab1', 'request_id': 'req-d794865a-36e7-45b3-8037-ae698e1267fe'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.943315 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3820/7670] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:43:57.944512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:57.946565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:57.956184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] The token cache is being invalidate because project 8d511f78873040e7afe04b5b9c49fab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:57.956474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.964250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:57.965097 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3851/7671] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:57 2022] DELETE /identity/v3/projects/8d511f78873040e7afe04b5b9c49fab1 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:57.968633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:57.974969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:58.026395 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:58.064149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838864c-0531-4586-a3e3-8fec969121fc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:58.135988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794865a-36e7-45b3-8037-ae698e1267fe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:58.144148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:58.144826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:58.145112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:58.145392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:58.158695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:58.171138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:58.173660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:58.176328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:58.176616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:58.180471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0c52dfe7c0664adc8d6edb8b249c0011)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:58.188182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:58.249499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.259064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.263285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:58.265239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:58.277430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3852/7672] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:43:58.278873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:58.280530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:58.296949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bb28-c74d-485d-a119-de5e569a9e32 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:58.333591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.336288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.340770 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3821/7673] 10.222.0.27 () {60 vars in 1248 bytes} [Sun Jul 24 01:43:57 2022] PATCH /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011 => generated 276 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:43:58.345705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:58.349063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:58.493232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:58.494151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:58.494430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:58.494707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] PATH_INFO: `/v3/users/dde2b0c1b63c49589d01e638911ce477` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:58.504244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde2b0c1b63c49589d01e638911ce477)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:58.510239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:58.594278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678518e-a111-4130-8571-edf82f61b227 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:58.611175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:58.617449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:58.618104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:58.621219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:58.623151 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:58.646173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde2b0c1b63c49589d01e638911ce477'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.647194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde2b0c1b63c49589d01e638911ce477'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.660141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde2b0c1b63c49589d01e638911ce477'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.686966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0c52dfe7c0664adc8d6edb8b249c0011)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:58.689663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:58.692533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde2b0c1b63c49589d01e638911ce477'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.754492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.775970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde2b0c1b63c49589d01e638911ce477'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.778580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.795777 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:58.810368 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3853/7674] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:58 2022] DELETE /identity/v3/users/dde2b0c1b63c49589d01e638911ce477 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:58.911806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.921031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:58.924434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:58.925233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.943543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.979399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] The token cache is being invalidate because project 0c52dfe7c0664adc8d6edb8b249c0011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:58.980135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:58.981150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.014432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.015913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.037979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0c52dfe7c0664adc8d6edb8b249c0011', 'request_id': 'req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.049826 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3822/7675] 10.222.0.27 () {58 vars in 1229 bytes} [Sun Jul 24 01:43:58 2022] DELETE /identity/v3/domains/0c52dfe7c0664adc8d6edb8b249c0011 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:59.053447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:59.055574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:59.219902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf6f63-67bc-44ea-86eb-7010f16dc8b4 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:59.225984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:59.227016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:59.227424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:59.227809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:59.228815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34500aa-f095-4688-8f0b-cea6da35b7fe admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:59.229556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4ad5525c920f47a48c1e4e52d81ee44c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:59.231673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:59.277294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 4ad5525c920f47a48c1e4e52d81ee44c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:59.277998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.278691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.282828 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3823/7676] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:59 2022] DELETE /identity/v3/roles/4ad5525c920f47a48c1e4e52d81ee44c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:43:59.298439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:59.303322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:59.322134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:59.323032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:59.323308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:59.323579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] PATH_INFO: `/v3/projects/98b00f5c9a1d43629e74ce8bebc610b0` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:59.325345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b00f5c9a1d43629e74ce8bebc610b0)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:59.330655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:59.442982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b00f5c9a1d43629e74ce8bebc610b0', 'request_id': 'req-b63fae83-892a-414b-b38b-e22b991d9e07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.451001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b00f5c9a1d43629e74ce8bebc610b0', 'request_id': 'req-b63fae83-892a-414b-b38b-e22b991d9e07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.456476 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:59.464067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b00f5c9a1d43629e74ce8bebc610b0', 'request_id': 'req-b63fae83-892a-414b-b38b-e22b991d9e07'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.495663 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:43:59.513203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] The token cache is being invalidate because project 98b00f5c9a1d43629e74ce8bebc610b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:59.526934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.529602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.537502 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3854/7677] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:58 2022] DELETE /identity/v3/projects/98b00f5c9a1d43629e74ce8bebc610b0 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:59.549024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:59.553437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:59.565751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d3cb-83cc-4ec1-8721-ad189162081a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:59.716856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:59.720055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:59.720598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:59.721085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/b8d2facd23154664bbd3f7a420dfdb2e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:59.726456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b8d2facd23154664bbd3f7a420dfdb2e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:59.728444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:59.745887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fae83-892a-414b-b38b-e22b991d9e07 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:43:59.757431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:43:59.759105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:59.759708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:59.760102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] PATH_INFO: `/v3/projects/891fd3386419434180b40a36c49ccc46` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:59.761792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=891fd3386419434180b40a36c49ccc46)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:43:59.767427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:43:59.851463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role b8d2facd23154664bbd3f7a420dfdb2e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:59.854274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.855635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891fd3386419434180b40a36c49ccc46', 'request_id': 'req-73d35e5e-f62a-478e-8087-55f1b530fb4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.857137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-638d4d4b-6c7b-470d-b1bf-ca695202e72a tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.860422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3824/7678] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:59 2022] DELETE /identity/v3/roles/b8d2facd23154664bbd3f7a420dfdb2e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:59.861800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ad1-7bd0-4f84-9959-6e03ecc33773 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:43:59.862016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ad1-7bd0-4f84-9959-6e03ecc33773 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:43:59.862295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ad1-7bd0-4f84-9959-6e03ecc33773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:43:59.869933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891fd3386419434180b40a36c49ccc46', 'request_id': 'req-73d35e5e-f62a-478e-8087-55f1b530fb4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.885407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891fd3386419434180b40a36c49ccc46', 'request_id': 'req-73d35e5e-f62a-478e-8087-55f1b530fb4d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.904317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cdaf9ad1-7bd0-4f84-9959-6e03ecc33773 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:43:59.908456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cdaf9ad1-7bd0-4f84-9959-6e03ecc33773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:43:59.909035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] The token cache is being invalidate because project 891fd3386419434180b40a36c49ccc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:43:59.909333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.910622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:43:59.913585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3855/7679] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:43:59 2022] DELETE /identity/v3/projects/891fd3386419434180b40a36c49ccc46 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:43:59.914422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:43:59.920487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.052007 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3825/7680] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:00.053578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3c42-9949-4531-8ee9-e869105c0dd8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.054122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3c42-9949-4531-8ee9-e869105c0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.054595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3c42-9949-4531-8ee9-e869105c0dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.085898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35e5e-f62a-478e-8087-55f1b530fb4d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.113034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-253b3c42-9949-4531-8ee9-e869105c0dd8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:00.114297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-253b3c42-9949-4531-8ee9-e869105c0dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.123136 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:00.129845 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3826/7681] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:00.131173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e76a-c932-4063-adbf-6d416a5fa7d5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.131463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e76a-c932-4063-adbf-6d416a5fa7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.131741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e76a-c932-4063-adbf-6d416a5fa7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.166186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3ee3e76a-c932-4063-adbf-6d416a5fa7d5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:00.167397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ee3e76a-c932-4063-adbf-6d416a5fa7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.177867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3827/7682] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:00.179158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.179446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.179718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.204288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:00.205641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.208220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6260cefc34e84e16b83f93d940f3f390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43063a0934f647ac8fb5a495b83462ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.209174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.209526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.209917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] PATH_INFO: `/v3/roles/0e2171ed24284418880a91d573e49ec7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.215587 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3828/7683] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:00.216438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.220357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0e2171ed24284418880a91d573e49ec7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.222113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.228786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb351-9d8e-4599-86bb-37e4c41c5d5b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.240063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.241056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.241505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.242321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.243538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:00.244251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.246087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.265855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3829/7684] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:00.268388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.287173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f78742-4a6f-4bd8-bd6e-392f7a951ff0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.294396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.294946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invalidating the token cache because role 0e2171ed24284418880a91d573e49ec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:00.295241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.295489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.295989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.296271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.298426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:00.298748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.300561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.303582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.306180 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3856/7685] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:43:59 2022] DELETE /identity/v3/roles/0e2171ed24284418880a91d573e49ec7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:00.307063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.311450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.321396 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3830/7686] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:00.322373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.324819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.340259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9e9-00f1-4c0e-806e-03d3ec4969d3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.356999 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:00.439757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3452-4859-48a6-ab47-f9367d81ef56 tempest-RolesV3TestJSON-1458191333 tempest-RolesV3TestJSON-1458191333-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.444315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.446774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.447361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.448277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] PATH_INFO: `/v3/users/223a8d5510844f6a8f5a5be83cca55b8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.449503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.450104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223a8d5510844f6a8f5a5be83cca55b8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.450683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.450969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.451248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.452110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.453930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.455055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.503453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3857/7687] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/projects => generated 357 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:00.504752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.513993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.581447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223a8d5510844f6a8f5a5be83cca55b8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.600469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223a8d5510844f6a8f5a5be83cca55b8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.615502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223a8d5510844f6a8f5a5be83cca55b8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.636580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223a8d5510844f6a8f5a5be83cca55b8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.637913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223a8d5510844f6a8f5a5be83cca55b8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.639728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bedbe9-9f94-456e-b712-6b9ae08ccd60 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.645287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.646128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.646411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.646686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.647385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.650123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.656887 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3831/7688] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:00 2022] DELETE /identity/v3/users/223a8d5510844f6a8f5a5be83cca55b8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:00.658085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.659976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.691054 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3858/7689] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:00.695017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.699819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.708217 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:00.758007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9f2d-65c5-488a-b3df-a04e010459e6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.793152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1f43-5441-4e29-b953-ddbb7a7e95f5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:00.799709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.800688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.800978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.801262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] PATH_INFO: `/v3/users/3a37e2676b9e40dd852e0ccb6c81192b` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.802739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a37e2676b9e40dd852e0ccb6c81192b)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.804684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.834758 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:00.872487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:00.873607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.874284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.875709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.876980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:00.879625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d334e1-7191-40c3-a3da-1beaae97a25c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:00.899436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a37e2676b9e40dd852e0ccb6c81192b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.900260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a37e2676b9e40dd852e0ccb6c81192b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.911927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a37e2676b9e40dd852e0ccb6c81192b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.914800 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3832/7690] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/users => generated 279 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:00.916935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:00.917937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:00.918553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:00.920901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a37e2676b9e40dd852e0ccb6c81192b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.941217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:00.943200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.948410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a37e2676b9e40dd852e0ccb6c81192b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:00.964514 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3859/7691] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:00 2022] DELETE /identity/v3/users/3a37e2676b9e40dd852e0ccb6c81192b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:00.964514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.967503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:00.981304 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3833/7692] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:00.983704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:00.988648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:01.021708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defcc92-cad0-4e91-8111-c13cfbe67005 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.047169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b4c7-73b1-4ff9-b03b-678342809bee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.052980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.053826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.054323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.054719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.055519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.057927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ebf39-e94f-4982-8f02-eb4b1e4942ae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.086308 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3860/7693] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:00 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:01.086308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.086308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.086308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.107765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.108746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.109515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.110004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.110356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:01.111429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.112085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:01.113593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.133010 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3861/7694] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:01.136639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.138535 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3834/7695] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:01.143336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:01.144863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.151478 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:01.159352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89e13-0c02-4d14-96bf-66c7a6c76a0c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.166945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.168311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.168839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.169344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.170386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.174302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.193039 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3835/7696] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:01.194072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.207150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72d9a-28db-4fa2-b695-d335e591640b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.213081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.214355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.214909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.215317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.216069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.218380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.232587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834bb1a-5a0b-44bc-888a-8b88ed048ad5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.233694 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3836/7697] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:01.235318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.241422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.242244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.242624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.243114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.248889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d293d12-d773-4a7f-986e-912c089de553 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.255055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.255450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.255713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.256001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.256285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.257279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.267990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.269473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.270220 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3862/7698] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:01.271113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.286292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abfa81-b5ae-4124-aba4-a7a2478f6670 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.291195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.292096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.292376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.292651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] PATH_INFO: `/v3/projects/f932a938857141f38b17f242b1ad12ed/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.294032 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3837/7699] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:01.295930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.309910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f932a938857141f38b17f242b1ad12ed, user_id=3b801c4ee01f44c7b4bd1ae5ab5c3e3f, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.310644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee997f-b64a-4867-887d-59bc90383233 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.314764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.316786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.318169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.318974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.319585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] PATH_INFO: `/v3/projects/7b5b3a70865d44aba9d237aeac80b066/users/f0d48f4a8ba2418f9f79e5e097de9326/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.337466 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3863/7700] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:01 2022] PUT /identity/v3/projects/f932a938857141f38b17f242b1ad12ed/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:01.341591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.345423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5b3a70865d44aba9d237aeac80b066, user_id=f0d48f4a8ba2418f9f79e5e097de9326, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.348694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2256-28ec-43a7-9faa-f534b6dd3567 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.390968 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3838/7701] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:01 2022] PUT /identity/v3/projects/7b5b3a70865d44aba9d237aeac80b066/users/f0d48f4a8ba2418f9f79e5e097de9326/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:01.413094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.418901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.419528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.513900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] MFA Rules not processed for user `f0d48f4a8ba2418f9f79e5e097de9326`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:01.518742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:01.521519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b674-98f5-491e-aa64-c884b8d9797f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.700094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.701139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.702943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.704614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.706024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.707129 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:01.707898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.743964 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3864/7702] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:01.744922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.751426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:01.768018 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3839/7703] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:01.771486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.780743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b3b0-6bc3-405d-9ba0-470b69ff5b74 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.794539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.795390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.795675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.795949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] PATH_INFO: `/v3/projects/e2d7da6eee884068adb42a735089bf08` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.798655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d7da6eee884068adb42a735089bf08)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.800807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.808339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4acb3-31fb-4181-9272-887b7304f218 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:01.824448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:01.829704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.830327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.831971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] PATH_INFO: `/v3/projects/f932a938857141f38b17f242b1ad12ed/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:01.846668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f932a938857141f38b17f242b1ad12ed, user_id=3b801c4ee01f44c7b4bd1ae5ab5c3e3f, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:01.862434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:01.884758 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:01.888455 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3840/7704] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:01 2022] PUT /identity/v3/projects/f932a938857141f38b17f242b1ad12ed/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:01.889539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:01.923775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d7da6eee884068adb42a735089bf08', 'request_id': 'req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:01.931374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d7da6eee884068adb42a735089bf08', 'request_id': 'req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:01.941653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d7da6eee884068adb42a735089bf08', 'request_id': 'req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:01.957293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] The token cache is being invalidate because project e2d7da6eee884068adb42a735089bf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:01.957742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:01.958661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fbed32a7-861d-4dc7-8d37-44efd4b7fc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:01.960753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3865/7705] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:01 2022] DELETE /identity/v3/projects/e2d7da6eee884068adb42a735089bf08 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:01.961916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d8df-49bf-4ba8-9ec1-f81be2a9b791 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:01.962235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d8df-49bf-4ba8-9ec1-f81be2a9b791 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:01.962517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6d8df-49bf-4ba8-9ec1-f81be2a9b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.003815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6ab6d8df-49bf-4ba8-9ec1-f81be2a9b791 None None] MFA Rules not processed for user `3b801c4ee01f44c7b4bd1ae5ab5c3e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:02.005033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ab6d8df-49bf-4ba8-9ec1-f81be2a9b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.020483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a4137-ac78-42bf-9b71-f310fa41c6e4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.192712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.193386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.193695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.193970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.194948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.197943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.226771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3866/7706] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:02.228596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.228988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.229430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.260441 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3841/7707] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:01 2022] POST /identity/v3/projects => generated 355 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:02.260441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.261884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.286976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:02.288247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.366918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698a97-6052-4e34-a33e-f131df009e98 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.372567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.373625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.374100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.375146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] PATH_INFO: `/v3/projects/11288988e5e04a63a792695353e17b31` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.375857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3867/7708] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:02.376692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.377997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.383009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11288988e5e04a63a792695353e17b31)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.390829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.391778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d39741-9348-41aa-af97-168036037fe9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.396909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.397696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.398047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.398599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.399387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.401363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.418190 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:02.447694 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3868/7709] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:02.454619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.459013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.486543 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:02.491530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11288988e5e04a63a792695353e17b31', 'request_id': 'req-8c29ee36-fd4b-4619-828f-93425eb53292'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.502804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11288988e5e04a63a792695353e17b31', 'request_id': 'req-8c29ee36-fd4b-4619-828f-93425eb53292'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.514898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11288988e5e04a63a792695353e17b31', 'request_id': 'req-8c29ee36-fd4b-4619-828f-93425eb53292'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.536219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] The token cache is being invalidate because project 11288988e5e04a63a792695353e17b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:02.536505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.537341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8c29ee36-fd4b-4619-828f-93425eb53292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.539195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3842/7710] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:02 2022] DELETE /identity/v3/projects/11288988e5e04a63a792695353e17b31 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:02.543281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.543611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.543843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.578655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868a86-a005-49ae-8870-14bd0f2c9668 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.580711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:02.581911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.668442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.669560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.670392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.670680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.672205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.675039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.681752 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3843/7711] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:02.682677 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.684022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.699891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b42fe-4494-48aa-a65a-db5c03615efc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.707012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3869/7712] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:02.707012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.707553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.708430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.709218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.709613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.710021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.710860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.713697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.725308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87926b-2fd3-4ec2-8622-17fb41ce5abc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.733334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.734946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.735373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.735741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] PATH_INFO: `/v3/users/6260cefc34e84e16b83f93d940f3f390` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.737097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6260cefc34e84e16b83f93d940f3f390)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.740083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.749079 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3844/7713] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:02.751552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.763394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846bb5c-9fc0-443d-b142-bc8998f0ee14 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.769594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.771138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.771903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.772435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.773315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:02.773854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.775497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.792269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3845/7714] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:02.793221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.794956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.804756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6260cefc34e84e16b83f93d940f3f390'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.805853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6260cefc34e84e16b83f93d940f3f390'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.809327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4743a6-122a-4b56-8700-1e22a75bc617 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.814716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.815610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.815901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.816180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.817273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.818434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6260cefc34e84e16b83f93d940f3f390'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.819181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.832078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3846/7715] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:02.832941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.834688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.841355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6260cefc34e84e16b83f93d940f3f390'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.849345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d46a4-35bb-4258-b4a2-c3d63449532d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.855526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:02.856623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:02.856989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:02.857284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:02.858264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:02.860439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:02.869971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6260cefc34e84e16b83f93d940f3f390'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:02.882304 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3870/7716] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:02 2022] DELETE /identity/v3/users/6260cefc34e84e16b83f93d940f3f390 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:02.883333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.885166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.894212 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3847/7717] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:02.899992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:02.907349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:02.922634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:02.937174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a59f-6379-4d7e-8a9b-4bd808b22c9b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:02.990379 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:03.002583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48bdc9-e8e9-4c30-8e51-369646e2132c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.012342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.013501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.014240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.017993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.018310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.019124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.021122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.021892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.022589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.023196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] PATH_INFO: `/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1/users/acf08922664e4e60a51bf7726027fa1d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.047363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754d4ef8e3684b96afe47d85f0bea5d1, user_id=acf08922664e4e60a51bf7726027fa1d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.051483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.071758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3871/7718] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:02 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:03.073971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.088927 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3848/7719] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:02 2022] PUT /identity/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1/users/acf08922664e4e60a51bf7726027fa1d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:03.091009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.223088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00785d-87ca-4dd4-adfa-b6f3f175e0bf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.244443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ca0b4-15d9-4c56-a7f3-43bf54b3fe66 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.259588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.260426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.260712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.260984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.261719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.263783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.330352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3849/7720] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:03 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:03.331312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.363080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bfb4-eae4-41eb-9d44-6c6911e96e49 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.382305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.383042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.383254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.383530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.387290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.392339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.403272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.404415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.404917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.405404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.406723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.408545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.424474 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3850/7721] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:03.426145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.436455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3872/7722] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:03.439043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.446216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064123e-2080-448a-9e1d-4da80a9960ec admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.459091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d503e-ad2d-4fdf-a05a-842483d4c508 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.461552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.462369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.462948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.463303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.464585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.466707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.478386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.479465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.479842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.480215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] PATH_INFO: `/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1/users/acf08922664e4e60a51bf7726027fa1d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.483459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=754d4ef8e3684b96afe47d85f0bea5d1, user_id=acf08922664e4e60a51bf7726027fa1d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.488872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.494303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3851/7723] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:03.498186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.500221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:03.509818 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3873/7724] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:03 2022] PUT /identity/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1/users/acf08922664e4e60a51bf7726027fa1d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:03.510907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.524568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1abd3-fd6c-426a-8cf6-d5ecd9878e72 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.583716 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:03.590920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.592277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.592844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.594083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] PATH_INFO: `/v3/projects/43063a0934f647ac8fb5a495b83462ea` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.595694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43063a0934f647ac8fb5a495b83462ea)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.598030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.616181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5dd01-1cd9-49e2-a8bb-c06485004b0a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.622583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.623491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.626680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.626680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] PATH_INFO: `/v3/projects/1bd2abe562274ec98b5ce15ce07d163d/users/a8cc58115d144c5c972b9e3e2119e5ec/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.652236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd2abe562274ec98b5ce15ce07d163d, user_id=a8cc58115d144c5c972b9e3e2119e5ec, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.657017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.662974 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:03.679064 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3874/7725] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:03 2022] PUT /identity/v3/projects/1bd2abe562274ec98b5ce15ce07d163d/users/a8cc58115d144c5c972b9e3e2119e5ec/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:03.679823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.682731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43063a0934f647ac8fb5a495b83462ea', 'request_id': 'req-53427505-e912-42e6-ba3d-0f905d61f8c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:03.693516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43063a0934f647ac8fb5a495b83462ea', 'request_id': 'req-53427505-e912-42e6-ba3d-0f905d61f8c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:03.700817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43063a0934f647ac8fb5a495b83462ea', 'request_id': 'req-53427505-e912-42e6-ba3d-0f905d61f8c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:03.721646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] The token cache is being invalidate because project 43063a0934f647ac8fb5a495b83462ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:03.722146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:03.722980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-53427505-e912-42e6-ba3d-0f905d61f8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:03.726165 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3852/7726] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:03 2022] DELETE /identity/v3/projects/43063a0934f647ac8fb5a495b83462ea => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:03.728693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e70e5-e9b8-4165-a612-a1f1ff4ec4f3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.729454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e70e5-e9b8-4165-a612-a1f1ff4ec4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.729884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e70e5-e9b8-4165-a612-a1f1ff4ec4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.772842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ed9e70e5-e9b8-4165-a612-a1f1ff4ec4f3 None None] MFA Rules not processed for user `acf08922664e4e60a51bf7726027fa1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:03.774293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed9e70e5-e9b8-4165-a612-a1f1ff4ec4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:03.799141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294e12b-1697-4283-a402-46ed1d34d95d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.804251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.805008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.805357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.805718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.806532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:03.808234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeae65-45c8-467e-9b1f-59c3eeec278f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:03.820959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3875/7727] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:03.822770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.823162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.823812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.855847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] MFA Rules not processed for user `a8cc58115d144c5c972b9e3e2119e5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:03.857653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:03.909862 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3853/7728] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:03.913985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.914552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.915143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.939121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3876/7729] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:03.940508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.942193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:03.959809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:03.961118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:03.961370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f364-df5c-4049-a765-8493709d0da1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:03.966475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:03.967392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:03.967672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:03.967953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] PATH_INFO: `/v3/projects/a27951eb7d58435681336ba0f8774b17/users/769bcdd2b058414380c3dccf14be7fa9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:03.982458 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3854/7730] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:03.985755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:03.990692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.002396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27951eb7d58435681336ba0f8774b17, user_id=769bcdd2b058414380c3dccf14be7fa9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.005305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.027835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3877/7731] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:03 2022] PUT /identity/v3/projects/a27951eb7d58435681336ba0f8774b17/users/769bcdd2b058414380c3dccf14be7fa9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:04.028764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.031493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.061247 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:04.094215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a1d4-c2ae-4682-8446-41eea4194c3a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.149062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df46d8f-bdb2-4635-9478-4363ae4db4af admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.158718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.159688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.162095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.162485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.167185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.190905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.191387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.194015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.195098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.229366 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:04.282645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.285199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b433bb-840e-4bb9-89bb-6e5852562fc8 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.295934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.298128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6b75-7aae-4cee-a144-4630369dbb05 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.310422 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3855/7732] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:03 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:04.311798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.312124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.312448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.322151 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3878/7733] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:04.326308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.329911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.330337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.353330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:04.357728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.374194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:04.375519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.536036 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3856/7734] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:04.542224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.544846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.550611 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3879/7735] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:04.551909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.575413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3f77-78e4-452a-8437-c9e490fe3c95 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.576080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aff63-c101-4a51-8811-ffe376ff902f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.581391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.582220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.583243 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.583377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.583738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.584005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.584684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.584810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:04.585250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.585792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.586762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.589734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.603544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3880/7736] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:04.605063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.608213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:04.691797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.697024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.728462 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3857/7737] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:04.729435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.742771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c7257-98e3-4624-b3e9-3e9921aa58c2 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.749178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.750059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.750441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.750812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.752253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.754024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f8ac-668d-47a8-a9a9-d65cdfa84f45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.755514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.758678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.759295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.759998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.760489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.773575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.775177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:04.794624 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3881/7738] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:04.804573 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3858/7739] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:04 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:04.805881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:04.819089 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:04.832650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d216b8-8676-4e6a-a99f-f9807f952775 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:04.939426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:04.940013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:04.940299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:04.940575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:04.941278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:04.943690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.022290 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3882/7740] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:04 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:05.025062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.050275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ba74e-2d47-42f7-81c8-cddf355c514c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.060242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.063599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.065843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.066198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.067587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:05.071463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.100056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3859/7741] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:05.100892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.121701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9962c-40b1-4111-8ae1-b3f55dd090e3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.135758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.136447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.136723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.137004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.137773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:05.139397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eddda-73b0-4b3e-9a37-548b4a14845c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.185739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3883/7742] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:44:05.188595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.211265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce3797-038c-4e57-b2e6-92c826f33c66 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.234393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.236199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.236461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.236762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] PATH_INFO: `/v3/projects/d126e0726bd04d63aa0e2cbd9f85bdac/users/cacd7f52b9f34549a08abf473a5c5979/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.271861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d126e0726bd04d63aa0e2cbd9f85bdac, user_id=cacd7f52b9f34549a08abf473a5c5979, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:05.275793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.279294 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:05.321650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3860/7743] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:05 2022] PUT /identity/v3/projects/d126e0726bd04d63aa0e2cbd9f85bdac/users/cacd7f52b9f34549a08abf473a5c5979/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:05.335958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.336407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.336691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.353727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.356434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.398434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] MFA Rules not processed for user `cacd7f52b9f34549a08abf473a5c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:05.401959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.460626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb9c3-7df8-4af3-904e-cd01cd3c9ab0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.468038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.470374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.471049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.471745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] PATH_INFO: `/v3/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.473458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b801c4ee01f44c7b4bd1ae5ab5c3e3f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:05.476666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.553994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b801c4ee01f44c7b4bd1ae5ab5c3e3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.571695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b801c4ee01f44c7b4bd1ae5ab5c3e3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.598155 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3884/7744] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:05.601591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b801c4ee01f44c7b4bd1ae5ab5c3e3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.603260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.612549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.652005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b801c4ee01f44c7b4bd1ae5ab5c3e3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.652824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b801c4ee01f44c7b4bd1ae5ab5c3e3f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.668958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb720-2ace-452f-ba7e-30074ed3000a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.674796 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3861/7745] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:05 2022] DELETE /identity/v3/users/3b801c4ee01f44c7b4bd1ae5ab5c3e3f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:05.678467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.680405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.805639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.806778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.807065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.807523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] PATH_INFO: `/v3/users/e35dff0e8793481a907ef2d6b1e31e0e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.809918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8565-6337-4107-a17b-8a70e6221777 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.813756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35dff0e8793481a907ef2d6b1e31e0e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:05.815885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:05.816092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfa0e-eafc-46df-8613-8ff24b7bb3e6 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacd7f52b9f34549a08abf473a5c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.816829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfa0e-eafc-46df-8613-8ff24b7bb3e6 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.817357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfa0e-eafc-46df-8613-8ff24b7bb3e6 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.817799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfa0e-eafc-46df-8613-8ff24b7bb3e6 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] PATH_INFO: `/v3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.819701 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3862/7746] 10.222.0.27 () {58 vars in 1103 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3 => generated 255 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:05.820940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.821224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.821494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.844098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:05.844745 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:05.846909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.867205 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3863/7747] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:05.877995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.898540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6d75-ef72-43d7-9e54-6c7109a733f9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:05.909548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacd7f52b9f34549a08abf473a5c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:05.912027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:05.912331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:05.912647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] PATH_INFO: `/v3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:05.914057 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3864/7748] 10.222.0.27 () {58 vars in 1103 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3 => generated 255 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:05.920580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35dff0e8793481a907ef2d6b1e31e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.922932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.924333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35dff0e8793481a907ef2d6b1e31e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.924866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:05.939791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35dff0e8793481a907ef2d6b1e31e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.949150 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:05.951671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35dff0e8793481a907ef2d6b1e31e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.976480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35dff0e8793481a907ef2d6b1e31e0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:05.993334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3885/7749] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:05 2022] DELETE /identity/v3/users/e35dff0e8793481a907ef2d6b1e31e0e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:05.994444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:05.997924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:06.052411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95b21b-1171-404d-b375-a87cb8a1a0d7 tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:06.128806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ceb06-d7e5-4bbb-a61e-1164cb4fc2c6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:06.140054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810e940-9c68-4386-87b5-60df60fb73be tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacd7f52b9f34549a08abf473a5c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:06.141326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810e940-9c68-4386-87b5-60df60fb73be tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.141615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810e940-9c68-4386-87b5-60df60fb73be tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.141921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810e940-9c68-4386-87b5-60df60fb73be tempest-TestApiDiscovery-479777020 tempest-TestApiDiscovery-479777020-project] PATH_INFO: `/v3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.168563 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3886/7750] 10.222.0.27 () {58 vars in 1103 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3 => generated 255 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:06.170092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a672-6fb5-4d0d-a5ef-4f8330e0c31c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.177056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a672-6fb5-4d0d-a5ef-4f8330e0c31c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.178600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8a672-6fb5-4d0d-a5ef-4f8330e0c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.216471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:06.217250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.217387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.217689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.226805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:06.237438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-02b8a672-6fb5-4d0d-a5ef-4f8330e0c31c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:06.239905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-02b8a672-6fb5-4d0d-a5ef-4f8330e0c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:06.406001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:06.407570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:06.415852 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3887/7751] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:06.417315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4701f6-383f-4cfe-b374-d78838d3ecbd None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.417619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4701f6-383f-4cfe-b374-d78838d3ecbd None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.417926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4701f6-383f-4cfe-b374-d78838d3ecbd None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.425947 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3888/7752] 10.222.0.27 () {56 vars in 894 bytes} [Sun Jul 24 01:44:06 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:44:06.427422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab7ca-d8d2-4616-a597-c6803354f01b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.427786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab7ca-d8d2-4616-a597-c6803354f01b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.428015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eab7ca-d8d2-4616-a597-c6803354f01b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.436196 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3889/7753] 10.222.0.27 () {56 vars in 894 bytes} [Sun Jul 24 01:44:06 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:44:06.437736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab7ca-d8d2-4616-a597-c6803354f01b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:06.445115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3865/7754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:06.446296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:06.451505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:06.468796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eab7ca-d8d2-4616-a597-c6803354f01b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:06.472147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fad8-595c-4b83-bb97-6be47c8a8b56 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:06.476738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:06.477409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.477782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.478108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.484895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:06.488910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.489196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.489501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] PATH_INFO: `/v3/users/cacd7f52b9f34549a08abf473a5c5979` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.490954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacd7f52b9f34549a08abf473a5c5979)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:06.494282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:06.499694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:06.501165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469f6c4-2b70-43c8-a5fa-143e1dda9834 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:06.522383 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3890/7755] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:06.562960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacd7f52b9f34549a08abf473a5c5979'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:06.575323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacd7f52b9f34549a08abf473a5c5979'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:06.597235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacd7f52b9f34549a08abf473a5c5979'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:06.611960 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:06.633351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacd7f52b9f34549a08abf473a5c5979'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:06.635492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacd7f52b9f34549a08abf473a5c5979'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:06.654656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:06.655264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:06.655380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:06.657221 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3866/7756] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:06 2022] DELETE /identity/v3/users/cacd7f52b9f34549a08abf473a5c5979 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:06.696608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:06.700208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:06.764657 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:06.893559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3891/7757] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:06.903369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:06.904717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:07.082582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b489c7-aaab-4870-b6b4-bc7a8fa4de1e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:07.094555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:07.095258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:07.095546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:07.095825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:07.116685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:07.122479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:07.146792 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3867/7758] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:07.486150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:07.487956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:07.509413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543bb70-1b36-47f8-a9ef-d69411f8c26d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:07.522103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:07.524090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:07.524386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:07.524864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] PATH_INFO: `/v3/projects/f932a938857141f38b17f242b1ad12ed` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:07.528784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f932a938857141f38b17f242b1ad12ed)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:07.534299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:07.671864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f932a938857141f38b17f242b1ad12ed', 'request_id': 'req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:07.698254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f932a938857141f38b17f242b1ad12ed', 'request_id': 'req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:07.724172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f932a938857141f38b17f242b1ad12ed', 'request_id': 'req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:07.763972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] The token cache is being invalidate because project f932a938857141f38b17f242b1ad12ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:07.764445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:07.765958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:07.773990 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3892/7759] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:07 2022] DELETE /identity/v3/projects/f932a938857141f38b17f242b1ad12ed => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:07.777924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:07.792621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1b49-3ee6-44e2-9b84-1956afb78dfa service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:07.964043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:07.965059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:07.965348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:07.965699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] PATH_INFO: `/v3/users/a8cc58115d144c5c972b9e3e2119e5ec` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:07.967197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cc58115d144c5c972b9e3e2119e5ec)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:07.971164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:08.000224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:08.002044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.024317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723d09-8038-4f6a-ad5b-4bf6dc7f08e6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:08.039961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:08.041649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.042192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.045520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] PATH_INFO: `/v3/projects/d126e0726bd04d63aa0e2cbd9f85bdac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.050095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d126e0726bd04d63aa0e2cbd9f85bdac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:08.055610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:08.076195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cc58115d144c5c972b9e3e2119e5ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.096878 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cc58115d144c5c972b9e3e2119e5ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.122792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cc58115d144c5c972b9e3e2119e5ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.167241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cc58115d144c5c972b9e3e2119e5ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.170861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a3e0da2f-2656-43ef-82be-8c82031a19bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cc58115d144c5c972b9e3e2119e5ec'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.191379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3868/7760] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:07 2022] DELETE /identity/v3/users/a8cc58115d144c5c972b9e3e2119e5ec => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:08.217383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'request_id': 'req-df8d8175-3fb0-4c0c-a514-225f09b05ae2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.237393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'request_id': 'req-df8d8175-3fb0-4c0c-a514-225f09b05ae2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.254357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd126e0726bd04d63aa0e2cbd9f85bdac', 'request_id': 'req-df8d8175-3fb0-4c0c-a514-225f09b05ae2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.282225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] The token cache is being invalidate because project d126e0726bd04d63aa0e2cbd9f85bdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:08.282436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.288461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.302094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e535-298e-47a5-bf9c-f0a8feadedca None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.302458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e535-298e-47a5-bf9c-f0a8feadedca None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.302707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e535-298e-47a5-bf9c-f0a8feadedca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.305473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3893/7761] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:07 2022] DELETE /identity/v3/projects/d126e0726bd04d63aa0e2cbd9f85bdac => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:08.336828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5ba1e535-298e-47a5-bf9c-f0a8feadedca None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:08.348331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:08.348856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ba1e535-298e-47a5-bf9c-f0a8feadedca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.350630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.365488 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:08.465489 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:08.541749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8175-3fb0-4c0c-a514-225f09b05ae2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:08.554084 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3869/7762] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:08.556505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:08.557029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.557585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.557985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.558177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.558633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.559079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] PATH_INFO: `/v3/projects/100fdf80931a43bf87a0e8aa934dfef3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.565608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=100fdf80931a43bf87a0e8aa934dfef3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:08.568091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:08.640651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:08.657227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.681339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3870/7763] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:08.684704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:08.695812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100fdf80931a43bf87a0e8aa934dfef3', 'request_id': 'req-60b52561-165b-48c0-bd6b-06855c4b96dc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.706492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05d66e-17bc-4cec-948a-8630fb43deba None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:08.710117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100fdf80931a43bf87a0e8aa934dfef3', 'request_id': 'req-60b52561-165b-48c0-bd6b-06855c4b96dc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.727439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100fdf80931a43bf87a0e8aa934dfef3', 'request_id': 'req-60b52561-165b-48c0-bd6b-06855c4b96dc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.762229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] The token cache is being invalidate because project 100fdf80931a43bf87a0e8aa934dfef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:08.762528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.768245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:08.776334 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3894/7764] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:08 2022] DELETE /identity/v3/projects/100fdf80931a43bf87a0e8aa934dfef3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:08.780450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:08.793272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.873630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:08.873630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.874453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.874453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.875396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:08.875715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:08.878775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:08.910983 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3871/7765] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:08.915492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:08.917523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:08.918888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b52561-165b-48c0-bd6b-06855c4b96dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:08.924867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:08.925796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.926090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.926373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] PATH_INFO: `/v3/users/082abe6e1b6d4ecb88313a335e5b14b7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.928018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082abe6e1b6d4ecb88313a335e5b14b7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:08.930053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:08.948366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4524d-6ef2-4b66-b76a-b0940947bcf0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:08.953700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:08.954551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:08.954841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:08.955120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:08.955914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:08.961589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.023937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3872/7766] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:08 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:09.027856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:09.048937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082abe6e1b6d4ecb88313a335e5b14b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.050513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082abe6e1b6d4ecb88313a335e5b14b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.071891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082abe6e1b6d4ecb88313a335e5b14b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.083506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082abe6e1b6d4ecb88313a335e5b14b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.085003 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:09.107844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082abe6e1b6d4ecb88313a335e5b14b7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.129485 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3895/7767] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:08 2022] DELETE /identity/v3/users/082abe6e1b6d4ecb88313a335e5b14b7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:09.181574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedffd-752b-4560-8c25-6f0decad9f94 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:09.224098 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:09.305725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:09.306549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.306920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.307309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.308131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:09.310237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.355956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:09.357104 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3873/7768] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:09 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:09.358088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:09.376368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed87b-b44d-4edf-87a4-02568791b2f7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:09.393429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:09.394608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.395593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.396156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.397191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:09.399502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.415157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3896/7769] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:44:09.418915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:09.433574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1a1ff-3a5b-428d-87aa-a4dcb36e239e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:09.448908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:09.449620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.449942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.450226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.450982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:09.454238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.480813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3874/7770] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:09.484714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:09.506494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f44a0-f808-48e6-b96e-57dae9c3b494 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:09.550865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:09.552146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.552629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.553092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] PATH_INFO: `/v3/projects/b1f847bba36b428aa6287dff82398f47/users/2e2e1de7b62249b280f67f5fa92b74f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.574075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:09.575908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:09.609067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f847bba36b428aa6287dff82398f47, user_id=2e2e1de7b62249b280f67f5fa92b74f3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:09.611395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e30f-8603-4e40-9514-23a6232ce97d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:09.611802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e72cde-ed2e-47d6-9601-2b6d09df0f1b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.634518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:09.635015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.635227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.636107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] PATH_INFO: `/v3/projects/1bd2abe562274ec98b5ce15ce07d163d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.641164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd2abe562274ec98b5ce15ce07d163d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:09.643309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:09.654617 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3897/7771] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:09 2022] PUT /identity/v3/projects/b1f847bba36b428aa6287dff82398f47/users/2e2e1de7b62249b280f67f5fa92b74f3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:09.763960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.764616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.764616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.839917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd2abe562274ec98b5ce15ce07d163d', 'request_id': 'req-36160e6d-eef5-4287-bf7b-291f23d03a94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.853116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] MFA Rules not processed for user `2e2e1de7b62249b280f67f5fa92b74f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:09.854804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:09.858087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd2abe562274ec98b5ce15ce07d163d', 'request_id': 'req-36160e6d-eef5-4287-bf7b-291f23d03a94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.872605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd2abe562274ec98b5ce15ce07d163d', 'request_id': 'req-36160e6d-eef5-4287-bf7b-291f23d03a94'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.903188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] The token cache is being invalidate because project 1bd2abe562274ec98b5ce15ce07d163d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:09.903826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.908431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-36160e6d-eef5-4287-bf7b-291f23d03a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:09.916103 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3875/7772] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:09 2022] DELETE /identity/v3/projects/1bd2abe562274ec98b5ce15ce07d163d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:09.917534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dad5a-e6bf-43ef-a68d-7a34dea2970e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:09.917858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dad5a-e6bf-43ef-a68d-7a34dea2970e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:09.918139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dad5a-e6bf-43ef-a68d-7a34dea2970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:09.976965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c60dad5a-e6bf-43ef-a68d-7a34dea2970e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:09.978323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c60dad5a-e6bf-43ef-a68d-7a34dea2970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.017722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3898/7773] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:10.019045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:10.048443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337aac-93a4-4620-aad7-f71eb8dab3bb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:10.056302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:10.057475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.057971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.058414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.059350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:10.060742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:10.090460 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3876/7774] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:10.142294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.143896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.145412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.210806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:10.215602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.241516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3877/7775] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:10.242698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:10.247004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.282096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee40fc-cea9-4b60-a9a2-d2fd2816ba6f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:10.284357 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3899/7776] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 788 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:10.285492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:10.291374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:10.292949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.296759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.296759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] PATH_INFO: `/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.297961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cf9f6bb5e04c95adf97506f739c12a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:10.300374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:10.321522 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:10.329539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1907a8c-b046-404b-833f-75405847c3ff tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:10.348002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:10.349125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.349695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.350233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.352026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:10.353914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:10.358167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:10.402940 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3900/7777] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:10.402940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:10.406129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cf9f6bb5e04c95adf97506f739c12a', 'request_id': 'req-35446294-653c-4099-bf92-e30b43562fef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:10.419588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cf9f6bb5e04c95adf97506f739c12a', 'request_id': 'req-35446294-653c-4099-bf92-e30b43562fef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:10.429105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a193a21-66ea-472b-9ad7-b92817ff8ab6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:10.445567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cf9f6bb5e04c95adf97506f739c12a', 'request_id': 'req-35446294-653c-4099-bf92-e30b43562fef'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:10.468107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] The token cache is being invalidate because project b5cf9f6bb5e04c95adf97506f739c12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:10.468903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:10.469605 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:10.470623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:10.473001 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3878/7778] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:10 2022] DELETE /identity/v3/projects/b5cf9f6bb5e04c95adf97506f739c12a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:10.475699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:10.481012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.565054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:10.566230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.566622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.567010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/37b293c8361943f5a7ee5b9390a5fcf6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.580736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:get_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=37b293c8361943f5a7ee5b9390a5fcf6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:10.582697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042dd87-a372-4b11-ba9b-0df1b1b4598e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:10.588669 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3901/7779] 10.222.0.27 () {58 vars in 1391 bytes} [Sun Jul 24 01:44:10 2022] GET /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/37b293c8361943f5a7ee5b9390a5fcf6 => generated 688 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:10.588669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fceb-7757-49e5-a2b3-43f14f0f3dfa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.588669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fceb-7757-49e5-a2b3-43f14f0f3dfa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.588669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fceb-7757-49e5-a2b3-43f14f0f3dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.630763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bd68fceb-7757-49e5-a2b3-43f14f0f3dfa None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:10.632818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bd68fceb-7757-49e5-a2b3-43f14f0f3dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.646016 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3902/7780] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:10.647572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.647863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.648804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.660267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35446294-653c-4099-bf92-e30b43562fef admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:10.674377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:10.676815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.677108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.677254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] MFA Rules not processed for user `2e2e1de7b62249b280f67f5fa92b74f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:10.677513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.678137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:10.678674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.683378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6858fd-e569-4ec9-8667-539b90782367 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:10.776105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3879/7781] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:10.786857 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:10.787535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:10.787825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:10.835774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:10.837011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:10.967810 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3903/7782] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3416 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 24 01:44:10.969406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.020047 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3880/7783] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:11.022862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.027850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:11.084264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc24c83-81ea-4eba-a35c-4abe96cfdfe3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.094546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.095344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.095627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.095901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.097473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.103502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.130332 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:11.130529 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:11.141038 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3904/7784] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:10 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:11.145463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.182210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0a9f-c6a9-480f-b9a2-ebeee160c29e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.187979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.188726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.189022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.189319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.190073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:11.190377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.192275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.206186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248467-4ecf-4003-9494-31cad21272c3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.212713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.213901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.214539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.219215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/37b293c8361943f5a7ee5b9390a5fcf6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.219524 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3905/7785] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:11.219524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.221839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=37b293c8361943f5a7ee5b9390a5fcf6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.224235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.253013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212001-4ffe-49d5-8d26-94b7386462bf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.267924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.274282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.277052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.279518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.281593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.285119 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3881/7786] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:11 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/37b293c8361943f5a7ee5b9390a5fcf6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:11.289593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.293177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.331380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678af7f0-941b-45c4-80af-d983c325f460 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.332424 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3906/7787] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:11.333359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.348385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.350074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.350354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.354784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.355817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.358156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.366333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd29f-0509-4041-aabc-42759b461f7f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.383017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.383922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.384215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.388663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.389460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.394686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.446110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3882/7788] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:11 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:11.446848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.633053 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3907/7789] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:44:11 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 920 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:11.633958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.650717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461a8b-9e9f-41e1-abf2-600f911aee32 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.656240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.657563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.658002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.658285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.659216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.663659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6b4b-7eb4-4435-b6fa-45cec85d5356 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.664239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.680948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:11.682369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:11.682771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:11.683172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] PATH_INFO: `/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab/users/8afe5af241ec4b6bb94ac9cc01da1a04/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:11.710758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3908/7790] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:11 2022] POST /identity/v3/users => generated 292 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:11.710758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.720147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb0ae40b753462bb33ed4f1d58966ab, user_id=8afe5af241ec4b6bb94ac9cc01da1a04, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:11.724702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:11.766984 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3883/7791] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:11 2022] PUT /identity/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab/users/8afe5af241ec4b6bb94ac9cc01da1a04/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:11.767969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:11.916393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58598-76e5-4da3-9b44-f84bfc097962 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:11.991095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c8a2-6a01-4519-9663-c6bdcb970378 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.013558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.014292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.014583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.014916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.019713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.024130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.060474 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3884/7792] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:12.061405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.066818 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:12.084040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.085404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.086069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.086419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/ce5869cfb53e4a2d8a99502eb47506fe` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.091357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e809-e65e-4359-9357-32df2e0d66ae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.104905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.106184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.107843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.108134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.109777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.111440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.142188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3885/7793] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:12.146851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.157185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=ce5869cfb53e4a2d8a99502eb47506fe)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.159108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.168250 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:12.204903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26525f-b7ff-4043-a452-42db04da1216 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.227499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.236829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.237133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.237424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.242214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.246060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3909/7794] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:11 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/ce5869cfb53e4a2d8a99502eb47506fe => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:12.247073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.249771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.274870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f47c20-9994-412a-9488-ae23394575b8 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.288386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.289994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.291980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.296763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] PATH_INFO: `/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab/users/8afe5af241ec4b6bb94ac9cc01da1a04/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.297037 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3886/7795] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:12.300046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.306275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb0ae40b753462bb33ed4f1d58966ab, user_id=8afe5af241ec4b6bb94ac9cc01da1a04, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.314613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.347166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef36c-cecd-44ce-9a5f-da7e6fa4d86b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.364776 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3910/7796] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:12 2022] PUT /identity/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab/users/8afe5af241ec4b6bb94ac9cc01da1a04/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:12.366256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.503236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.504150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.504435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.504718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.505479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.509222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.538664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722135e-9f04-4e84-aa6d-d28967e05c3c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.571051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.572488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.573468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.574130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] PATH_INFO: `/v3/projects/236fe831133843bba03bab865106bb80/users/ff495dded5014520a350e2bd5f8967a6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.601143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236fe831133843bba03bab865106bb80, user_id=ff495dded5014520a350e2bd5f8967a6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.604158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761884b6-0f9a-4f7f-9a47-56f434892ea4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.637323 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3911/7797] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:12 2022] PUT /identity/v3/projects/236fe831133843bba03bab865106bb80/users/ff495dded5014520a350e2bd5f8967a6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:12.639507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba009-ba2a-424f-b41b-dfd7605c967c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.640470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba009-ba2a-424f-b41b-dfd7605c967c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.641040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba009-ba2a-424f-b41b-dfd7605c967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.666730 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3887/7798] 10.222.0.27 () {60 vars in 1314 bytes} [Sun Jul 24 01:44:12 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 813 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:12.667762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.703757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344db797-b5ba-4ff8-8db1-c77a744fe022 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:12.717654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5a5ba009-ba2a-424f-b41b-dfd7605c967c None None] MFA Rules not processed for user `8afe5af241ec4b6bb94ac9cc01da1a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:12.720219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a5ba009-ba2a-424f-b41b-dfd7605c967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:12.875107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:12.877666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.877977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.878269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/b33903b2b8f840179915d54f4cfd3c26` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.899654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3912/7799] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:12.900989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:12.901282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:12.901793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:12.907420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=b33903b2b8f840179915d54f4cfd3c26)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:12.910834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:12.961515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] MFA Rules not processed for user `ff495dded5014520a350e2bd5f8967a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:12.962783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:12.970667 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3888/7800] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:12 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/b33903b2b8f840179915d54f4cfd3c26 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:12.972068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:12.984742 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:13.013273 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:13.118141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933cb6-cc59-4fad-b94d-ed46180818d7 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.128806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.129504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.129951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.130230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.130936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.136414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.153156 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3913/7801] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:13.153156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.174949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a4c9-0163-4065-86d7-759544628eb9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.189698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.190724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.191126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.191519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.193425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.197893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.212297 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3889/7802] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:12 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:13.217402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.220905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:13.341084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886cf0f-6d4a-4ae8-8a25-a911cc037a08 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.350294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.351116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.351446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.351669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.365568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3914/7803] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Jul 24 01:44:13 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 788 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:13.366639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.393800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b6e63-8e21-4983-9031-3593fe00991c tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.474908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.475630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.507875 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3890/7804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:13.509167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.532854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.534328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.534623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.534907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.535618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.537886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09677e05-312a-44bd-b124-1ae08f157e18 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.575809 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3915/7805] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:13 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:13.577153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.577476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.582031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.613827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab79ed-9cda-41fa-ba4c-90a069d75099 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.618598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.619607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.619989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.620372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.621218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.622524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.654008 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:13.674645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] MFA Rules not processed for user `769bcdd2b058414380c3dccf14be7fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:13.676122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:13.714072 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:13.756598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3891/7806] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Jul 24 01:44:13 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 789 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:13.757630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.772398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297127f4-9aa3-4a24-887f-a753b6f6199f tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.779779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.781570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.781972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.782329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] PATH_INFO: `/v3/users/ff495dded5014520a350e2bd5f8967a6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.783954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff495dded5014520a350e2bd5f8967a6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.786201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.804824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3916/7807] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:13.806200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.828621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a395d-138a-49fd-862e-76cade578bfa None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.836613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.837382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.838614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.838614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.838889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.845213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.859659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3917/7808] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:13.860897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.868830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff495dded5014520a350e2bd5f8967a6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:13.878838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff495dded5014520a350e2bd5f8967a6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:13.880284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4832e5-cb62-4296-85c5-4967b3a3ecae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:13.887730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:13.887999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff495dded5014520a350e2bd5f8967a6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:13.888925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:13.889408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:13.889864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:13.891000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:list_application_credentials(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:13.892901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:13.903226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff495dded5014520a350e2bd5f8967a6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:13.903993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff495dded5014520a350e2bd5f8967a6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:13.910508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3918/7809] 10.222.0.27 () {58 vars in 1292 bytes} [Sun Jul 24 01:44:13 2022] GET /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 1501 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:13.914834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.915399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3892/7810] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:13 2022] DELETE /identity/v3/users/ff495dded5014520a350e2bd5f8967a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:13.916437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:13.917215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:13.917965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:13.948270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf5e6-8ef1-4c46-97a8-9c8efbd5a43a tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.004174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d453e-d95d-47bf-9d35-cc446e848b62 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.016875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.017631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.017962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.018294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.019054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.021290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.043679 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3893/7811] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:14.043679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.044007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:14.089111 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:14.125801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.127264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.127264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.128062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.128811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.134409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5c47c-d746-4e81-a885-998a1eb5f1cc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.178645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d680b-fcea-4b50-ba09-69c3907b855b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.189710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.190746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.191031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.191460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/4eb9a21e6d974a85b1618dd2759b6bb9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.207383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=4eb9a21e6d974a85b1618dd2759b6bb9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.209121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.227866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3919/7812] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:13 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:14.229253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.229600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.229928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.267248 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3894/7813] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:14 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/4eb9a21e6d974a85b1618dd2759b6bb9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:14.267248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.281956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5d19-8767-4de6-9179-9a356133d9e6 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.282344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:14.284027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:14.410794 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3920/7814] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:14.410794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.441906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bd42c-0297-4ffb-af1d-68c5e84055ff None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.452019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.453438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.454075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.454744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.456697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.457136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.457610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.457986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.458406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] PATH_INFO: `/v3/projects/0d581d60aaca4815966fbd2323d5fa05/users/408d17f918704b20943d79a848462645/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.485404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.507915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d581d60aaca4815966fbd2323d5fa05, user_id=408d17f918704b20943d79a848462645, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.511291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.528121 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3921/7815] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:14 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:14.529079 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3895/7816] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:14 2022] PUT /identity/v3/projects/0d581d60aaca4815966fbd2323d5fa05/users/408d17f918704b20943d79a848462645/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:14.529629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.530030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.532675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:14.548356 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:14.647081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61716a-9fb7-4c0c-8944-56b66035c2dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.656559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c95570-d40e-4f34-b1ef-1c168fd4fedb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.669621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.671658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.672657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.675604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.723123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.725415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.726147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.726644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/bf07bfcecd9a40d09e8e7d3dbd3f3850` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.744218 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:14.754436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=bf07bfcecd9a40d09e8e7d3dbd3f3850)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.759687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.788959 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3922/7817] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:14 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/bf07bfcecd9a40d09e8e7d3dbd3f3850 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:14.789990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.820156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.824061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e39ae2-8677-4aff-82cf-371247219ce2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.850806 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3896/7818] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:14.854225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.854525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.855577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.894236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820abc-c89d-4f09-8401-3d051ec5e3b9 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.912284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.912571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] MFA Rules not processed for user `408d17f918704b20943d79a848462645`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:14.913838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.913994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:14.914306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.916862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.917777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.921393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:14.941430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3923/7819] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:14.941430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:14.961495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f3c4c-b6d1-442d-a8fa-79e5addc76ac admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:14.974263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:14.976087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:14.976374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:14.978951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:14.981999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:14.985944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.064500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3897/7820] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:15.067041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.094656 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:15.094895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead692eb-9fce-46e0-bb46-35b61b2c75d6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.110373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.111369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.111571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.111850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] PATH_INFO: `/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9/users/0b11d226d8fa44f2bc24b219a0098e53/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.163047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1ad4ae9b3846acb6ab2af2690db6f9, user_id=0b11d226d8fa44f2bc24b219a0098e53, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.166382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.172113 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3924/7821] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Jul 24 01:44:14 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 789 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:15.173146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.182047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:15.197881 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3898/7822] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:15 2022] PUT /identity/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9/users/0b11d226d8fa44f2bc24b219a0098e53/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:15.198797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.360176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98ca86-795c-432c-a486-5e65e416f1e3 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.400102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27e8f-62d5-4337-8506-12348c5966af admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.425502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.427654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.427963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.428250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.430924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:create_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.432605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.530064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.532188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.532576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.532938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.537881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:15.573729 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:15.624649 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3899/7823] 10.222.0.27 () {60 vars in 1313 bytes} [Sun Jul 24 01:44:15 2022] POST /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials => generated 789 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:15.626227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.745780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.747200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.779247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3925/7824] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:15.783858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.786749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:15.869579 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:15.883229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703f6a-1d7d-4b80-abce-0bd5cf715f6e tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.893904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.894801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.895259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.895556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.897040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.899650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.916876 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3900/7825] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:15.921833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:15.939235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edcd7d-ee05-48a1-9894-4885e4b69c82 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.954926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.956175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.956472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.956757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.957933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Adding query filter params (name=tempest-application_credential-1234155838) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:15.958202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:list_application_credentials(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.963485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:15.966889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bca4-cb31-4282-a73f-2995c56647a6 service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:15.982301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:15.983760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:15.984236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:15.984696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] PATH_INFO: `/v3/projects/236fe831133843bba03bab865106bb80` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:15.986442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=236fe831133843bba03bab865106bb80)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:15.988693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.019056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3901/7826] 10.222.0.27 () {58 vars in 1385 bytes} [Sun Jul 24 01:44:15 2022] GET /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials?name=tempest-application_credential-1234155838 => generated 887 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:16.025078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.075292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872989bd-d164-4ddf-ac08-cce207527927 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.094645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236fe831133843bba03bab865106bb80', 'request_id': 'req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:16.112991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236fe831133843bba03bab865106bb80', 'request_id': 'req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:16.146862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236fe831133843bba03bab865106bb80', 'request_id': 'req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:16.167480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] The token cache is being invalidate because project 236fe831133843bba03bab865106bb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:16.167703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:16.168970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:16.178711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3926/7827] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:15 2022] DELETE /identity/v3/projects/236fe831133843bba03bab865106bb80 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:16.178711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.181720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:16.268033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:16.268958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.269972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.270210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] PATH_INFO: `/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9/users/0b11d226d8fa44f2bc24b219a0098e53/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.275614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1ad4ae9b3846acb6ab2af2690db6f9, user_id=0b11d226d8fa44f2bc24b219a0098e53, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:16.278347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbffafb-d295-4e39-9e88-696f8608a619 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.315201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3902/7828] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:16 2022] PUT /identity/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9/users/0b11d226d8fa44f2bc24b219a0098e53/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:16.320717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68be6f-578f-4019-a4cd-10e179e2fc42 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.321196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68be6f-578f-4019-a4cd-10e179e2fc42 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.321698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68be6f-578f-4019-a4cd-10e179e2fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.356149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782ca6a-0bbd-4f75-a14a-1f253477b1ac admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.364984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fb68be6f-578f-4019-a4cd-10e179e2fc42 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:16.370055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fb68be6f-578f-4019-a4cd-10e179e2fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:16.499929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:16.518907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.519704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.519960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/ab92fb44ab254ffc898061601bda1f0f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.570123 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:16.582073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=ab92fb44ab254ffc898061601bda1f0f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:16.583748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.606778 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3903/7829] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:16.614178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.614785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.615087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.641158 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:16.667504 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3927/7830] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:16 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/ab92fb44ab254ffc898061601bda1f0f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:16.667729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:16.670236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.671393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:16.698476 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3904/7831] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:16.700661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da13a-5c70-4cb8-b5da-344ec989b0ba tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.712577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2e1de7b62249b280f67f5fa92b74f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1f847bba36b428aa6287dff82398f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:16.713593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.714260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.714556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/901c86fe68534732a03d18243c4d342e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.719779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.739297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2e2e1de7b62249b280f67f5fa92b74f3, application_credential_id=901c86fe68534732a03d18243c4d342e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:16.740836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.749942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3b2d4-6a9a-434b-97be-551c83c51618 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.772192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:16.773390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.773390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.773820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.774378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:16.774692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:16.776485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.793160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3905/7832] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:16.797728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.800305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3928/7833] 10.222.0.27 () {58 vars in 1394 bytes} [Sun Jul 24 01:44:16 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3/application_credentials/901c86fe68534732a03d18243c4d342e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:16.806050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:16.811124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad0f3-6713-4188-8f0a-c33c0af5360d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.828331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:16.831580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:16.832268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:16.832574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:16.832826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:16.833604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:16.835850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:16.877981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba835ad-c059-4521-8d9f-2a5f0e693d92 tempest-ApplicationCredentialsV3Test-1345712557 tempest-ApplicationCredentialsV3Test-1345712557-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:16.880256 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3906/7834] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:16 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:16.885915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.043827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8c26b-6d5d-47ac-8429-c47948eddc77 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:17.058351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.060616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.060917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.061259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.065711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.067659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.069180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.069473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.069774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] PATH_INFO: `/v3/users/2e2e1de7b62249b280f67f5fa92b74f3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.071516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.073317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2e1de7b62249b280f67f5fa92b74f3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.081406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.119028 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3907/7835] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:16 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:17.120737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.127187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.165173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafb2a-097b-46e8-bc3d-dc7238cdf280 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:17.207165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.209041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.210043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.211765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] PATH_INFO: `/v3/users/8afe5af241ec4b6bb94ac9cc01da1a04` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.218614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afe5af241ec4b6bb94ac9cc01da1a04)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.225903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.228623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2e1de7b62249b280f67f5fa92b74f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.229631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2e1de7b62249b280f67f5fa92b74f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.246061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2e1de7b62249b280f67f5fa92b74f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.264375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2e1de7b62249b280f67f5fa92b74f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.339535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2e1de7b62249b280f67f5fa92b74f3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.363056 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3929/7836] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:16 2022] DELETE /identity/v3/users/2e2e1de7b62249b280f67f5fa92b74f3 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:17.369244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.372894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.374915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afe5af241ec4b6bb94ac9cc01da1a04'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.393847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afe5af241ec4b6bb94ac9cc01da1a04'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.411806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afe5af241ec4b6bb94ac9cc01da1a04'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.443425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afe5af241ec4b6bb94ac9cc01da1a04'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.447813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-841f629d-d181-49b9-b455-cbdd701b8d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afe5af241ec4b6bb94ac9cc01da1a04'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:17.477895 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3908/7837] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:17 2022] DELETE /identity/v3/users/8afe5af241ec4b6bb94ac9cc01da1a04 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:17.478284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b5540-9321-42e2-be2d-617e7f494211 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.478590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b5540-9321-42e2-be2d-617e7f494211 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.480800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b5540-9321-42e2-be2d-617e7f494211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.489063 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:17.551083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620459ec-cbb9-43c4-86e2-0ba817e8eae9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:17.554780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-701b5540-9321-42e2-be2d-617e7f494211 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:17.556010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-701b5540-9321-42e2-be2d-617e7f494211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.610936 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:17.696642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.697336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.697623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.697944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.698728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.705047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.718175 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3909/7838] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:17.719663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.720555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.720555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.726260 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3930/7839] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:17.730483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.739291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.758929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:17.760197 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.778423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3910/7840] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:17.779282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.781163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.810543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cd19c-86de-49e5-bf2c-eee01e870453 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:17.816689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.817384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.817819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.818007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.818750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.820400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.836867 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3911/7841] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:17.837915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.839616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:17.935092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7a47-c228-4997-8f6c-75d14cb38ec4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:17.946467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:17.947563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:17.948123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:17.948790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:17.968217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:17.970400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:17.994477 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3931/7842] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:17.995643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:17.997474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597dda0-6d25-48f1-a5cc-fe50a8e597af admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:18.010320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:18.010958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:18.015517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:18.015851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:18.041980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236617f-6993-483e-b9f0-3efd2cd03641 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:18.052741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:18.053976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a7ffa-5969-472a-8047-14f15fb40652 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:18.066601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:18.067684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:18.068074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:18.068476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] PATH_INFO: `/v3/projects/3b1aa84be30d4a469f4fdfe24c4b8f79/users/147e9e02cd3f45dcbb4a0907f24bc1fc/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:18.073275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3912/7843] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:18.119014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1aa84be30d4a469f4fdfe24c4b8f79, user_id=147e9e02cd3f45dcbb4a0907f24bc1fc, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:18.147571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:18.184263 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3932/7844] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:17 2022] PUT /identity/v3/projects/3b1aa84be30d4a469f4fdfe24c4b8f79/users/147e9e02cd3f45dcbb4a0907f24bc1fc/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:18.196314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:18.197621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:18.198161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:18.257972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] MFA Rules not processed for user `147e9e02cd3f45dcbb4a0907f24bc1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:18.262021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:18.412489 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3913/7845] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:18.425733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:18.428536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:18.578274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cd25-0a16-4990-b51d-1a5407707d9f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:18.589566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:18.590207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:18.590495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:18.593749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:18.634362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:18.635901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:18.678227 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3933/7846] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:18.890432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:18.894416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:18.961582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:18.963974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:18.998067 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:19.061103 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:19.112260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824b67-df59-46da-8f17-fd4d48c70ea0 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:19.127211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:19.128574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.129107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.130424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] PATH_INFO: `/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.138632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb0ae40b753462bb33ed4f1d58966ab)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:19.147169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:19.159544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955e6c-ac32-461c-bee3-4591b3f7eaba None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:19.176338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:19.178600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.178942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.180510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] PATH_INFO: `/v3/projects/b1f847bba36b428aa6287dff82398f47` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.183230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f847bba36b428aa6287dff82398f47)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:19.188984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:19.320866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f847bba36b428aa6287dff82398f47', 'request_id': 'req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.329004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb0ae40b753462bb33ed4f1d58966ab', 'request_id': 'req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.340524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb0ae40b753462bb33ed4f1d58966ab', 'request_id': 'req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.344769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f847bba36b428aa6287dff82398f47', 'request_id': 'req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.363920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f847bba36b428aa6287dff82398f47', 'request_id': 'req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.395284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] The token cache is being invalidate because project b1f847bba36b428aa6287dff82398f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:19.395948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.397905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b0fc111-9f3e-4bb3-ad49-0c54bfeaad75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.403210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3914/7847] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:18 2022] DELETE /identity/v3/projects/b1f847bba36b428aa6287dff82398f47 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:19.408688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb0ae40b753462bb33ed4f1d58966ab', 'request_id': 'req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.410064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542e6c4-369c-4242-8f2d-9c936751ef48 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.410712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542e6c4-369c-4242-8f2d-9c936751ef48 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.411211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542e6c4-369c-4242-8f2d-9c936751ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.446058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b542e6c4-369c-4242-8f2d-9c936751ef48 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:19.449939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b542e6c4-369c-4242-8f2d-9c936751ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:19.474663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] The token cache is being invalidate because project 8bb0ae40b753462bb33ed4f1d58966ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:19.476468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.477155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.489093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3934/7848] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:18 2022] DELETE /identity/v3/projects/8bb0ae40b753462bb33ed4f1d58966ab => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:19.490460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:19.494448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:19.594453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3915/7849] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:19.603071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.604292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.604760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.621542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ece5d4-f195-49b7-9bb5-8429f76bc2fc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:19.629133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:19.630175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.630574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.630899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] PATH_INFO: `/v3/users/408d17f918704b20943d79a848462645` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.632791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408d17f918704b20943d79a848462645)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:19.636010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:19.642906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:19.649755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:19.671972 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3916/7850] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:19.674164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:19.694681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8619a-9f9f-4f0e-8022-e68cebbf952b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:19.700577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:19.701415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.701789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.703378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.709514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:19.709956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:19.713255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:19.726187 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:19.736161 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3917/7851] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:19.737880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408d17f918704b20943d79a848462645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.738584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:19.739182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408d17f918704b20943d79a848462645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.745965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:19.763567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408d17f918704b20943d79a848462645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.772186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a3360-7632-4b2c-8048-60d8a8d78269 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:19.780400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408d17f918704b20943d79a848462645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.784507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:19.785054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:19.785343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:19.785615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:19.788815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:19.791698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:19.816492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408d17f918704b20943d79a848462645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:19.826438 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3935/7852] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:19 2022] DELETE /identity/v3/users/408d17f918704b20943d79a848462645 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:19.869567 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3918/7853] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:19 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:19.873624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:20.076707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9fcb-b40e-4ae2-b04b-f11a434d12f1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:20.287577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:20.288569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:20.290044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:20.290359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:20.291092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:20.300446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:20.448629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:20.451014 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3936/7854] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:19 2022] POST /identity/v3/users => generated 285 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:20.462954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37023d2-7662-4031-bba8-ad345fbcb02b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:20.497010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:20.497933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:20.498726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:20.509391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:20.510805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:20.515799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:20.559234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:20.565947 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3919/7855] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:20.579338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241b87b-6e3c-40bb-a9d0-747889e0289a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:20.601010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:20.601742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:20.602027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:20.602303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:20.603053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:20.604693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504125a-72f7-48c0-9674-e03d91f4cdf4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:20.630376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3937/7856] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:20.631684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:20.651538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b829-bdcb-4577-8e66-d3bd50c5bff2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:20.678457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:20.679388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:20.682469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:20.682469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] PATH_INFO: `/v3/projects/3dc5d06395d04b5890c524b22ad26d75/users/fada8a20c85c439594a6855b672a09ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:20.735300 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:20.749078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc5d06395d04b5890c524b22ad26d75, user_id=fada8a20c85c439594a6855b672a09ac, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:20.753642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:20.798975 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3920/7857] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:20 2022] PUT /identity/v3/projects/3dc5d06395d04b5890c524b22ad26d75/users/fada8a20c85c439594a6855b672a09ac/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:20.812504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:20.813028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:20.813473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:20.856992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:20.859040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:20.933703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] MFA Rules not processed for user `fada8a20c85c439594a6855b672a09ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:20.936570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:21.066634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:21.104597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a924bca-1d87-4ff7-8f2e-a613d063555f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.122434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.124599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.125145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.125801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] PATH_INFO: `/v3/projects/0d581d60aaca4815966fbd2323d5fa05` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.127251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d581d60aaca4815966fbd2323d5fa05)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.129380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.166436 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3938/7858] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:21.171228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.184303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ef53f-ea4d-4c06-b079-986f948f49b1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.204301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.208423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.210085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.210564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.213757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.218913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.251103 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3939/7859] 10.222.0.27 () {60 vars in 1298 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:21.251435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d581d60aaca4815966fbd2323d5fa05', 'request_id': 'req-1db650a8-3eab-4ffb-bcc3-e0032ea53433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:21.254927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.267623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d581d60aaca4815966fbd2323d5fa05', 'request_id': 'req-1db650a8-3eab-4ffb-bcc3-e0032ea53433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:21.282964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c1f7-3ae8-40cd-97ed-9016d6b721b5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.290541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d581d60aaca4815966fbd2323d5fa05', 'request_id': 'req-1db650a8-3eab-4ffb-bcc3-e0032ea53433'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:21.322759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] The token cache is being invalidate because project 0d581d60aaca4815966fbd2323d5fa05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:21.323393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:21.325001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1db650a8-3eab-4ffb-bcc3-e0032ea53433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:21.331928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3921/7860] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:20 2022] DELETE /identity/v3/projects/0d581d60aaca4815966fbd2323d5fa05 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:21.336901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ac2c-dee5-46b5-b07e-b2a5f56d78b0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.337432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ac2c-dee5-46b5-b07e-b2a5f56d78b0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.337975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ac2c-dee5-46b5-b07e-b2a5f56d78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.378458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8f71ac2c-dee5-46b5-b07e-b2a5f56d78b0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:21.387259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f71ac2c-dee5-46b5-b07e-b2a5f56d78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:21.431386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.435187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.435678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.436128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/be80f318f07940938b5e67c63edb4e8e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.444001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=be80f318f07940938b5e67c63edb4e8e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.446381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.506771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3940/7861] 10.222.0.27 () {58 vars in 1379 bytes} [Sun Jul 24 01:44:21 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/be80f318f07940938b5e67c63edb4e8e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:21.512932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.520831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:21.558432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf761-2694-4f27-bcd2-25392bbf738a tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.572524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.573378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.573683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.573979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.574665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.580795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.604700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3922/7862] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:21.614182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.614474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.614754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.631514 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3941/7863] 10.222.0.27 () {60 vars in 1298 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:21.633532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.678232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:21.679282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ab73c-70ca-4ed2-8826-2005e8ca877d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.679546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:21.697186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.700549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.700958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.701122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5dcddb4b0cf543da8472cf7f2a607842` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.710404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=5dcddb4b0cf543da8472cf7f2a607842)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.718969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.733891 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3923/7864] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:21.735138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.771378 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3942/7865] 10.222.0.27 () {58 vars in 1379 bytes} [Sun Jul 24 01:44:21 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5dcddb4b0cf543da8472cf7f2a607842 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:21.775418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bec806-236b-4c4b-b3a4-0eaa7844a52a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.782816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.797455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.798886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.799178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.802933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.804906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:21.805258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.813626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.822885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766e18-cfce-4c4f-95a7-8c78f135bc5e tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.843036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.844516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.845902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.846139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5dcddb4b0cf543da8472cf7f2a607842` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.856760 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:21.867732 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3924/7866] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:21.868665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Could not find credential: c4930ebbe301d94637e696ed5a62f2b2b19f0a35f8f492464d5b44f4bd71c93d.: keystone.exception.CredentialNotFound: Could not find credential: c4930ebbe301d94637e696ed5a62f2b2b19f0a35f8f492464d5b44f4bd71c93d. Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 24 01:44:21.897325 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application with Lock( Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:44:21.898512 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: c4930ebbe301d94637e696ed5a62f2b2b19f0a35f8f492464d5b44f4bd71c93d. Jul 24 01:44:21.899698 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:44:21.900730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ad9ab-28c2-4473-ac83-41243ff2eece admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.904575 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3943/7867] 10.222.0.27 () {58 vars in 1376 bytes} [Sun Jul 24 01:44:21 2022] GET /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5dcddb4b0cf543da8472cf7f2a607842 => generated 148 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 24 01:44:21.909885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:21.918108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.918800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.919082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.919359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.920064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.925129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.925930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a3c5-f04b-4ddc-a43d-c328e3639f12 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:21.939848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:21.941131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:21.941727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:21.942262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:21.943210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:21.945191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:21.997011 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3925/7868] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:21.998079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.005856 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3944/7869] 10.222.0.27 () {60 vars in 1298 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:22.011564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.034509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2830a6-0c36-43c2-898e-81f8c41aaea5 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.155352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244e41-825f-4a27-bf51-dec75286b7e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.180954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.182134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.182529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.182910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.183893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.185830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.187918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.188639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.188952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.189542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.190298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.192289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.226301 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3945/7870] 10.222.0.27 () {60 vars in 1298 bytes} [Sun Jul 24 01:44:22 2022] POST /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:22.233591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.239614 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:22.253487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ac8b-1050-4a61-bf81-c6db2979d20b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.264301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.272986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.274095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.276197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.277366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.280955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3926/7871] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:21 2022] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:22.282398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.294176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.332376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfe045-27d5-4902-b9d1-f613a8f375d4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.338321 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3946/7872] 10.222.0.27 () {58 vars in 1277 bytes} [Sun Jul 24 01:44:22 2022] GET /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 865 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:22.339608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.351070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.355592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.356018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.356403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.357298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.361696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.375063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4e29-e39a-48ee-8dac-697015414d32 tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.394452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.398034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.399396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.400030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/d5d8a665c83341918bdf33bad5fc995c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.402801 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3927/7873] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:22.408780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=d5d8a665c83341918bdf33bad5fc995c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.409607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.411503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.445629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b113821-ec74-488b-8910-a52705a9fe1b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.474439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.478077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.478492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.486388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.488220 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3947/7874] 10.222.0.27 () {58 vars in 1379 bytes} [Sun Jul 24 01:44:22 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/d5d8a665c83341918bdf33bad5fc995c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:22.488367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.491436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.492308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.512508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb29-1c9c-4447-a364-e67d7fee4add tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.523341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.524616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.528391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.528874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/d46abd8887a74ff68e8ccf5559b0c2c3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.534178 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3928/7875] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:22.535227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.536350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=d46abd8887a74ff68e8ccf5559b0c2c3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.538021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.560784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97ad6-c13e-41ae-823e-b882799d8d81 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.582423 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3948/7876] 10.222.0.27 () {58 vars in 1379 bytes} [Sun Jul 24 01:44:22 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/d46abd8887a74ff68e8ccf5559b0c2c3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:22.587655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.598847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.600757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.601982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.602373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] PATH_INFO: `/v3/projects/36b227c0555e41a987e442c10c0c9e61/users/b6d866891c6c422fabf23e1cd24be6b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.618436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908d725-b990-4e1e-9f3a-0c4187b74c8f tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.630636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.632588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.633501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.634553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.638388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.645288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b227c0555e41a987e442c10c0c9e61, user_id=b6d866891c6c422fabf23e1cd24be6b0, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.646137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.650655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010a78-2c08-4598-a6b6-f843d30d6c3a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.681402 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3949/7877] 10.222.0.27 () {60 vars in 1298 bytes} [Sun Jul 24 01:44:22 2022] POST /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2 => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:22.686341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.698993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3929/7878] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:22 2022] PUT /identity/v3/projects/36b227c0555e41a987e442c10c0c9e61/users/b6d866891c6c422fabf23e1cd24be6b0/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:22.709869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.710361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.710752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.713653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba0881-99ce-4160-bc4c-13d7442565bd tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.804432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] MFA Rules not processed for user `b6d866891c6c422fabf23e1cd24be6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:22.810406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:22.933024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.934353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.934835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.935723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5a83215e3f374b54a15369ffe90706f4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.939681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=5a83215e3f374b54a15369ffe90706f4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.943634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:22.951174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3950/7879] 10.222.0.27 () {58 vars in 1376 bytes} [Sun Jul 24 01:44:22 2022] GET /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5a83215e3f374b54a15369ffe90706f4 => generated 367 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:22.955233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:22.973321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254dae-995b-4007-bca6-f805c4e35e7b tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:22.987517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fada8a20c85c439594a6855b672a09ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dc5d06395d04b5890c524b22ad26d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:22.989544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:22.990255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:22.990786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5a83215e3f374b54a15369ffe90706f4` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:22.997729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=fada8a20c85c439594a6855b672a09ac, credential_id=5a83215e3f374b54a15369ffe90706f4)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:22.999626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:23.074031 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3951/7880] 10.222.0.27 () {58 vars in 1379 bytes} [Sun Jul 24 01:44:22 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac/credentials/OS-EC2/5a83215e3f374b54a15369ffe90706f4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:23.082927 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3930/7881] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:23.086512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:23.088035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:23.088398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:23.131340 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:23.317661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304b14-fe7a-4a92-a5b6-3cec44057989 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:23.354114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:23.357333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:23.358141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:23.362156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:23.366250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:23.369085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:23.384840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2ee9-4b92-424b-ab6a-890e9d4f441d tempest-EC2CredentialsTest-68510051 tempest-EC2CredentialsTest-68510051-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:23.413337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:23.416213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:23.416573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:23.416859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] PATH_INFO: `/v3/users/fada8a20c85c439594a6855b672a09ac` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:23.420226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fada8a20c85c439594a6855b672a09ac)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:23.425494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:23.492252 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3931/7882] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:23 2022] POST /identity/v3/projects => generated 367 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:23.506657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:23.558190 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:23.571109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fada8a20c85c439594a6855b672a09ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:23.572361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fada8a20c85c439594a6855b672a09ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:23.613542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fada8a20c85c439594a6855b672a09ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:23.644326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fada8a20c85c439594a6855b672a09ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:23.698176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4bdd143-c528-4ca0-8c38-2d024f4a13c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fada8a20c85c439594a6855b672a09ac'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:23.726986 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3952/7883] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:23 2022] DELETE /identity/v3/users/fada8a20c85c439594a6855b672a09ac => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:23.731912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:23.734176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:23.734791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:23.791063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:23.799831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:23.801453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e118c-f9b9-434e-aef9-586250a42d6e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:24.003350 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3953/7884] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:24.014935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:24.017294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:24.220960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:24.226541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.227109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.230455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.234849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:24.237847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:24.260690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4192-fc50-4321-8964-b37d25cbccc2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:24.273167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:24.273974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.274299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.274536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.313162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:24.314511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:24.346654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3954/7885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:24.349759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:24.353660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:24.370843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3932/7886] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:23 2022] POST /identity/v3/users => generated 284 bytes in 870 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:24.386907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9066d3-6293-4612-b791-dfa8bc2870cc service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:24.412114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:24.413290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.413642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.413951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.414708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:24.418853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:24.463278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3955/7887] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:24.470421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:24.511628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5dcde-4099-488e-a614-175b8be81f86 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:24.534675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:24.536164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.538265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.538938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.542756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:24.551053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb434-3ec5-4caa-8151-94f3583edd0b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:24.587530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3933/7888] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:24.591250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:24.608528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c34aa-14cb-47b8-bf33-c2e1f04de8fc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:24.621610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:24.622846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.626422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.627045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] PATH_INFO: `/v3/projects/937bf44b9b8543f7871dce206e8605be/users/7c40a886225543d9875abd5903f03047/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.697789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=937bf44b9b8543f7871dce206e8605be, user_id=7c40a886225543d9875abd5903f03047, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:24.701023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:24.743946 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3956/7889] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:24 2022] PUT /identity/v3/projects/937bf44b9b8543f7871dce206e8605be/users/7c40a886225543d9875abd5903f03047/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:24.756163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:24.756567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:24.756957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:24.882054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] MFA Rules not processed for user `7c40a886225543d9875abd5903f03047`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:24.885715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:24.945814 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:25.282515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3934/7890] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:25.288989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:25.291516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:25.356819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:25.358763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:25.469431 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:25.613983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0798c-13f6-43d6-a532-2fecaf8d8f7d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:25.627794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:25.628751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:25.629042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:25.629322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:25.638883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:25.660511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a1d58-f20c-4188-b1d5-558414165006 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:25.686752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:25.687681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:25.687973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:25.688257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] PATH_INFO: `/v3/projects/3dc5d06395d04b5890c524b22ad26d75` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:25.690939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc5d06395d04b5890c524b22ad26d75)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:25.700985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:25.850361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:25.851844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ab62-905b-4425-a903-b4d7c71640fb service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:25.853064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc5d06395d04b5890c524b22ad26d75', 'request_id': 'req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:25.873837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc5d06395d04b5890c524b22ad26d75', 'request_id': 'req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:25.889132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3957/7891] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:25.893874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc5d06395d04b5890c524b22ad26d75', 'request_id': 'req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:25.924250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] The token cache is being invalidate because project 3dc5d06395d04b5890c524b22ad26d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:25.924639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:25.925240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:25.927170 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3935/7892] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:25 2022] DELETE /identity/v3/projects/3dc5d06395d04b5890c524b22ad26d75 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:25.931962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ec65-eaf4-40d4-88ce-e23e92028d87 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:25.932308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ec65-eaf4-40d4-88ce-e23e92028d87 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:25.932514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ec65-eaf4-40d4-88ce-e23e92028d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:25.962863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9d65ec65-eaf4-40d4-88ce-e23e92028d87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:25.976155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9d65ec65-eaf4-40d4-88ce-e23e92028d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:26.133336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:26.134928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:26.178937 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3958/7893] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:26.186152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:26.186645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:26.186936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:26.268793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:26.270096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:26.306179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3959/7894] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:26.311727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:26.322982 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:26.340288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe7301-e41c-458e-85e3-dd28e25145dc None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:26.361910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ccee8-43d8-49bc-b4e7-2d7e6354b2ac admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:26.363400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:26.364100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:26.364384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:26.364663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:26.365422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:26.365758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:26.371240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:26.383443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:26.384127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:26.384409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:26.384693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:26.387808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:26.435855 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3960/7895] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:26.437559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:26.460559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583d1b-d8e8-4cba-843b-80e4cc82f53b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:26.475316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:26.476003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:26.476293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:26.476755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:26.477477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:26.479471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:26.563559 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3961/7896] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:26 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:26.567945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:26.590747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:26.592834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:26.636245 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3936/7897] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:26.734802 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:26.798374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22361f-4b0a-4467-8208-89eec45d235d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:26.821946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:26.822657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:26.831613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:26.831965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:26.832731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:26.839894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:26.987199 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3962/7898] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:26 2022] POST /identity/v3/users => generated 279 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:26.991386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:27.013076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb07d5-fdf2-4440-8b3d-2c11f279c851 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:27.046865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:27.047927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.048397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.048847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.049828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:27.055385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:27.091831 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3937/7899] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:27.096493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:27.109798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8d7f-827f-45a2-8e5a-687e05ef05b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:27.160217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:27.160923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.161207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.161482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.162269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:27.163907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717493d2-d464-40d6-85ec-f1a63984a594 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:27.207992 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3963/7900] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:27.212715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:27.228221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7be5d-3b60-495f-bb1b-622e94a9f48c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:27.242171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:27.243400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.243868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.244317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] PATH_INFO: `/v3/projects/cf709e00a6624650b06ce36a78f0632e/users/5ed603267cde4b95b08665dfaeeba5ce/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.289069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf709e00a6624650b06ce36a78f0632e, user_id=5ed603267cde4b95b08665dfaeeba5ce, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:27.292246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd817f83-9783-41d2-8993-0210d7efff3b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:27.331493 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3938/7901] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:27 2022] PUT /identity/v3/projects/cf709e00a6624650b06ce36a78f0632e/users/5ed603267cde4b95b08665dfaeeba5ce/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:27.347914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c4d9-5c48-4c2d-b8c3-697c32404e71 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.348554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c4d9-5c48-4c2d-b8c3-697c32404e71 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.348746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c4d9-5c48-4c2d-b8c3-697c32404e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.463889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c3b7c4d9-5c48-4c2d-b8c3-697c32404e71 None None] MFA Rules not processed for user `5ed603267cde4b95b08665dfaeeba5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:27.470094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c3b7c4d9-5c48-4c2d-b8c3-697c32404e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:27.655728 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3964/7902] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:27.660461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.660756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.661035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.697317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] MFA Rules not processed for user `5ed603267cde4b95b08665dfaeeba5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:27.699903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:27.724509 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3939/7903] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:27 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 01:44:27.729636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.731066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.731066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.785329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] MFA Rules not processed for user `5ed603267cde4b95b08665dfaeeba5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:27.787206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:27.806453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3965/7904] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:27 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:44:27.809255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:27.833303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ac577-0ac9-4c0a-83d9-98236f1f956c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:27.847529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:27.849354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `HEAD` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.850161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.851238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.880795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorizing `identity:check_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:27.886705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:27.934231 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3940/7905] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Jul 24 01:44:27 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 24 01:44:27.939259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:27.966672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d2b7-9080-4641-b008-d5182e94117e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:27.979093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:27.979877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:27.980160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:27.980702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:27.996736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:28.003462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:28.027714 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3966/7906] 10.222.0.27 () {56 vars in 1262 bytes} [Sun Jul 24 01:44:27 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:28.029615 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.066505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc3873-c3de-43be-a64f-d3847478a370 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.081277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.083549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.084095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.084392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.112646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:28.136125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384be3-3998-4e10-aefb-5a21e11b989b tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:28.225893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3941/7907] 10.222.0.27 () {56 vars in 1265 bytes} [Sun Jul 24 01:44:28 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:28.230049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.253420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fcff1-3dff-469c-8e37-e8020622b468 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.284277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.284949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `HEAD` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.285233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.285519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.287488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 24 01:44:28.307414 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 24 01:44:28.308918 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:44:28.310467 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:44:28.335903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.336221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.336502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.337885 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3967/7908] 10.222.0.27 () {56 vars in 1263 bytes} [Sun Jul 24 01:44:28 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 24 01:44:28.366039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] MFA Rules not processed for user `5ed603267cde4b95b08665dfaeeba5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:28.368000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:28.379727 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3942/7909] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:28 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 01:44:28.383572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.404461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530d13-166c-45c1-8891-68b03b9e703f tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.440524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.441448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.441747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.442027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.472595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:28.474632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:28.487844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.490074 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3968/7910] 10.222.0.27 () {56 vars in 1262 bytes} [Sun Jul 24 01:44:28 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 01:44:28.506799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9db3-68bb-4389-a7fc-7557ed0278da None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.515794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.516598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.516845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.517338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.535758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:28.537334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:28.587802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.588473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3943/7911] 10.222.0.27 () {56 vars in 1265 bytes} [Sun Jul 24 01:44:28 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:28.602494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc014f2-c382-48a7-8a86-e93bab8f36fb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.628411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed603267cde4b95b08665dfaeeba5ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf709e00a6624650b06ce36a78f0632e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.628991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.629520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.630868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.635307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-9b6e95a0-c4ae-439c-a94b-66df93b169bb tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 24 01:44:28.679510 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 24 01:44:28.680728 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 24 01:44:28.682335 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:44:28.686547 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3969/7912] 10.222.0.27 () {56 vars in 1262 bytes} [Sun Jul 24 01:44:28 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:44:28.688310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:28.792126 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:28.797562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.799333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.801129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.813009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b492c9-e4c7-4a24-b2fd-4cebecdb7437 tempest-TokensV3Test-10117514 tempest-TokensV3Test-10117514-project] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:28.818941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:28.822808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:28.822808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:28.822808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] PATH_INFO: `/v3/users/5ed603267cde4b95b08665dfaeeba5ce` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:28.823431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed603267cde4b95b08665dfaeeba5ce)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:28.825608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:28.849108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] MFA Rules not processed for user `0b11d226d8fa44f2bc24b219a0098e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:28.850404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:28.929070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed603267cde4b95b08665dfaeeba5ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:28.946314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed603267cde4b95b08665dfaeeba5ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:28.960647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed603267cde4b95b08665dfaeeba5ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:28.986611 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:28.987739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed603267cde4b95b08665dfaeeba5ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:28.989402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca34bb1f-5d1c-4eed-bf56-bdec48dc484d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed603267cde4b95b08665dfaeeba5ce'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.015843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3944/7913] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:28 2022] DELETE /identity/v3/users/5ed603267cde4b95b08665dfaeeba5ce => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:29.024311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.027495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.027799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:29.047871 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3970/7914] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:29.063228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:29.066034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:29.091601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:29.095570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:29.282347 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3945/7915] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:29.285124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f8d90-5b5d-4bb6-8719-4feda38b9b42 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:29.294467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:29.298740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:29.468512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb65ef-e0f5-48e4-922c-b56162fe6728 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:29.474010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877501d-6009-4149-a295-49def2310468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:29.480097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877501d-6009-4149-a295-49def2310468 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.480097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877501d-6009-4149-a295-49def2310468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.480097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877501d-6009-4149-a295-49def2310468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:29.502743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877501d-6009-4149-a295-49def2310468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:29.503270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:29.504134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.504611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.505053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:29.506785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877501d-6009-4149-a295-49def2310468 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:29.523597 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3946/7916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:29.524567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877501d-6009-4149-a295-49def2310468 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:29.525941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5877501d-6009-4149-a295-49def2310468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:29.541295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877501d-6009-4149-a295-49def2310468 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:29.546617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:29.547585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.547974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.548313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] PATH_INFO: `/v3/users/b6d866891c6c422fabf23e1cd24be6b0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:29.550538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d866891c6c422fabf23e1cd24be6b0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:29.553028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:29.583826 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:29.669808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d866891c6c422fabf23e1cd24be6b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.724576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d866891c6c422fabf23e1cd24be6b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.725602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:29.727856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f52cc-e585-452b-a966-07bf7f163b99 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:29.756122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d866891c6c422fabf23e1cd24be6b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.756743 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3971/7917] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:29.810549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d866891c6c422fabf23e1cd24be6b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.812417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1b8b59da-95b7-4553-a825-873e2e752d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d866891c6c422fabf23e1cd24be6b0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:29.827137 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3947/7918] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:29 2022] DELETE /identity/v3/users/b6d866891c6c422fabf23e1cd24be6b0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:29.831508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.833034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.833875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:29.877589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:29.878799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:29.923818 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:29.955945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:29.956527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:29.957021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:30.018276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] MFA Rules not processed for user `769bcdd2b058414380c3dccf14be7fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:30.019530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:30.181271 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3972/7919] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:30.192286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:30.200148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:30.229596 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3948/7920] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:30.335088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0da2cd-b163-45dd-bc31-12b5a5646a7b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:30.346410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:30.347404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:30.347945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:30.348496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:30.381068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:30.382658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:30.386603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:30.390492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118d760-859c-419e-b4cb-6e386001f369 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:30.415673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7bea-b7e6-4376-9514-6840cf5d3def None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:30.432420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:30.433404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:30.433795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:30.434143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] PATH_INFO: `/v3/projects/cf709e00a6624650b06ce36a78f0632e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:30.438373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf709e00a6624650b06ce36a78f0632e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:30.440344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:30.453942 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3973/7921] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:30.617018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf709e00a6624650b06ce36a78f0632e', 'request_id': 'req-76964a22-237a-4e1c-9585-47ce81639f77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:30.631658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf709e00a6624650b06ce36a78f0632e', 'request_id': 'req-76964a22-237a-4e1c-9585-47ce81639f77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:30.666136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf709e00a6624650b06ce36a78f0632e', 'request_id': 'req-76964a22-237a-4e1c-9585-47ce81639f77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:30.697495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] The token cache is being invalidate because project cf709e00a6624650b06ce36a78f0632e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:30.699041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:30.699978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76964a22-237a-4e1c-9585-47ce81639f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:30.702830 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3949/7922] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:30 2022] DELETE /identity/v3/projects/cf709e00a6624650b06ce36a78f0632e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:30.710220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:30.710509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:30.710791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:30.832225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:30.847716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:31.086572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:31.087186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:31.087652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:31.087790 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3974/7923] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:31.173635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:31.175198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:31.228200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:31.236344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3950/7924] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:31.247382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2a980-663a-417c-bd94-d1fefe61ae4c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:31.264198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:31.265727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:31.266277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:31.267339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:31.270047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:31.272400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:31.277614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:31.318171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:31.323973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3975/7925] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:31.330954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:31.336599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:31.340751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3ce5-cb8d-47cd-b25d-d08f7bb71ba0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:31.372642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:31.377379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:31.379668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:31.380163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:31.385512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:31.393783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1013b3-463a-4c96-9da0-3614171abb45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:31.394888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:31.411140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:31.412478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:31.417968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:31.418411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] PATH_INFO: `/v3/projects/36b227c0555e41a987e442c10c0c9e61` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:31.425227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b227c0555e41a987e442c10c0c9e61)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:31.564116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:31.565371 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:31.565371 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3951/7926] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:31 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:31.565371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:31.737894 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:31.737894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b227c0555e41a987e442c10c0c9e61', 'request_id': 'req-dc6f7936-b89a-4223-88aa-6ef36ec06223'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:31.737894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b227c0555e41a987e442c10c0c9e61', 'request_id': 'req-dc6f7936-b89a-4223-88aa-6ef36ec06223'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:31.737894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b227c0555e41a987e442c10c0c9e61', 'request_id': 'req-dc6f7936-b89a-4223-88aa-6ef36ec06223'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:31.822663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] The token cache is being invalidate because project 36b227c0555e41a987e442c10c0c9e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:31.823005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:31.834375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:31.848764 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3976/7927] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:31 2022] DELETE /identity/v3/projects/36b227c0555e41a987e442c10c0c9e61 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:31.853851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:31.878064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:31.950939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c63-3492-4426-a57a-7a8d4f3b1c56 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:32.097306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:32.098031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:32.098318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:32.098603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:32.099310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:32.103606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:32.171271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3952/7928] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:31 2022] POST /identity/v3/users => generated 300 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:32.175486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:32.183663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7936-b89a-4223-88aa-6ef36ec06223 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:32.189922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:32.208847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf21b-0a9d-438e-9c71-b5a5b25397d1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:32.209704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:32.213407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:32.213866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:32.214688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] PATH_INFO: `/v3/users/7c40a886225543d9875abd5903f03047` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:32.217881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c40a886225543d9875abd5903f03047)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:32.224858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:32.234888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:32.235585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:32.236077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:32.236307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:32.237008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:32.238696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:32.270955 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3953/7929] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:44:32.273747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:32.306125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768b00c-b41c-41bd-a0af-d6e8620046b8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:32.325510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:32.327556 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:32.330003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:32.330213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] PATH_INFO: `/v3/projects/d2d42fc8e6e54633851c447f00977446/users/40f2f26746cf46bdab0aa28e03f44186/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:32.359747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c40a886225543d9875abd5903f03047'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:32.363749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c40a886225543d9875abd5903f03047'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:32.414783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c40a886225543d9875abd5903f03047'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:32.417330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d42fc8e6e54633851c447f00977446, user_id=40f2f26746cf46bdab0aa28e03f44186, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:32.424414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:32.446150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c40a886225543d9875abd5903f03047'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:32.474012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c40a886225543d9875abd5903f03047'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:32.495891 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3977/7930] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:31 2022] DELETE /identity/v3/users/7c40a886225543d9875abd5903f03047 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:32.544485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:32.546219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3954/7931] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:32 2022] PUT /identity/v3/projects/d2d42fc8e6e54633851c447f00977446/users/40f2f26746cf46bdab0aa28e03f44186/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:32.547605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:32.922805 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:33.014697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cea5c4-f8f3-4cf4-a23e-3b8bdc5f2b91 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:33.029291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:33.031108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:33.031393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:33.031669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:33.032423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:33.036979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:33.066156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:33.081703 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3978/7932] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:33.281507 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:33.316370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ac201-0ff1-4a07-88cb-554b3316d4fe admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:33.386125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:33.390350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:33.390866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:33.391562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] PATH_INFO: `/v3/projects/d2d42fc8e6e54633851c447f00977446/users/40f2f26746cf46bdab0aa28e03f44186/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:33.396833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:33.400229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d42fc8e6e54633851c447f00977446, user_id=40f2f26746cf46bdab0aa28e03f44186, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:33.400865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:33.403668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580f413-4bd4-4bf1-afc0-b1b07a0d50e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:33.429088 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3955/7933] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:33 2022] PUT /identity/v3/projects/d2d42fc8e6e54633851c447f00977446/users/40f2f26746cf46bdab0aa28e03f44186/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:33.436984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:33.437336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:33.437701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:33.516490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2b047-f7c0-4c14-85b6-0f557f71962e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:33.582855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] MFA Rules not processed for user `40f2f26746cf46bdab0aa28e03f44186`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:33.607231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:33.723301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:33.726674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:33.727281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:33.728296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] PATH_INFO: `/v3/projects/937bf44b9b8543f7871dce206e8605be` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:33.732759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937bf44b9b8543f7871dce206e8605be)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:33.739998 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:33.889504 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3956/7934] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:33.894859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:33.928929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7a5df-6dd6-4ecd-aee0-246a8ec20ac2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:33.948775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937bf44b9b8543f7871dce206e8605be', 'request_id': 'req-111f45a0-3d04-4ec3-b9c0-68c671c25da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:33.958495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937bf44b9b8543f7871dce206e8605be', 'request_id': 'req-111f45a0-3d04-4ec3-b9c0-68c671c25da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:33.978183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937bf44b9b8543f7871dce206e8605be', 'request_id': 'req-111f45a0-3d04-4ec3-b9c0-68c671c25da4'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:34.006942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] The token cache is being invalidate because project 937bf44b9b8543f7871dce206e8605be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:34.007415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:34.018407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-111f45a0-3d04-4ec3-b9c0-68c671c25da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:34.021761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3979/7935] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:33 2022] DELETE /identity/v3/projects/937bf44b9b8543f7871dce206e8605be => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:34.030500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf8e07-8c60-4bb2-90be-1bf3e5f324a2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.031141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf8e07-8c60-4bb2-90be-1bf3e5f324a2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.031575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf8e07-8c60-4bb2-90be-1bf3e5f324a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.060610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d2cf8e07-8c60-4bb2-90be-1bf3e5f324a2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:34.062334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.063038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.063642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.064062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.065107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.069854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d2cf8e07-8c60-4bb2-90be-1bf3e5f324a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:34.071012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.084106 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3980/7936] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:34.093326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.093879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.094275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.121904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:34.124068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:34.142250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3981/7937] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:34.144295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.182839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee2a9-59a8-4a64-9d3f-102c27b32bc1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.192513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3957/7938] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:33 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:34.196659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.202800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:34.377314 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:34.378091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.378876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.380153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.384159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546287-4a41-4f36-827d-8a8cf2307f33 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.384512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.386168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:34.389092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.400580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.400961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.402065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.402723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.403169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.403891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.406136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.411606 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:34.452355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3958/7939] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:34 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:34.458063 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3982/7940] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:34.458799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.463190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.497865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3791183-4d03-4cd3-b51b-3b011768254c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.532319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.533334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.533859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.534276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.536080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.539200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.559377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4818e6-d4ff-4d6e-8d11-02caa21ca372 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.584781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.585685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.586239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.586665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.587585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.589904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.620172 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3983/7941] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:34 2022] POST /identity/v3/projects => generated 357 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:34.621633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.643441 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3959/7942] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:34.644572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.677525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7493b-3410-428a-9aa9-20500d36ee4d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.761077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2c71-131f-45ac-9cec-f0f2a2b4e99f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.775151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.776259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.777601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.778132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.781256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.783729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.883382 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3984/7943] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:34 2022] POST /identity/v3/users => generated 279 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:34.894481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.905722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.906901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.907847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.908340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.909306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.913945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.922950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc584e8e-82f7-4303-83f9-5ce46ba8e3db admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.945759 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3960/7944] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:34.948609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.949547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.950019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.950378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.950591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:34.952631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:34.954648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:34.971358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8f4bf-bc6d-4445-bb68-460bc86a61b2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:34.984935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:34.988895 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3985/7945] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:34.989731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:34.990110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:34.990502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:34.991009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] PATH_INFO: `/v3/projects/b61071721a314704b070e3ba4988974f/users/477ed5b4c0c4433d94aa1eca63870d2d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.019426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2a2a-d06e-4596-8e6a-1b7f682506c5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:35.025860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61071721a314704b070e3ba4988974f, user_id=477ed5b4c0c4433d94aa1eca63870d2d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:35.028368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:35.029472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.030567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.030991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.032051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:35.033117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:35.036581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4f54c-9b01-4979-af1c-d8d071131c24 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:35.058269 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3961/7946] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:34 2022] PUT /identity/v3/projects/b61071721a314704b070e3ba4988974f/users/477ed5b4c0c4433d94aa1eca63870d2d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:35.061212 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3986/7947] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:44:35.064822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:35.070964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1eb83-0941-404f-b5e6-245977045087 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.071669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1eb83-0941-404f-b5e6-245977045087 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.072308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1eb83-0941-404f-b5e6-245977045087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.203143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cde1eb83-0941-404f-b5e6-245977045087 None None] MFA Rules not processed for user `477ed5b4c0c4433d94aa1eca63870d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:35.204403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cde1eb83-0941-404f-b5e6-245977045087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:35.308312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05c1a8-df43-42be-a487-89bd840ba2a3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:35.323566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:35.339785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.340681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.341209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] PATH_INFO: `/v3/projects/c86aed30e16244d3b980f7d82265d8af/users/ac2fbaa21804488685946a455e08ffa8/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.402076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86aed30e16244d3b980f7d82265d8af, user_id=ac2fbaa21804488685946a455e08ffa8, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:35.413924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:35.445513 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3987/7948] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:35.461378 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3962/7949] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:35 2022] PUT /identity/v3/projects/c86aed30e16244d3b980f7d82265d8af/users/ac2fbaa21804488685946a455e08ffa8/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:35.469735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.472553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.473980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.478262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:35.482164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:35.543818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] MFA Rules not processed for user `ac2fbaa21804488685946a455e08ffa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:35.549070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:35.557712 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:35.613973 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:35.662649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6b6c4-b8a0-4733-b9d1-142b8000d79e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:35.673376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:35.674319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.674676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.674963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.678530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:35.773571 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3988/7950] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:35 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:35.786907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:35.788572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:35.925071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0fd2-aecc-4949-bc65-f462336edb7a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:35.930776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:35.931780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:35.932299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:35.932781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:35.936859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:35.941963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:35.945714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:35.948674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:35.961284 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3989/7951] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:44:35.983802 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3963/7952] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:36.652050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:36.654833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:36.713364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf59c8-f539-486a-9b69-d8db23bb3df4 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:36.735224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:36.738295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:36.739538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:36.741545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:36.749422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:36.788285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:36.790296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1a432-3fd1-4474-95cf-72348df75ec2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:36.807853 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3990/7953] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:37.143467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:37.344737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efb78b-8a7b-4945-acbd-7db6781bbe64 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:37.386603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:37.387540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:37.387927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:37.388201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] PATH_INFO: `/v3/users/40f2f26746cf46bdab0aa28e03f44186` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:37.390471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f2f26746cf46bdab0aa28e03f44186)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:37.392812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:37.569140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f2f26746cf46bdab0aa28e03f44186'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:37.587058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f2f26746cf46bdab0aa28e03f44186'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:37.610826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f2f26746cf46bdab0aa28e03f44186'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:37.647349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f2f26746cf46bdab0aa28e03f44186'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:37.649498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f2f26746cf46bdab0aa28e03f44186'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:37.652909 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:37.672473 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3964/7954] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:37 2022] DELETE /identity/v3/users/40f2f26746cf46bdab0aa28e03f44186 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:37.674385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:37.674831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:37.674997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:37.708426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:37.712990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:38.063753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3991/7955] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:38.118457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:38.120986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:38.322486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ac76b-1aa9-47ba-b671-a1b0ea1eb1c9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:38.344715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:38.345573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:38.346330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:38.346922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:38.364192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:38.367481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:38.388770 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3965/7956] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:39.393791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:39.395709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:39.587604 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:39.674599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa230f-5315-4c68-863d-9cc9175785d2 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:39.693302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:39.694016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:39.694305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:39.694579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:39.704735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:39.752167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:39.753839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:39.808908 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3992/7957] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:39.921530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:39.923016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:39.946840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d743-e811-41a0-b3c7-2a3de3537099 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:39.968325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:39.969269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:39.969558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:39.969864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] PATH_INFO: `/v3/projects/d2d42fc8e6e54633851c447f00977446` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:39.974182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d42fc8e6e54633851c447f00977446)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:39.976298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:40.149422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d42fc8e6e54633851c447f00977446', 'request_id': 'req-cfea8462-1695-405b-938d-e8b870667e7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.163941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d42fc8e6e54633851c447f00977446', 'request_id': 'req-cfea8462-1695-405b-938d-e8b870667e7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.181097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d42fc8e6e54633851c447f00977446', 'request_id': 'req-cfea8462-1695-405b-938d-e8b870667e7a'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.223130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] The token cache is being invalidate because project d2d42fc8e6e54633851c447f00977446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:40.226316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.228275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.231513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3966/7958] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:39 2022] DELETE /identity/v3/projects/d2d42fc8e6e54633851c447f00977446 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:40.236298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:40.255304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38971-e808-438d-9210-33f10f22cc07 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:40.500339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:40.503598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:40.503912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:40.504203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] PATH_INFO: `/v3/users/477ed5b4c0c4433d94aa1eca63870d2d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:40.509233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] RBAC: Authorizing `identity:delete_user(user_id=477ed5b4c0c4433d94aa1eca63870d2d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:40.513208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:40.683407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477ed5b4c0c4433d94aa1eca63870d2d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.685835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477ed5b4c0c4433d94aa1eca63870d2d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.709595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477ed5b4c0c4433d94aa1eca63870d2d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.748838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477ed5b4c0c4433d94aa1eca63870d2d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.800701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-914dbada-bd20-4868-b1e7-58ca091c436e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477ed5b4c0c4433d94aa1eca63870d2d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:40.815216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3993/7959] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:40 2022] DELETE /identity/v3/users/477ed5b4c0c4433d94aa1eca63870d2d => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:42.403466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:42.405657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:42.428567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea8462-1695-405b-938d-e8b870667e7a admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:42.627831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:42.628760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:42.629046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:42.629323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] PATH_INFO: `/v3/projects/b61071721a314704b070e3ba4988974f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:42.632727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61071721a314704b070e3ba4988974f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:42.634793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:42.731418 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:42.798404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61071721a314704b070e3ba4988974f', 'request_id': 'req-570d5ce7-9aa7-4dac-98c1-b1706326ad01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:42.825403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61071721a314704b070e3ba4988974f', 'request_id': 'req-570d5ce7-9aa7-4dac-98c1-b1706326ad01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:42.853292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61071721a314704b070e3ba4988974f', 'request_id': 'req-570d5ce7-9aa7-4dac-98c1-b1706326ad01'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:42.888773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] The token cache is being invalidate because project b61071721a314704b070e3ba4988974f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:42.889864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:42.891973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-570d5ce7-9aa7-4dac-98c1-b1706326ad01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:42.901263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3967/7960] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:42 2022] DELETE /identity/v3/projects/b61071721a314704b070e3ba4988974f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:42.907113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:42.907974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:42.908406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:42.952249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:42.959267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:43.183619 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:43.221536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.221877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.222155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.222727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3994/7961] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:43.278932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:43.280412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:43.296443 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3968/7962] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:43.300380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.316579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27072-1f24-4bf1-98fa-96d912400ffa None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.331695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.332389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.332676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.332957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.333953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:43.334420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:43.336207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:43.360759 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3995/7963] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:44:43.364842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.378431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f88207-5c8f-46a6-8c52-992ba714268e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.391709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.392624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.393055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.393467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.394469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:43.396889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:43.495262 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3969/7964] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:43 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:43.496961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.516969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56e3d-eafe-4722-bc8a-305c7b65c34a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.680543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.681750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.682240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.682712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.683766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:43.687110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:43.731821 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3996/7965] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:43 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:43.735952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.747284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0fd1-7812-4822-9b97-70123dca29f8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.775990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12084da9-120e-4319-869a-c7712657972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.776774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084da9-120e-4319-869a-c7712657972e admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.777001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084da9-120e-4319-869a-c7712657972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.777281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084da9-120e-4319-869a-c7712657972e admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.778061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12084da9-120e-4319-869a-c7712657972e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:43.780239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12084da9-120e-4319-869a-c7712657972e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:43.836459 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3970/7966] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:43.840428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.863050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c8d0-4cea-47d3-81f5-9a20287e6153 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.879856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.880848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.881313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.881879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:43.882803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:43.884788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24b43b-1b48-4693-b1c1-360e45c15e7a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:43.898709 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3997/7967] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:43.902813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12084da9-120e-4319-869a-c7712657972e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:43.958057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12084da9-120e-4319-869a-c7712657972e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:43.987827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:43.997033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:43.997802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:43.999046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] PATH_INFO: `/v3/projects/fe763473071145ce9f04bfa3e16e4025/users/72938f32b0274bd59aed3daa2144cc10/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:44.068246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe763473071145ce9f04bfa3e16e4025, user_id=72938f32b0274bd59aed3daa2144cc10, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:44.075470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:44.108590 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3971/7968] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:43 2022] PUT /identity/v3/projects/fe763473071145ce9f04bfa3e16e4025/users/72938f32b0274bd59aed3daa2144cc10/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:44.123764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cdd9-06f6-4e23-ab68-8b35f9201a5c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:44.124288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cdd9-06f6-4e23-ab68-8b35f9201a5c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:44.124288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700cdd9-06f6-4e23-ab68-8b35f9201a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:44.207404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e700cdd9-06f6-4e23-ab68-8b35f9201a5c None None] MFA Rules not processed for user `72938f32b0274bd59aed3daa2144cc10`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:44.208977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e700cdd9-06f6-4e23-ab68-8b35f9201a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:44.410518 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3998/7969] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:44.427002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:44.428975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:44.645176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a2f5-0a7e-4e31-bc93-12a3b8dfacc8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:44.656077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:44.656763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:44.657050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:44.657323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:44.681501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:44.684688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:44.708283 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3972/7970] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:45.039900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778685c9-6bc9-4ad8-86eb-d33462ded97e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:45.040186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778685c9-6bc9-4ad8-86eb-d33462ded97e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:45.040462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778685c9-6bc9-4ad8-86eb-d33462ded97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:45.112571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-778685c9-6bc9-4ad8-86eb-d33462ded97e None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:45.145659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-778685c9-6bc9-4ad8-86eb-d33462ded97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:45.316348 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:45.394428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 3999/7971] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:45.503422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:45.504919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:45.632907 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:45.704955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bd7b3-f292-4a98-b107-d00ccc33ac60 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:45.746275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:45.750353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:45.753164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:45.755045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:45.783622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:45.785626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:45.809594 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3973/7972] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:46.939033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:46.939889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:46.940479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:46.986607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:46.988063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:47.013540 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4000/7973] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:47.046170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:47.065486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be391e-bf01-4e9f-bdaf-adaf8a8780d8 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:47.101933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:47.103867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:47.105542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:47.106594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:47.168229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:47.171928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5b1b-9ce0-461f-8c0a-0c6d0b965a66 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:47.202736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3974/7974] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:47.303231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:47.304687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:47.505917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945d177-8edd-4075-87f7-4ae3c567aef0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:47.529966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:47.531252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:47.538182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:47.538741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] PATH_INFO: `/v3/users/f0d48f4a8ba2418f9f79e5e097de9326` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:47.546557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d48f4a8ba2418f9f79e5e097de9326)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:47.549219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:47.718163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d48f4a8ba2418f9f79e5e097de9326'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:47.719141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d48f4a8ba2418f9f79e5e097de9326'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:47.754468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d48f4a8ba2418f9f79e5e097de9326'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:47.784635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d48f4a8ba2418f9f79e5e097de9326'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:47.835884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7940553e-72d3-4832-9517-642fa6dafe8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d48f4a8ba2418f9f79e5e097de9326'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:47.873273 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4001/7975] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:47 2022] DELETE /identity/v3/users/f0d48f4a8ba2418f9f79e5e097de9326 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:47.877959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:47.878534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:47.879004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:47.939894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:47.941168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:47.997637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:47.998701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:47.999175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:48.039959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:48.045084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:48.076825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3975/7976] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:48.100437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:48.102788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:48.230796 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4002/7977] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:48.245198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:48.246846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:48.281476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4503-28f9-4daa-898e-c9a4069b4aef None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:48.288832 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:48.317929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:48.318925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:48.321003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:48.322256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:48.356574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:48.363827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5f7f7-aef7-4483-ae0e-d09018906559 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:48.406977 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3976/7978] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:48.519918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f1848-63bc-41ed-a48c-56a77ebbedfb None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:48.546078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:48.546756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:48.552169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:48.552472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:48.578368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:48.581292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:48.603543 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4003/7979] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:44:49.003455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:49.004272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:49.004881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:49.047958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:49.050143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:49.078675 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3977/7980] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:49.086275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:49.113288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7812257-e294-4013-b6b8-817e769ac151 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:49.145398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:49.151397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:49.151691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:49.151989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:49.180756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:49.184969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:49.227561 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4004/7981] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:49.631534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:49.633660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:49.698102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26af8d6-e022-4282-8003-9dc564f93e14 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:49.716882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:49.718132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:49.718568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:49.720980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] PATH_INFO: `/v3/projects/7b5b3a70865d44aba9d237aeac80b066` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:49.724500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5b3a70865d44aba9d237aeac80b066)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:49.740649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:49.897655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5b3a70865d44aba9d237aeac80b066', 'request_id': 'req-b21f7178-eb36-4ba1-ace4-84f8882ec313'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:49.912496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5b3a70865d44aba9d237aeac80b066', 'request_id': 'req-b21f7178-eb36-4ba1-ace4-84f8882ec313'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:49.948159 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:49.951839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5b3a70865d44aba9d237aeac80b066', 'request_id': 'req-b21f7178-eb36-4ba1-ace4-84f8882ec313'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:49.988120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] The token cache is being invalidate because project 7b5b3a70865d44aba9d237aeac80b066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:49.988739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:49.989772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b21f7178-eb36-4ba1-ace4-84f8882ec313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:49.996638 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3978/7982] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:49 2022] DELETE /identity/v3/projects/7b5b3a70865d44aba9d237aeac80b066 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:50.001020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:50.031185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac2fa6-e5b4-41e1-a752-0e8017a3b1e2 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:50.202723 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:50.205092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:50.205382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:50.205660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] PATH_INFO: `/v3/users/acf08922664e4e60a51bf7726027fa1d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:50.210826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf08922664e4e60a51bf7726027fa1d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:50.219582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:50.264743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:50.265555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:50.266021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:50.314768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:50.320384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:50.352640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf08922664e4e60a51bf7726027fa1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:50.353480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf08922664e4e60a51bf7726027fa1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:50.366053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf08922664e4e60a51bf7726027fa1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:50.381933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf08922664e4e60a51bf7726027fa1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:50.405596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf08922664e4e60a51bf7726027fa1d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:50.429459 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4005/7983] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:49 2022] DELETE /identity/v3/users/acf08922664e4e60a51bf7726027fa1d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:50.601556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:50.602141 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3979/7984] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 24 01:44:50.603195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:50.622708 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:50.803262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365e7a-5bff-4362-b6a6-f0bcbc2fed2c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:50.820579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:50.821259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:50.821543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:50.821848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:50.947032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:50.948711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1d4bf-a9f3-433a-8797-41841899a586 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:50.978789 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4006/7985] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:44:51.254786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:51.256472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:51.367851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6d186-bb0f-4ee2-8c2e-f02dd27617e0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:51.408031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:51.408476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:51.408596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:51.467241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:51.468624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:51.499827 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4007/7986] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:44:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:51.515245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:51.547886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527707-762b-4b41-9697-b79e50c35481 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:51.573354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:51.578893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:51.579397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:51.581244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:51.604453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:51.606612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:51.607126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:51.607565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] PATH_INFO: `/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:51.608993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] RBAC: Authorizing `identity:delete_project(project_id=754d4ef8e3684b96afe47d85f0bea5d1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:51.611119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:51.620903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:51.637273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3407ef-4029-4b43-a9f3-9b1627316162 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:51.674664 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4008/7987] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:51.727801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754d4ef8e3684b96afe47d85f0bea5d1', 'request_id': 'req-969e2d92-2f9a-4c72-a37f-cc292e8aceae'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:51.741037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754d4ef8e3684b96afe47d85f0bea5d1', 'request_id': 'req-969e2d92-2f9a-4c72-a37f-cc292e8aceae'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:51.765145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754d4ef8e3684b96afe47d85f0bea5d1', 'request_id': 'req-969e2d92-2f9a-4c72-a37f-cc292e8aceae'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:51.797657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] The token cache is being invalidate because project 754d4ef8e3684b96afe47d85f0bea5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:51.798244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:51.801027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:51.807815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3980/7988] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:51 2022] DELETE /identity/v3/projects/754d4ef8e3684b96afe47d85f0bea5d1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:51.809489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5dc75-7b0a-4c3c-bc43-eed784d78657 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:51.809885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5dc75-7b0a-4c3c-bc43-eed784d78657 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:51.810327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5dc75-7b0a-4c3c-bc43-eed784d78657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:51.916805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-85d5dc75-7b0a-4c3c-bc43-eed784d78657 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:51.920940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85d5dc75-7b0a-4c3c-bc43-eed784d78657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:51.977285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:51.979186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:52.091162 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:52.145139 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4009/7989] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:52.149349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.149999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.150288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.219884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e2d92-2f9a-4c72-a37f-cc292e8aceae admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.221927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:52.223730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:52.231211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.232326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.232719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.233101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] PATH_INFO: `/v3/users/72938f32b0274bd59aed3daa2144cc10` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.234962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72938f32b0274bd59aed3daa2144cc10)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.237533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.244901 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4010/7990] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:52.252710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.280947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58074ff-916d-4601-b01c-4b4c711c5c08 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.307225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.308006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.308396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.308776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.309705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:52.312129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.313127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.339019 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4011/7991] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:44:52.344450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.361344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72938f32b0274bd59aed3daa2144cc10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:52.385209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72938f32b0274bd59aed3daa2144cc10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:52.393959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f57f-87ea-43af-a46c-7505eb3fbdc6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.395395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72938f32b0274bd59aed3daa2144cc10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:52.410349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72938f32b0274bd59aed3daa2144cc10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:52.411250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-76954272-2f74-451e-923e-c3a8ee3927d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72938f32b0274bd59aed3daa2144cc10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:52.412396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.419113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.419962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.420254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.420488 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3981/7992] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:44:51 2022] DELETE /identity/v3/users/72938f32b0274bd59aed3daa2144cc10 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:52.424398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.425406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.425861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.426236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.426400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.439698 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:52.459172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:52.462959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:52.501125 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4012/7993] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:52 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:52.504258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.508905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:52.690028 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3982/7994] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:52.703392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.704872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:52.745697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb17c1-5702-4e92-b053-d73da6b613c8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.751944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.752747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.753147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.753515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.754505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.757084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.795261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4013/7995] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:52 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:52.796334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.815285 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:52.821788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2cde-a94d-46e0-b743-f66b8e036797 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.828483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.829724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.830217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.830634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.831515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.833352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.836417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646db67-460c-4b19-be79-6ebe18169bdf None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.847035 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4014/7996] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:52.868778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.932134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db01a-3983-41b7-a51c-e0e17147204b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:52.952609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.953298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.953587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.953902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.955014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.965056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:52.968485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:52.969088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:52.969372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:52.969646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:52.985647 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4015/7997] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:52.986701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:52.996390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:52.999044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776590a-538a-45c5-8bd9-01583ec3df3b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:53.003436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc49af8-81e3-47bc-b42d-17f14de31290 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:53.004344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:53.005187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.005621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.006064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] PATH_INFO: `/v3/projects/469b6a2c1c35404e87006fe815a5c7df/users/28c2d585280d40d3a16a5b5c84097665/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.059494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b6a2c1c35404e87006fe815a5c7df, user_id=28c2d585280d40d3a16a5b5c84097665, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:53.066713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:53.083855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3983/7998] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:44:53.091299 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4016/7999] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:52 2022] PUT /identity/v3/projects/469b6a2c1c35404e87006fe815a5c7df/users/28c2d585280d40d3a16a5b5c84097665/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:53.227266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.227918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.228425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.279692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] MFA Rules not processed for user `28c2d585280d40d3a16a5b5c84097665`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:53.281405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:53.413243 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3984/8000] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:53.414183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:53.574285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc553e6-7f39-482c-b1ca-f21ee3892ee7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:53.596833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:53.597641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.599054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.599413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.600369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:53.603633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10637f1c-53ed-4c16-a5d0-236d3a69b8eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:53.694948 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4017/8001] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:53 2022] POST /identity/v3/projects => generated 383 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:44:53.696326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:53.714550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a9fb7-60da-4b6b-8780-ae1dccab4f1f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:53.827987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:53.828339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.828696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.829187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.830751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:53.832328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:53.842963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.843250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.843532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.879839 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3985/8002] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:53 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:53.881144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:53.888848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] MFA Rules not processed for user `769bcdd2b058414380c3dccf14be7fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:53.890463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:53.905997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2b162-8c11-458d-9f21-31de255c6bb4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:53.913378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:53.914310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.914691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.915033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:53.916032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:53.917863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:53.940323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3986/8003] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:53.945075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:53.949104 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:53.968526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4c81-809f-4f3f-b3a5-1f4bcc87ba7b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:53.986215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:53.987554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:53.988048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:53.988534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] PATH_INFO: `/v3/projects/be47764e305d41b09d75b581e10a09d7/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.015795 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:54.035190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be47764e305d41b09d75b581e10a09d7, user_id=d8e9c8c3c2fc4b3a91c39dfe8e257eed, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.039502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.071900 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3987/8004] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:53 2022] PUT /identity/v3/projects/be47764e305d41b09d75b581e10a09d7/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:54.076073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.081415 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4018/8005] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:54.200601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.203880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:54.265279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c020f0-4416-4823-bdfb-0c552e12b996 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:54.293387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf198-9fc9-4c38-9bfe-bcdce68d9fcd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:54.299522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:54.300826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.301247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.301407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:54.301866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] PATH_INFO: `/v3/projects/fe763473071145ce9f04bfa3e16e4025` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.302138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.302426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.302702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.303455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.304165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe763473071145ce9f04bfa3e16e4025)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.305416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.320985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.322599 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3988/8006] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:54.344309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.379293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecadc7-5bf0-4e4b-9ce8-404a3d797250 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:54.392468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe763473071145ce9f04bfa3e16e4025', 'request_id': 'req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:54.399439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe763473071145ce9f04bfa3e16e4025', 'request_id': 'req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:54.437802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe763473071145ce9f04bfa3e16e4025', 'request_id': 'req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:54.474977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] The token cache is being invalidate because project fe763473071145ce9f04bfa3e16e4025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:44:54.476413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:54.480761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-51ca6fe3-5f8b-4e8c-80cd-02c138202d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:44:54.483907 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4019/8007] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:44:54 2022] DELETE /identity/v3/projects/fe763473071145ce9f04bfa3e16e4025 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:44:54.489542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838522d-02c4-4637-8670-d295140adfcc None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.490090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838522d-02c4-4637-8670-d295140adfcc None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.490636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838522d-02c4-4637-8670-d295140adfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.538315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1838522d-02c4-4637-8670-d295140adfcc None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:54.539566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1838522d-02c4-4637-8670-d295140adfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:54.540466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:54.541486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.541789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.542068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] PATH_INFO: `/v3/projects/be47764e305d41b09d75b581e10a09d7/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.544348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be47764e305d41b09d75b581e10a09d7, user_id=d8e9c8c3c2fc4b3a91c39dfe8e257eed, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.547614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d76a3-b4d5-4b9c-9eeb-2cdcbf27cc64 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.555130 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4020/8008] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:54.559172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.559438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.559724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.569856 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3989/8009] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:54 2022] PUT /identity/v3/projects/be47764e305d41b09d75b581e10a09d7/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:54.580578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.580875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.581138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.610594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:54.613400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:54.637214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] MFA Rules not processed for user `d8e9c8c3c2fc4b3a91c39dfe8e257eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:54.640727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:54.770873 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4021/8010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:54.773794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.804048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156641c-a980-49b9-92c3-d0d4c1d3b986 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:54.808967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:54.809642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.811102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.811416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.812248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:44:54.812689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.814378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.818745 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3990/8011] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:54.825386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.827440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:54.833217 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:54.837737 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4022/8012] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:44:54.845593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.859527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc36af-9b3c-4913-94f2-3e0b1b694085 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:54.870623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:54.871309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:54.871596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:54.871873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:54.873143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:54.875180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:54.919479 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4023/8013] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:44:54 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:54.920658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:54.938837 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:54.950562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114d668-2899-4071-85bd-35101d2e5b9b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:55.020205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:55.021051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.021932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.022280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.025246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:55.096887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818faabe-d517-4d2d-b42a-8e850ceec95e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:55.102111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:55.102795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.103363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.103647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.104350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:55.106811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:55.142999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4024/8014] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:44:54 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:44:55.146834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:55.157943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628d73-bbf6-41f8-a964-713cca43cd04 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:55.162763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:55.163426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.163757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.164040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.164772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:55.166418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:55.167827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:55.170067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:55.180705 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3991/8015] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:44:55.181851 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4025/8016] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:44:55.186731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:55.199053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930c84-b781-4e0d-bee7-4a87a7f0a6f4 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:55.227034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:55.227034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.227034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.227034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.227446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:55.227446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e144d1-deaa-421c-981e-9fcb65d645a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:55.248598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3992/8017] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:44:55.249461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:55.266643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c3262-a494-49fa-a5c6-15d6c99ce269 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:55.273001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:55.274278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.274717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.275501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] PATH_INFO: `/v3/projects/d883d94f96834e5c83026059cdcf153e/users/d8d6c0f2722b41448e8e4744cf5d7c65/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.302867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d883d94f96834e5c83026059cdcf153e, user_id=d8d6c0f2722b41448e8e4744cf5d7c65, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:55.305564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:55.345318 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4026/8018] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:44:55 2022] PUT /identity/v3/projects/d883d94f96834e5c83026059cdcf153e/users/d8d6c0f2722b41448e8e4744cf5d7c65/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:44:55.357058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8ff3-f081-45dd-86c7-387f93c88515 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:55.358054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8ff3-f081-45dd-86c7-387f93c88515 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:55.358514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8ff3-f081-45dd-86c7-387f93c88515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:55.403011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f95d8ff3-f081-45dd-86c7-387f93c88515 None None] MFA Rules not processed for user `d8d6c0f2722b41448e8e4744cf5d7c65`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:55.405332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f95d8ff3-f081-45dd-86c7-387f93c88515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:55.523781 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:55.621499 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3993/8019] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:55.640158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:55.642183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:55.997378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57a75-f474-4e09-889a-15af52f7a08f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:56.045485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:56.048344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:56.048592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:56.048888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:56.109178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:56.112612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:56.138373 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4027/8020] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:56.350016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc6b2-b031-465d-bd1d-a28b2e691fb4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:56.351285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc6b2-b031-465d-bd1d-a28b2e691fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:56.351668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc6b2-b031-465d-bd1d-a28b2e691fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:56.392179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8e8fc6b2-b031-465d-bd1d-a28b2e691fb4 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:56.410582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e8fc6b2-b031-465d-bd1d-a28b2e691fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:56.582715 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3994/8021] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:56.602553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:56.605036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:56.741871 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:44:56.759074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ada46-c077-45b0-885d-5d7ab34dae9d service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:56.777619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:56.779508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:56.779508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:56.779508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:56.813424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:56.816357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:56.837285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4028/8022] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:57.503276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b503bf-696b-4e10-bb84-2c3579f878af None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:57.504117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b503bf-696b-4e10-bb84-2c3579f878af None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:57.504728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b503bf-696b-4e10-bb84-2c3579f878af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:57.554167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-00b503bf-696b-4e10-bb84-2c3579f878af None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:57.556035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00b503bf-696b-4e10-bb84-2c3579f878af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:57.604818 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3995/8023] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:57.665954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:57.685504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3fd73-7cd6-4f4a-9b59-82847d3fe70a service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:57.692291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:57.693136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:57.693572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:57.694774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:57.706432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:57.708615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:57.720979 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4029/8024] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:58.298196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b4d3-408c-4189-9a99-a0e1e5fff74c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:58.298482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b4d3-408c-4189-9a99-a0e1e5fff74c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:58.298763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99b4d3-408c-4189-9a99-a0e1e5fff74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:58.332641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ab99b4d3-408c-4189-9a99-a0e1e5fff74c None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:58.333908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ab99b4d3-408c-4189-9a99-a0e1e5fff74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:58.359195 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3996/8025] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:58.373039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:58.395154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be197-b4f8-414b-b577-c662b9ce7844 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:58.416740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:58.420590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:58.421080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:58.421508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:58.441529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:58.449779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:58.471073 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4030/8026] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:44:58.949514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:58.950074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:58.950263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:59.010758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:59.011980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:59.069134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3997/8027] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:44:59.069934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:59.095735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b35f-6930-4500-b75b-229f79c1fd44 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:59.112671 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:59.113344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:59.113633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:59.113953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:59.140454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:59.142567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f4409-cbf9-404d-8a5a-fca93af00770 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:59.168739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4031/8028] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:44:59.365479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:44:59.367814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:59.455363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd532-9fdc-42a7-bbf5-100f01cf5f1c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:44:59.460369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:44:59.462170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:59.462897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:59.463346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:59.465534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:59.484831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:44:59.486424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:44:59.502937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3998/8029] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:44:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:44:59.879436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017aba-744c-41ac-86df-0600c95421a7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:44:59.879942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017aba-744c-41ac-86df-0600c95421a7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:44:59.880219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017aba-744c-41ac-86df-0600c95421a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:44:59.924662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-00017aba-744c-41ac-86df-0600c95421a7 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:44:59.928025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-00017aba-744c-41ac-86df-0600c95421a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:44:59.963897 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4032/8030] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:44:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:44:59.986026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:00.026777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043fb3-2c4a-4529-9828-9246e5b601e3 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:00.041607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:00.042636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:00.047158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:00.049319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:00.086292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:00.089363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:00.129503 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 3999/8031] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:44:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:00.645402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:00.645939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:00.646361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:00.678752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:00.680225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:00.703659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4033/8032] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:00.716207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:00.732637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357ec7-5891-4480-848c-426f54d0cf15 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:00.744319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:00.745291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:00.745632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:00.745916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:00.758702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:00.760743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be499b-5410-49c4-97f2-961f9bd0e2f7 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:00.779250 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4000/8033] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:02.814370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:02.816371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:02.968551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e323e-82b8-4111-9a41-9f1c244cccfa None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:02.975470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:02.976731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:02.977162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:02.977582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:03.112814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:03.123527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:03.154693 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4034/8034] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:03.656521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dfe24-2f6f-4b4e-a8c4-bca0ab495e81 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:03.657032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dfe24-2f6f-4b4e-a8c4-bca0ab495e81 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:03.657106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dfe24-2f6f-4b4e-a8c4-bca0ab495e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:03.702172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d20dfe24-2f6f-4b4e-a8c4-bca0ab495e81 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:03.703422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d20dfe24-2f6f-4b4e-a8c4-bca0ab495e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:03.735068 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4001/8035] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:03.736199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:03.758620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48133-7d6b-48ff-8a16-f254b171b557 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:03.769982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:03.773150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:03.773460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:03.773769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:03.798440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:03.800334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:03.825129 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4035/8036] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:45:04.214236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b96611-c605-4c5a-a0f4-329abac07374 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:04.214524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b96611-c605-4c5a-a0f4-329abac07374 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:04.214971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b96611-c605-4c5a-a0f4-329abac07374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:04.246366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d0b96611-c605-4c5a-a0f4-329abac07374 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:04.249085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d0b96611-c605-4c5a-a0f4-329abac07374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:04.264156 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4002/8037] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:04.280359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:04.303769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5c47-a419-42f4-858d-2a6bfcef0316 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:04.312791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:04.313783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:04.314385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:04.314848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:04.327542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:04.334971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:04.375344 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4036/8038] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:04.662375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ad90-c7f8-4e7d-935b-c7edf8798eab None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:04.662817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ad90-c7f8-4e7d-935b-c7edf8798eab None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:04.662928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ad90-c7f8-4e7d-935b-c7edf8798eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:04.705773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e1b5ad90-c7f8-4e7d-935b-c7edf8798eab None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:04.707256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e1b5ad90-c7f8-4e7d-935b-c7edf8798eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:04.728280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4003/8039] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:04.743845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:04.765986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1834af-a6c4-4bfd-9181-1a6a8e2c5f0b service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:04.780532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:04.782219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:04.784384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:04.784912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:04.804787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:04.806925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:04.865530 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4037/8040] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:05.160856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08af5-e295-45e2-994b-0fd2fc6f2e75 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:05.161465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08af5-e295-45e2-994b-0fd2fc6f2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:05.161975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08af5-e295-45e2-994b-0fd2fc6f2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:05.211699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e0a08af5-e295-45e2-994b-0fd2fc6f2e75 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:05.213971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e0a08af5-e295-45e2-994b-0fd2fc6f2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:05.245126 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4004/8041] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:05.245281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:05.264817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e906e8-f72c-45bd-8488-111a91e7d765 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:05.270558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:05.271338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:05.271864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:05.272242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:05.289276 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:05.292438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:05.295030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:05.310122 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4038/8042] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:45:05.714375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d72-72c1-4370-b8d3-1ee33f7f6ce2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:05.714850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d72-72c1-4370-b8d3-1ee33f7f6ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:05.714952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d72-72c1-4370-b8d3-1ee33f7f6ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:05.755550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8e2e2d72-72c1-4370-b8d3-1ee33f7f6ce2 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:05.758257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e2e2d72-72c1-4370-b8d3-1ee33f7f6ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:05.790509 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4005/8043] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:05.808017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:05.831017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873cecc-5e59-489a-98b5-24f509aae350 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:05.867225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:05.868011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:05.868198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:05.868445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:05.880742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:05.883128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:05.893753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4039/8044] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:06.239883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:06.240415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:06.241245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:06.293653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:06.299377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:06.353825 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4006/8045] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:45:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:06.369621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:06.428031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8ab8b-1dd3-4324-aecd-762e58f20e64 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:06.462611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:06.467798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:06.469175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:06.469816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:06.508456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:06.510853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130378a1-4789-4d63-a0c9-9dd3e8cb58d1 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:06.570009 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4040/8046] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:45:06.877277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:06.901468 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:07.021874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823f3a-6be8-4421-a522-3e0d92b04dd2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:07.037243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:07.038500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:07.038990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:07.039491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] PATH_INFO: `/v3/users/d8d6c0f2722b41448e8e4744cf5d7c65` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:07.041777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d6c0f2722b41448e8e4744cf5d7c65)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:07.044076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:07.283987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d6c0f2722b41448e8e4744cf5d7c65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:07.335068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d6c0f2722b41448e8e4744cf5d7c65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:07.365854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d6c0f2722b41448e8e4744cf5d7c65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:07.408576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d6c0f2722b41448e8e4744cf5d7c65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:07.409942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d6c0f2722b41448e8e4744cf5d7c65'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:07.429081 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4007/8047] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:06 2022] DELETE /identity/v3/users/d8d6c0f2722b41448e8e4744cf5d7c65 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:07.434588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:07.435488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:07.435973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:07.479468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:07.486675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:07.703847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:07.705905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:07.722481 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4041/8048] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:07.921078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4370a5-801b-4e75-9dd2-33c3fca79934 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:07.937613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:07.938530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:07.942819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:07.943372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:07.975463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:07.982352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d1c30-955e-47c9-b5ec-9ca2149f523a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:08.026674 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4008/8049] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:45:09.166908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:09.168598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:09.198812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a430-4324-4d23-a7ff-e58b5584c39a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:09.220732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:09.225567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:09.225993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:09.226355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] PATH_INFO: `/v3/projects/d883d94f96834e5c83026059cdcf153e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:09.238584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d883d94f96834e5c83026059cdcf153e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:09.240661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:09.363564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd883d94f96834e5c83026059cdcf153e', 'request_id': 'req-f001f878-292a-4f03-9c92-04bdf668993b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:09.384147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd883d94f96834e5c83026059cdcf153e', 'request_id': 'req-f001f878-292a-4f03-9c92-04bdf668993b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:09.398977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd883d94f96834e5c83026059cdcf153e', 'request_id': 'req-f001f878-292a-4f03-9c92-04bdf668993b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:09.423858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] The token cache is being invalidate because project d883d94f96834e5c83026059cdcf153e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:09.424237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:09.425959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f001f878-292a-4f03-9c92-04bdf668993b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:09.428995 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4042/8050] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:09 2022] DELETE /identity/v3/projects/d883d94f96834e5c83026059cdcf153e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:09.434139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b242e-d703-49e6-bff0-499019933e58 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:09.435271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b242e-d703-49e6-bff0-499019933e58 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:09.435605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b242e-d703-49e6-bff0-499019933e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:09.469158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-364b242e-d703-49e6-bff0-499019933e58 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:09.471966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-364b242e-d703-49e6-bff0-499019933e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:09.642869 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:09.821117 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4009/8051] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:09.830054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:09.830054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:09.830054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:09.855563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:09.857588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:09.867525 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4043/8052] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:09.872456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b242e-d703-49e6-bff0-499019933e58 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:09.883397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b242e-d703-49e6-bff0-499019933e58 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:09.905405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:09.906276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:09.906783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:09.907194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:09.907967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:09.908342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:09.912946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:09.944683 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4010/8053] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:09.947574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:09.965146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084bf83-a389-43d6-8986-0c09fe62c592 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:09.973519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:09.974236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:09.974516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:09.974792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:09.975505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:09.985104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:10.042020 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4044/8054] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:09 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:10.045790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:10.059199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c5c55-4486-418a-a820-5f34dddfb7db admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:10.318771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:10.319549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:10.320058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:10.320359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:10.327968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:10.331117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:10.426327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4011/8055] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:10 2022] POST /identity/v3/users => generated 293 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:10.432410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:10.464937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8fb8-dc2c-44d8-8cff-f7057e1fb9e9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:10.500611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:10.506625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:10.507228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:10.511840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:10.513759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:10.528272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:10.608347 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4045/8056] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:45:10.612510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:10.634093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba26e3-e5d9-4c80-bdaf-59fc976b10df admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:10.658222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:10.661144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:10.661584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:10.662039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:10.664591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:10.669937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d94a35-88c8-44e9-82dd-66939c9a0889 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:10.713566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:10.727108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613e1c-fb49-43ab-81bc-261c78373209 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:10.728631 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4012/8057] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:10.747357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:10.755724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:10.756242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:10.756690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] PATH_INFO: `/v3/projects/35f1880c271546b68f72ed33220224a2/users/8d62a92dc9fc482092d887e611288ade/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:10.790121 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:10.801215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f1880c271546b68f72ed33220224a2, user_id=8d62a92dc9fc482092d887e611288ade, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:10.806427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:10.859971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4046/8058] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:10 2022] PUT /identity/v3/projects/35f1880c271546b68f72ed33220224a2/users/8d62a92dc9fc482092d887e611288ade/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:10.863092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:10.863622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:10.864094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:10.951824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] MFA Rules not processed for user `8d62a92dc9fc482092d887e611288ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:10.957185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:11.229339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:11.229847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4013/8059] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:11.417805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:11.420352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:11.542730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cf761-1f9e-4f4e-ad72-6b5bd979e75e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:11.570456 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:11.578313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:11.579266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:11.580632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:11.581718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:11.583358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:11.586352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:11.769445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4047/8060] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:11 2022] POST /identity/v3/projects => generated 385 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:11.780135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:11.790115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b75d7-ddc5-4e7b-81c5-9225e1d6b4e7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:12.015488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:12.020382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.021415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.021415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.027149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:12.088467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:12.093957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:12.097747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53534-2f5f-4c1e-9d5e-9e44767ae7b7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:12.149950 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4014/8061] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:45:12.157689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:12.158401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.158716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.159727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.165417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:12.167447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:12.412772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4048/8062] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:11 2022] POST /identity/v3/users => generated 293 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:12.416635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:12.459188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4fce7-e56b-494e-ae40-b382b6488763 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:12.486415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:12.487163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.487378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.487651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.490676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:12.495754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:12.594790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:12.601440 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4015/8063] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:12.613304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692363d0-1a93-4d6b-b61c-473d70bd1016 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:12.622791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:12.623728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.624148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.624595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.625477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:12.627263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac434195-5822-4d74-9114-009aff88f104 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:12.658146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:12.669399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d58281-d5d5-4adf-8739-9a98fa988157 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:12.672270 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4049/8064] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:12.695080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:12.696006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.696288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.696966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] PATH_INFO: `/v3/projects/b2ebce2390b4446c9aac792b60b3e34a/users/5c6e940d41024eb6ac68314887d9ab30/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.742847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ebce2390b4446c9aac792b60b3e34a, user_id=5c6e940d41024eb6ac68314887d9ab30, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:12.745271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:12.779704 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4016/8065] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:12 2022] PUT /identity/v3/projects/b2ebce2390b4446c9aac792b60b3e34a/users/5c6e940d41024eb6ac68314887d9ab30/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:12.790603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:12.790891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:12.791165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:12.906927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] MFA Rules not processed for user `5c6e940d41024eb6ac68314887d9ab30`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:12.908447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:13.002634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:13.056890 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4050/8066] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:13.072282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:13.074703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:13.257420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ca6a-379a-46a1-80ca-fb86c8d220de admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:13.264823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:13.265512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:13.265830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:13.266115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:13.353340 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:13.388406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:13.389944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:13.415622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4017/8067] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:13.535823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:13.579486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea65cbf-234e-454a-bb1b-0afc8ed7be22 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:13.604462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:13.607092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:13.607593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:13.608103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:13.626370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:13.630672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323d322-8f66-45d3-abaa-c00757365f5c service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:13.674157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4051/8068] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:14.371218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:14.508897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2223a8a-5011-4bbf-a46c-121ab6c6a131 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:14.514219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:14.515375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:14.515812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:14.516236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] PATH_INFO: `/v3/users/8d62a92dc9fc482092d887e611288ade` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:14.517704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d62a92dc9fc482092d887e611288ade)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:14.519811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:14.625764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d62a92dc9fc482092d887e611288ade'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:14.642588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d62a92dc9fc482092d887e611288ade'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:14.654500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d62a92dc9fc482092d887e611288ade'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:14.681215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d62a92dc9fc482092d887e611288ade'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:14.682362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d62a92dc9fc482092d887e611288ade'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:14.695516 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4018/8069] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:14 2022] DELETE /identity/v3/users/8d62a92dc9fc482092d887e611288ade => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:14.700290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:14.702275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:14.702726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:14.759436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:14.768354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:14.954527 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4052/8070] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:14.972775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:14.974607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:15.118109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538934f-9fac-4753-b4d4-3adacedaa1d2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:15.132342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:15.133178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:15.133552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:15.133993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:15.155234 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:15.161312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:15.163538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:15.187658 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4019/8071] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:16.002641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:16.004163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:16.027688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f26cd-10f5-4605-9ebb-7221e975a998 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:16.056177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:16.057071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:16.057352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:16.057625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] PATH_INFO: `/v3/projects/35f1880c271546b68f72ed33220224a2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:16.059025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f1880c271546b68f72ed33220224a2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:16.061463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:16.183730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f1880c271546b68f72ed33220224a2', 'request_id': 'req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.194863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f1880c271546b68f72ed33220224a2', 'request_id': 'req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.218938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f1880c271546b68f72ed33220224a2', 'request_id': 'req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.240024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] The token cache is being invalidate because project 35f1880c271546b68f72ed33220224a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:16.240552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.241406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.243424 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4053/8072] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:16 2022] DELETE /identity/v3/projects/35f1880c271546b68f72ed33220224a2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:16.247812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:16.266524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7925f7-0fb0-4e43-a5d4-2e6ca704e9f6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:16.410997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:16.411994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:16.412356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:16.412763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] PATH_INFO: `/v3/users/5c6e940d41024eb6ac68314887d9ab30` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:16.414259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6e940d41024eb6ac68314887d9ab30)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:16.416593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:16.505336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6e940d41024eb6ac68314887d9ab30'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.538345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6e940d41024eb6ac68314887d9ab30'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.562827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6e940d41024eb6ac68314887d9ab30'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.597426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6e940d41024eb6ac68314887d9ab30'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.598881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-12739d6a-a5bb-45dc-af78-5d1b4719a175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6e940d41024eb6ac68314887d9ab30'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:16.609785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4020/8073] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:16 2022] DELETE /identity/v3/users/5c6e940d41024eb6ac68314887d9ab30 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:17.538164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:17.540249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:17.565320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2729ae-f5b8-48aa-ae5a-2c0b5e0e47bd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:17.682468 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:17.708996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:17.710234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:17.710663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:17.711074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] PATH_INFO: `/v3/projects/b2ebce2390b4446c9aac792b60b3e34a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:17.712505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ebce2390b4446c9aac792b60b3e34a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:17.714701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:17.865457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ebce2390b4446c9aac792b60b3e34a', 'request_id': 'req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:17.884501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ebce2390b4446c9aac792b60b3e34a', 'request_id': 'req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:17.901908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ebce2390b4446c9aac792b60b3e34a', 'request_id': 'req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:17.926830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] The token cache is being invalidate because project b2ebce2390b4446c9aac792b60b3e34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:17.927126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:17.927800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed04ff5c-429c-4f9e-9cbc-fe3551bcfe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:17.930755 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4054/8074] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:17 2022] DELETE /identity/v3/projects/b2ebce2390b4446c9aac792b60b3e34a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:17.941507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:17.941507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:17.941507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:17.990966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:17.992355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:18.183777 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4021/8075] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:18.193363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:18.193880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:18.194312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:18.227433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:18.232287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:18.275501 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4055/8076] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:18.281637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:18.297831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddccc63-6a85-4f29-97c3-2acdfc217a27 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:18.312839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:18.313553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:18.313868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:18.314146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:18.314914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:18.315232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:18.318453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:18.350513 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4022/8077] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:18.353972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:18.366934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a435bc-dd53-4217-8856-4a04f105a20d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:18.373287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:18.373934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:18.374272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:18.374553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:18.375470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:18.377174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:18.492920 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4056/8078] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:18 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:18.495193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:18.502681 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:18.517394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adf923-b255-4316-8d5f-031f86eb4f3d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:18.721453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:18.723572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:18.829832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:18.832851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:18.839117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:18.840255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:18.850543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:18.856547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:18.930710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4023/8079] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:18 2022] POST /identity/v3/users => generated 287 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:18.935402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:18.983747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8e3e-7e17-46e5-a47b-903ad07b441e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.002454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:19.007387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.008432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.008805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.010221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:19.013056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:19.014099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c205-49c2-4069-a212-8961683b8171 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.031537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:19.033368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.033368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.033722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] PATH_INFO: `/v3/users/28c2d585280d40d3a16a5b5c84097665` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.036339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c2d585280d40d3a16a5b5c84097665)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:19.038459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:19.056263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4024/8080] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:19.058131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:19.091682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2348-12f3-407a-bbc9-b8c40235b256 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.112207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:19.139149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.139329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.139627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.141584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:19.144893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:19.150230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c2d585280d40d3a16a5b5c84097665'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:19.155936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c2d585280d40d3a16a5b5c84097665'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:19.165188 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4025/8081] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:19.166511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:19.169817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:19.177292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c2d585280d40d3a16a5b5c84097665'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:19.183184 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:19.193453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c2d585280d40d3a16a5b5c84097665'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:19.289751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d6e9b4cd-d580-4866-a906-19df7c7c6995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c2d585280d40d3a16a5b5c84097665'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:19.294023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab21798-23e3-4986-a93f-d421ffe5a3bf admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.298457 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4057/8082] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:18 2022] DELETE /identity/v3/users/28c2d585280d40d3a16a5b5c84097665 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:19.304158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.304762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.305781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.319216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:19.320434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.322112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.322568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] PATH_INFO: `/v3/projects/4103e9934b4c41a0ac72b7e154e55c67/users/f8078eb666d9480aa41ee6e7c1802e22/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.353149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:19.371594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:19.374872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4103e9934b4c41a0ac72b7e154e55c67, user_id=f8078eb666d9480aa41ee6e7c1802e22, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:19.382705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8852b2d-473b-4185-a1c0-3bd01f4cd725 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:19.424829 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4026/8083] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:19 2022] PUT /identity/v3/projects/4103e9934b4c41a0ac72b7e154e55c67/users/f8078eb666d9480aa41ee6e7c1802e22/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:19.441178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.441499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.441796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.563206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] MFA Rules not processed for user `f8078eb666d9480aa41ee6e7c1802e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:19.564465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:19.695405 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4058/8084] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:19.727642 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4027/8085] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:19.728763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:19.737329 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:19.750540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:19.763461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c6a01-5d06-4f60-9a29-6671ca751025 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.770493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:19.772764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.774477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.775923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.777129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:19.784413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e5cc2-2de1-4dc6-9907-d944a6a61533 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:19.846609 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:19.870590 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4059/8086] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:19 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:19.877249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:19.877889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:19.878394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:19.891459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c68dda-0d8a-4630-b15b-d9524b694a0f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:19.922834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] MFA Rules not processed for user `8f38ad0b87584fb498dc0479b0656b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:19.924318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:20.012551 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4060/8087] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:20.013893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.014794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.015294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.015644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.068173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.184653 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:20.205952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.208558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.222283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ee66-d077-4e45-8895-541e5a73085a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:20.224278 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4028/8088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:20.238421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.239122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.239439 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.239680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.240398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.242428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.286507 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4061/8089] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:20 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:20.290477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.303809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e8de-b4e1-4a78-b2a9-5a5fd4b8a390 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:20.315966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.316810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.317386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.317560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.318456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.323542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.350716 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4029/8090] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:20.358619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.384648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1d956-32b2-4097-b20d-c2cf8bfbe973 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:20.441226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.444784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.448868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.449311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] PATH_INFO: `/v3/projects/436e55b8b2cc44da837822c829479506/users/6a0f72bf0ff04030af40e96efcd19e8c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.512125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=436e55b8b2cc44da837822c829479506, user_id=6a0f72bf0ff04030af40e96efcd19e8c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.534944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.584963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4062/8091] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:20 2022] PUT /identity/v3/projects/436e55b8b2cc44da837822c829479506/users/6a0f72bf0ff04030af40e96efcd19e8c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:20.586549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.603599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3c512-fc2e-4592-8d2c-82117ca979da admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:20.758492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.761573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.764405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.764926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.767088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.786379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.831059 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4030/8092] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:45:20.833646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.853932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f907-a1cf-45a8-9b3e-64f122036f7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:20.873550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:20.874524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.879610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:20.879948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] PATH_INFO: `/v3/projects/436e55b8b2cc44da837822c829479506/users/6a0f72bf0ff04030af40e96efcd19e8c/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:20.885735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=436e55b8b2cc44da837822c829479506, user_id=6a0f72bf0ff04030af40e96efcd19e8c, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:20.891600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522a1be-6a9c-4152-a474-ab447eb85fcb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:20.958064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:20.959031 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4063/8093] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:20 2022] PUT /identity/v3/projects/436e55b8b2cc44da837822c829479506/users/6a0f72bf0ff04030af40e96efcd19e8c/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:20.959867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:20.961648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:20.986178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487e32-9c71-4fa7-8104-764745df99b1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:21.002696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:21.004704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:21.054364 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:21.108909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] MFA Rules not processed for user `6a0f72bf0ff04030af40e96efcd19e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:21.110193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:21.143676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:21.145058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:21.145518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:21.145981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] PATH_INFO: `/v3/projects/469b6a2c1c35404e87006fe815a5c7df` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:21.148911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] RBAC: Authorizing `identity:delete_project(project_id=469b6a2c1c35404e87006fe815a5c7df)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:21.153295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:21.222415 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4064/8094] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:21.228470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:21.254569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa2f3-55a9-4df0-8019-04c4c447d247 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:21.276852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469b6a2c1c35404e87006fe815a5c7df', 'request_id': 'req-f1d0c494-dd83-43fa-8431-784ca8db398e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.296025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469b6a2c1c35404e87006fe815a5c7df', 'request_id': 'req-f1d0c494-dd83-43fa-8431-784ca8db398e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.302335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469b6a2c1c35404e87006fe815a5c7df', 'request_id': 'req-f1d0c494-dd83-43fa-8431-784ca8db398e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.332362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] The token cache is being invalidate because project 469b6a2c1c35404e87006fe815a5c7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:21.332651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.337632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.342694 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4031/8095] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:20 2022] DELETE /identity/v3/projects/469b6a2c1c35404e87006fe815a5c7df => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:21.343598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:21.344985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:21.386760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0f72bf0ff04030af40e96efcd19e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '436e55b8b2cc44da837822c829479506', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:21.390096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:21.390392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:21.393938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:21.394934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:21.395260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:21.401883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:21.441022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4065/8096] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:21.445417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:21.449220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:21.472118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6a48-f428-4e3b-93be-200160298119 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:21.505573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0f72bf0ff04030af40e96efcd19e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '436e55b8b2cc44da837822c829479506', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:21.506303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:21.506588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:21.506869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:21.508285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:21.518425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:21.538034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0c494-dd83-43fa-8431-784ca8db398e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:21.558793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:21.567904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:21.568423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:21.568909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] PATH_INFO: `/v3/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:21.576001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e9c8c3c2fc4b3a91c39dfe8e257eed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:21.578505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:21.619556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4066/8097] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:21 2022] POST /identity/v3/projects => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:45:21.629392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:21.646581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:21.710868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e9c8c3c2fc4b3a91c39dfe8e257eed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.722182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e9c8c3c2fc4b3a91c39dfe8e257eed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.731583 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:21.738916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e9c8c3c2fc4b3a91c39dfe8e257eed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.766646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e9c8c3c2fc4b3a91c39dfe8e257eed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.767521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e9c8c3c2fc4b3a91c39dfe8e257eed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:21.781434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4032/8098] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:21 2022] DELETE /identity/v3/users/d8e9c8c3c2fc4b3a91c39dfe8e257eed => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:21.870898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27dd2c-c489-490a-b05b-0b241c25092a tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:22.024587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0f72bf0ff04030af40e96efcd19e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '436e55b8b2cc44da837822c829479506', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:22.025495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:22.025816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:22.026102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:22.027035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:22.027360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:22.030973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:22.057398 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4067/8099] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:22.105466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:22.108006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:22.287224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73488f19-f700-479c-8862-d826ca7bfb29 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:22.301346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:22.302280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:22.302674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:22.303049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:22.304967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:22.335151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:22.336725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4d06-75c8-41c9-8a12-10d15c7d56bc service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:22.360096 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4033/8100] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:23.243768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:23.246658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:23.489232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeb550-c23d-414c-8df5-521f12d88b88 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:23.500168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:23.501231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:23.501619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:23.502033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] PATH_INFO: `/v3/projects/be47764e305d41b09d75b581e10a09d7` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:23.510509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be47764e305d41b09d75b581e10a09d7)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:23.513562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:23.698675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be47764e305d41b09d75b581e10a09d7', 'request_id': 'req-97d3146a-89d7-43eb-a7dc-a61e9a18024d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:23.703400 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:23.722636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be47764e305d41b09d75b581e10a09d7', 'request_id': 'req-97d3146a-89d7-43eb-a7dc-a61e9a18024d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:23.740603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be47764e305d41b09d75b581e10a09d7', 'request_id': 'req-97d3146a-89d7-43eb-a7dc-a61e9a18024d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:23.767225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] The token cache is being invalidate because project be47764e305d41b09d75b581e10a09d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:23.767871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:23.768780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-97d3146a-89d7-43eb-a7dc-a61e9a18024d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:23.770930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4068/8101] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:23 2022] DELETE /identity/v3/projects/be47764e305d41b09d75b581e10a09d7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:23.776799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:23.778393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:23.778834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:23.856228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:23.857474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:24.084108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4034/8102] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:24.086014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.089835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.090266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.151931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:24.153508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:24.188546 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4069/8103] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:24.189721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.206296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70490b0-322d-4d70-8b05-bad4d6080589 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.235489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.236745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.244534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.244534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.244534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:24.244534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.247109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.275336 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4035/8104] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:24.280086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.290826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb62e-ceec-4da4-abae-21154d28524f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.311390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.312083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.312372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.312651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.314051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.316000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.405132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4070/8105] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:24 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:45:24.409224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.441325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7da98-9aea-4086-bdfd-4cd263d10737 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.667498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.668592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.668989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.669376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.670241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.672315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.694938 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:24.714347 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4036/8106] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:24 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:24.719707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.737748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68a4c-966e-4b1c-8233-3a38615998d8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.747948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.748678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.748940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.749222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.750001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.751631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.784623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4071/8107] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:24.788508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.809941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ee7b-a8af-4c2f-a1d4-e10b84bce307 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.832428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.833442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.838184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.838705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.839675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.841707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ff857-21ce-4e2b-9fde-75780da06fc4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.869340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4037/8108] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:24.873960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:24.906142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e24c-af34-464f-bda3-d98973c076d0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:24.914004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:24.914724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.915118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.915558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] PATH_INFO: `/v3/projects/bfed043ca8194f4eb5e683fc99f50503/users/369df6cbe4ad411cbed27b2187b35f41/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:24.943566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfed043ca8194f4eb5e683fc99f50503, user_id=369df6cbe4ad411cbed27b2187b35f41, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:24.947232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:24.970925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4072/8109] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:24 2022] PUT /identity/v3/projects/bfed043ca8194f4eb5e683fc99f50503/users/369df6cbe4ad411cbed27b2187b35f41/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:24.982974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:24.983268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:24.983752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:25.055027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] MFA Rules not processed for user `369df6cbe4ad411cbed27b2187b35f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:25.056338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:25.268932 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4038/8110] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:25.272927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:25.415591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bb46-97ac-49c4-ac3c-d1792ad2acf9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:25.422690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:25.423820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:25.424323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:25.424823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:25.425791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:25.428014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:25.463798 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4073/8111] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:25 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:45:25.467657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:25.485159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456af34-7e76-4b9e-af78-c2c6a993b868 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:25.558315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:25.560300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:25.560609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:25.560987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:25.565707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:25.566887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:25.611860 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4039/8112] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:25 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:25.615454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:25.640822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec09f-7238-477e-ad92-37449c430d09 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:25.646783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:25.650134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:25.650404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:25.651268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:25.653023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:25.657806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:25.687438 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4074/8113] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:25.691274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:25.718246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6e6d1-edf8-4948-819d-25d2becea20e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:25.730477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:25.731841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:25.732274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:25.734090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] PATH_INFO: `/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04/users/92b09eb1c4204b9d9d26428c61611184/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:25.770592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199b37c176ed4d64bd3a9b4c7c551e04, user_id=92b09eb1c4204b9d9d26428c61611184, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:25.782192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:25.821783 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4040/8114] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:25 2022] PUT /identity/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04/users/92b09eb1c4204b9d9d26428c61611184/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:25.830797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:25.863928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a7b9e-67ae-41da-a186-ec608aab14cb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:26.054532 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:26.085192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:26.087038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:26.087795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:26.088082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:26.090071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:26.095216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467085a-4150-4300-8a41-c1822689f282 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:26.123422 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4075/8115] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:26.124121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:26.137751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb05f-a349-4a8b-b720-d4d49e87de56 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:26.169096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:26.170400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:26.171460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:26.172066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] PATH_INFO: `/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04/users/92b09eb1c4204b9d9d26428c61611184/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:26.186970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199b37c176ed4d64bd3a9b4c7c551e04, user_id=92b09eb1c4204b9d9d26428c61611184, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:26.189652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:26.244027 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4041/8116] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:26 2022] PUT /identity/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04/users/92b09eb1c4204b9d9d26428c61611184/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:26.255850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:26.256146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:26.256485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:26.319495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] MFA Rules not processed for user `92b09eb1c4204b9d9d26428c61611184`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:26.320794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:26.439049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4076/8117] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:26.452002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:26.453997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:26.543951 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:26.646774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2ef7-048f-4ff1-baa3-dcda9215a9d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:26.656866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:26.657552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:26.658048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:26.658476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:26.683070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:26.685564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:26.715773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4042/8118] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:27.015934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:27.046484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1c7f1-bbd3-45a2-840c-c7b3e2d8629c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:27.057259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:27.057259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:27.057570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:27.057746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:27.075586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:27.080546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:27.212936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:27.214432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:27.227578 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4077/8119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:27.278166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673ae3b-beaa-4896-851f-cddfccbb1971 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:27.290709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0f72bf0ff04030af40e96efcd19e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '436e55b8b2cc44da837822c829479506', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:27.291632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:27.291919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:27.292202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] PATH_INFO: `/v3/projects/1cce2b128799423d9b469ba204aad883` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:27.298341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cce2b128799423d9b469ba204aad883)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:27.300340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:27.416761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cce2b128799423d9b469ba204aad883', 'request_id': 'req-07413e64-e48e-4e1c-95ff-3638ecbde656'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:27.428415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cce2b128799423d9b469ba204aad883', 'request_id': 'req-07413e64-e48e-4e1c-95ff-3638ecbde656'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:27.443541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cce2b128799423d9b469ba204aad883', 'request_id': 'req-07413e64-e48e-4e1c-95ff-3638ecbde656'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:27.470062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] The token cache is being invalidate because project 1cce2b128799423d9b469ba204aad883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:27.470531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:27.471289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-07413e64-e48e-4e1c-95ff-3638ecbde656 tempest-QuotasNegativeTest-313274083 tempest-QuotasNegativeTest-313274083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:27.477567 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4043/8120] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:27 2022] DELETE /identity/v3/projects/1cce2b128799423d9b469ba204aad883 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:27.481436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:27.483527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:27.720612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f77c55-33d7-4442-bb66-589020e6f3d5 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:27.784776 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:27.956597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:27.956597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:27.956953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:27.965771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] PATH_INFO: `/v3/users/f8078eb666d9480aa41ee6e7c1802e22` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:27.969105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8078eb666d9480aa41ee6e7c1802e22)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:27.972850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:28.139496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8078eb666d9480aa41ee6e7c1802e22'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.140421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8078eb666d9480aa41ee6e7c1802e22'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.159589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8078eb666d9480aa41ee6e7c1802e22'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.170504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8078eb666d9480aa41ee6e7c1802e22'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.201326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8078eb666d9480aa41ee6e7c1802e22'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.235058 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4078/8121] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:27 2022] DELETE /identity/v3/users/f8078eb666d9480aa41ee6e7c1802e22 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:28.236540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:28.237001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:28.237085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:28.282370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:28.285802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:28.304076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:28.305969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:28.351524 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:28.374789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4044/8122] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:28.385446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:28.388144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:28.510900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5bdb9-07b0-4928-aa68-41a8693dc258 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:28.521074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:28.521905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:28.522290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:28.522792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:28.530900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4258e-beaf-4d9c-9fa9-cfc03d34933f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:28.546714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:28.547636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:28.549399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:28.549834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] PATH_INFO: `/v3/users/147e9e02cd3f45dcbb4a0907f24bc1fc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:28.554561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147e9e02cd3f45dcbb4a0907f24bc1fc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:28.556973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:28.577177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:28.579182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232faf59-5587-432e-928d-e8240fad532c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:28.601201 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4045/8123] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:45:28.644676 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:28.663438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147e9e02cd3f45dcbb4a0907f24bc1fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.665460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147e9e02cd3f45dcbb4a0907f24bc1fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.681445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147e9e02cd3f45dcbb4a0907f24bc1fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.701055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147e9e02cd3f45dcbb4a0907f24bc1fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.746672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147e9e02cd3f45dcbb4a0907f24bc1fc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:28.776001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4079/8124] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:28 2022] DELETE /identity/v3/users/147e9e02cd3f45dcbb4a0907f24bc1fc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:28.778512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:28.778691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:28.778933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:28.829969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:28.833359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:29.030271 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4046/8125] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:29.063121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:29.064892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:29.186146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c764a9-f4da-4fb2-9c27-5943490e29b0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:29.205398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:29.206341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:29.206546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:29.207071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:29.225614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:29.227413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:29.261967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:29.263707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:29.283767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759813a5-1f3b-4b38-858b-02b1158a0607 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:29.304606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:29.306551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:29.306991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:29.307325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] PATH_INFO: `/v3/projects/4103e9934b4c41a0ac72b7e154e55c67` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:29.309826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4103e9934b4c41a0ac72b7e154e55c67)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:29.312786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:29.316522 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4080/8126] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:29.571085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4103e9934b4c41a0ac72b7e154e55c67', 'request_id': 'req-944bf803-d42f-48af-aeea-79d89918b740'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.611584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4103e9934b4c41a0ac72b7e154e55c67', 'request_id': 'req-944bf803-d42f-48af-aeea-79d89918b740'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.633564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4103e9934b4c41a0ac72b7e154e55c67', 'request_id': 'req-944bf803-d42f-48af-aeea-79d89918b740'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.704507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] The token cache is being invalidate because project 4103e9934b4c41a0ac72b7e154e55c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:29.704866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.709181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.719313 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4047/8127] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:29 2022] DELETE /identity/v3/projects/4103e9934b4c41a0ac72b7e154e55c67 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:29.720945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:29.736764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da753-253f-4b6a-9184-1d1b0ff23f9d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:29.810300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:29.811454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:29.811888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:29.812406 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] PATH_INFO: `/v3/users/6a0f72bf0ff04030af40e96efcd19e8c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:29.813970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0f72bf0ff04030af40e96efcd19e8c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:29.816196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:29.964160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0f72bf0ff04030af40e96efcd19e8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.965974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0f72bf0ff04030af40e96efcd19e8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.984565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0f72bf0ff04030af40e96efcd19e8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:29.994363 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:30.002135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0f72bf0ff04030af40e96efcd19e8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.031785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4dedc9ad-ef95-465e-a373-9697c5ffef70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0f72bf0ff04030af40e96efcd19e8c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.048166 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4081/8128] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:29 2022] DELETE /identity/v3/users/6a0f72bf0ff04030af40e96efcd19e8c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:30.561188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:30.562690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:30.577929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf803-d42f-48af-aeea-79d89918b740 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:30.609317 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:30.714423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:30.716352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:30.716644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:30.717057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] PATH_INFO: `/v3/projects/3b1aa84be30d4a469f4fdfe24c4b8f79` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:30.722167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1aa84be30d4a469f4fdfe24c4b8f79)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:30.724529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:30.805524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1aa84be30d4a469f4fdfe24c4b8f79', 'request_id': 'req-8f54b803-57a3-4cb7-81c5-87ed5534285d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.822479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1aa84be30d4a469f4fdfe24c4b8f79', 'request_id': 'req-8f54b803-57a3-4cb7-81c5-87ed5534285d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.842228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1aa84be30d4a469f4fdfe24c4b8f79', 'request_id': 'req-8f54b803-57a3-4cb7-81c5-87ed5534285d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.864067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] The token cache is being invalidate because project 3b1aa84be30d4a469f4fdfe24c4b8f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:30.864589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.865362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:30.872708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4048/8129] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:30 2022] DELETE /identity/v3/projects/3b1aa84be30d4a469f4fdfe24c4b8f79 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:30.873317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860bf1-4b64-4554-9cbd-a18b332b30fe None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:30.873807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860bf1-4b64-4554-9cbd-a18b332b30fe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:30.873898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860bf1-4b64-4554-9cbd-a18b332b30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:30.905388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-65860bf1-4b64-4554-9cbd-a18b332b30fe None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:30.910484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65860bf1-4b64-4554-9cbd-a18b332b30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:30.961443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:30.963211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:31.052204 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4082/8130] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:31.053830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.054098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.054376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.093272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:31.095075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:31.109125 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4083/8131] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:31.113948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.125232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910bbfd-fd64-4efa-96b2-3cb81c8bfd8c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.136083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.137524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.137524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.137898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.139156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:31.139466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.142560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.149291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54b803-57a3-4cb7-81c5-87ed5534285d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.164044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.164941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.165219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.165492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] PATH_INFO: `/v3/projects/436e55b8b2cc44da837822c829479506` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.166751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436e55b8b2cc44da837822c829479506)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.169463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.174093 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4084/8132] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:31.175501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.190331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d643b-9ec7-4c0e-af38-d39afc03fb93 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.195429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.196087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.196419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.196694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.197380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.200299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.229382 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:31.232526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436e55b8b2cc44da837822c829479506', 'request_id': 'req-3a2768c1-48b8-4b50-9bf3-2c420c94f277'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:31.240211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436e55b8b2cc44da837822c829479506', 'request_id': 'req-3a2768c1-48b8-4b50-9bf3-2c420c94f277'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:31.248259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436e55b8b2cc44da837822c829479506', 'request_id': 'req-3a2768c1-48b8-4b50-9bf3-2c420c94f277'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:31.258412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4085/8133] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:31.263251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.265072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] The token cache is being invalidate because project 436e55b8b2cc44da837822c829479506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:31.265374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:31.266552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3a2768c1-48b8-4b50-9bf3-2c420c94f277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:31.272136 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4049/8134] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:30 2022] DELETE /identity/v3/projects/436e55b8b2cc44da837822c829479506 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:31.273962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b68ef-c583-46d8-b24b-e5c46e5b6a2d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.274201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b68ef-c583-46d8-b24b-e5c46e5b6a2d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.274488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b68ef-c583-46d8-b24b-e5c46e5b6a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.300393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9f2b68ef-c583-46d8-b24b-e5c46e5b6a2d None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:31.301701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f2b68ef-c583-46d8-b24b-e5c46e5b6a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:31.393936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4050/8135] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:31.397770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc45a01-9374-4f27-94bf-1cd5c117bf93 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.402840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.403143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.403428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.404927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.405883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.406383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.406856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.407785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.410185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.445572 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4086/8136] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:45:31.449705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.451818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:31.456975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:31.458289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:31.478785 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4051/8137] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:31.485006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5c53-e97e-4bd2-969b-2eae86fbd009 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.487275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.505496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.505496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.505496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.505496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.506010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.508427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.515376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39bb3-0cd5-4f89-852c-f111ce859dd1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.534564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4087/8138] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:45:31.537123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.545349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.546082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.546365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.546637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.547384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:31.547684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.549290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.562056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e5cc-37eb-4c32-a4a7-38b67dee8245 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.565710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4052/8139] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:31.568786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.573566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.574547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.574897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.575231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.576077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.580063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.594453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae083845-080f-4121-87c7-def966ba43e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.607869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.609438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.610019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.610489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.612024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.614952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.622729 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4088/8140] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:31.628614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.644334 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:31.654253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0e8a-bf92-4b53-89cb-ae3ec05d1c0a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.666806 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4053/8141] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:31.670721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.795577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386faa-631f-4ea1-9e51-36062eb7d07d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.801811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.802586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.802946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.803343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.804622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.806752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.837647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.841585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.843016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.843791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] PATH_INFO: `/v3/projects/971898c5c70e45938f653d634d9dab69/users/f55425342e4f473cb40d7876b250ce10/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.857832 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4054/8142] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:31 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:31.859716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.884176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7abb-3c62-46cb-b66d-993f914aae09 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.897392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.898318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.898903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.899285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.900217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.903830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.917250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971898c5c70e45938f653d634d9dab69, user_id=f55425342e4f473cb40d7876b250ce10, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:31.936692 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4055/8143] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:31.936692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:31.944194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04aa02-283d-4baa-bd57-eca07a687ce2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:31.954935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed60d3f-1a66-480d-b1c9-cab872da55d5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:31.982419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:31.983338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:31.995622 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4089/8144] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:31 2022] PUT /identity/v3/projects/971898c5c70e45938f653d634d9dab69/users/f55425342e4f473cb40d7876b250ce10/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:31.997823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:31.997823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:31.997823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.005027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.005975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.006703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.014719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.050465 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4056/8145] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:45:32.055901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.066811 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:32.070083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] MFA Rules not processed for user `f55425342e4f473cb40d7876b250ce10`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:32.072747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:32.099397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df10a7b-84cf-43c6-bc87-d885711206aa admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:32.238119 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4090/8146] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:32.245496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.258235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:32.259073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.259355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.259632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] PATH_INFO: `/v3/projects/01d46f189031451f9ad4635a123c31f5/users/c7fa9575362746448d135295799c6631/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.270938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5c467-912c-4002-80bd-ad0329bff717 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:32.283516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df8be-63da-401b-b598-91a7747978df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:32.284218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df8be-63da-401b-b598-91a7747978df admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.292370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df8be-63da-401b-b598-91a7747978df admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.292370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df8be-63da-401b-b598-91a7747978df admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.292370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181df8be-63da-401b-b598-91a7747978df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.292370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181df8be-63da-401b-b598-91a7747978df admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.299063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d46f189031451f9ad4635a123c31f5, user_id=c7fa9575362746448d135295799c6631, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.302579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2276e-c5d7-423e-9c1f-68c879d1fd30 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.331771 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4057/8147] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:32 2022] PUT /identity/v3/projects/01d46f189031451f9ad4635a123c31f5/users/c7fa9575362746448d135295799c6631/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:32.342589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.342918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.343151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.352126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4091/8148] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:32 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:32.353060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df8be-63da-401b-b598-91a7747978df admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.419710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] MFA Rules not processed for user `c7fa9575362746448d135295799c6631`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:32.420966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:32.522026 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:32.563184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df8be-63da-401b-b598-91a7747978df admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:32.581108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:32.581839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.589652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.601564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.602375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.608469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.678254 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4092/8149] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:32 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:32.678254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.684953 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4058/8150] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:32.692724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.695271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:32.725415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269a50-8b55-4681-b2fe-68e1f9e4d4a9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:32.728309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856303-aafc-4dc4-8125-63111841e33b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:32.737490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:32.738218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.738502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.738782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.739527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.741158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.748491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:32.755085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:32.755380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:32.755682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] PATH_INFO: `/v3/users/369df6cbe4ad411cbed27b2187b35f41` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:32.760542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=369df6cbe4ad411cbed27b2187b35f41)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:32.774146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:32.797578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4059/8151] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:32.798828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.811537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:32.880475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369df6cbe4ad411cbed27b2187b35f41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:32.881521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369df6cbe4ad411cbed27b2187b35f41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:32.896186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369df6cbe4ad411cbed27b2187b35f41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:32.912085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369df6cbe4ad411cbed27b2187b35f41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:32.929388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369df6cbe4ad411cbed27b2187b35f41'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:32.946574 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4093/8152] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:32 2022] DELETE /identity/v3/users/369df6cbe4ad411cbed27b2187b35f41 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:32.948005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:32.950104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:32.998435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470544-95a5-4421-9459-1ecce4511629 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.019297 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:33.051073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fff2c-3781-42aa-903d-7300d45ee7bc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.057100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.058107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.058417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.059240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.060160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.061838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d025c78-92dd-4348-ba42-b545f2067950 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.063603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.064517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.065009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.065504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.067603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:33.073175 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4094/8153] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:33.074856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.075154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.075438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.098767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:33.100026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:33.112370 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4095/8154] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:33.121732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:33.142385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec39d-f5a7-4378-abb2-df71a5294c28 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.149871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.151328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.151805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.152725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] PATH_INFO: `/v3/projects/2b47cb70d49e470ba539431f720f7281/users/f4441da7e6324556b710d53a810913b6/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.164928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.166666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.175824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b47cb70d49e470ba539431f720f7281, user_id=f4441da7e6324556b710d53a810913b6, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.178038 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4060/8155] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:33.179133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:33.181093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:33.194575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aae05-5ce1-4aea-b6a1-ce41ffa655af admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.206825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e936-7d09-4f12-ae8c-ab680d626b21 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.219706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.220852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.221139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.221415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.225174 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4096/8156] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:33 2022] PUT /identity/v3/projects/2b47cb70d49e470ba539431f720f7281/users/f4441da7e6324556b710d53a810913b6/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:33.239834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.240124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.240408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.247372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.250804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.281031 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4061/8157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:33.307591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] MFA Rules not processed for user `f4441da7e6324556b710d53a810913b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:33.309324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:33.325465 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:33.435191 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4097/8158] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:45:33.441063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:33.468990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406710-8514-4eeb-9e66-7511258dfc1d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.645605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.646369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.646713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.646998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.647712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.649784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.701160 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4062/8159] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:33 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:33.704657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:33.720626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7ab2c-4870-4296-b511-6f9f7b1ef977 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.841251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.842187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.842627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.843107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.844043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.847091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.894535 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4098/8160] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:33 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:45:33.911686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:33.925325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c56e2-d95f-4662-b5df-762ea70648f5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:33.942371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:33.943074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:33.943362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:33.943644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:33.944400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:33.952267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:33.981528 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4063/8161] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:33.982922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.012417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ec6b1-2c6d-481d-b60d-f8c6bc2b1a7e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.022155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.023130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.023413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.023688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] PATH_INFO: `/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8/users/f1bc6f3350ad47f89c0c4d5ac1036a77/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.046272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7b79b49bc74858bfc26232fdc21bd8, user_id=f1bc6f3350ad47f89c0c4d5ac1036a77, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.049461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:34.070524 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4099/8162] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:33 2022] PUT /identity/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8/users/f1bc6f3350ad47f89c0c4d5ac1036a77/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:34.072112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.087046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2d53-2095-476c-8525-e35302b4e5f2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.175464 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:34.240943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.242440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.242880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.243335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.245205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.250327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b22a50-cec5-4df4-ae09-7f787656dde1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:34.331072 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4064/8163] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:34.335350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.351084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a1517-60d9-45c5-b0d6-d616fcfa9dfc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.363634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.364950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.367744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.368298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] PATH_INFO: `/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8/users/f1bc6f3350ad47f89c0c4d5ac1036a77/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.373300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7b79b49bc74858bfc26232fdc21bd8, user_id=f1bc6f3350ad47f89c0c4d5ac1036a77, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.378697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:34.399376 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4100/8164] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:34 2022] PUT /identity/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8/users/f1bc6f3350ad47f89c0c4d5ac1036a77/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:34.410339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.410640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.410906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.441983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] MFA Rules not processed for user `f1bc6f3350ad47f89c0c4d5ac1036a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:34.443452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:34.469775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.472071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:34.602206 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4065/8165] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:34.612136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.613561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:34.629657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601dae-d39c-424c-9160-53841e9c5d54 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.648976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.650429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.650637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.650923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] PATH_INFO: `/v3/projects/bfed043ca8194f4eb5e683fc99f50503` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.655955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfed043ca8194f4eb5e683fc99f50503)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.660631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:34.667323 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:34.742546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb03d9-5e8b-481f-8df6-95c247818006 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.748084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.749080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.749548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.750225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.752564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:34.786213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfed043ca8194f4eb5e683fc99f50503', 'request_id': 'req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:34.805481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfed043ca8194f4eb5e683fc99f50503', 'request_id': 'req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:34.822352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfed043ca8194f4eb5e683fc99f50503', 'request_id': 'req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:34.865021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] The token cache is being invalidate because project bfed043ca8194f4eb5e683fc99f50503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:34.865648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:34.867075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:34.869718 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4101/8166] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:34 2022] DELETE /identity/v3/projects/bfed043ca8194f4eb5e683fc99f50503 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:34.873902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:34.875962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:34.912879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.914639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:34.942558 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4066/8167] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:34.979248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bc3e5-ec9b-48e8-a9c3-b7e6083cb21d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:34.985108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:34.987021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:34.987456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:34.987996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] PATH_INFO: `/v3/users/92b09eb1c4204b9d9d26428c61611184` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:34.989409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b09eb1c4204b9d9d26428c61611184)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:34.991645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:35.097136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b09eb1c4204b9d9d26428c61611184'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:35.099872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b09eb1c4204b9d9d26428c61611184'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:35.118951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b09eb1c4204b9d9d26428c61611184'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:35.140310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b09eb1c4204b9d9d26428c61611184'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:35.208336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-68524a28-8ea4-4230-8c0a-164ea98aa554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b09eb1c4204b9d9d26428c61611184'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:35.246610 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4102/8168] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:34 2022] DELETE /identity/v3/users/92b09eb1c4204b9d9d26428c61611184 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:37.757427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:37.778948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aecc6-379a-422a-a7ab-cda7e4410f10 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:37.795865 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:37.918951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:37.923122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:37.923412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:37.923697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] PATH_INFO: `/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:37.925200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=199b37c176ed4d64bd3a9b4c7c551e04)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:37.932757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.075779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199b37c176ed4d64bd3a9b4c7c551e04', 'request_id': 'req-67585812-0f7b-47ed-bb56-ba1be4a29fed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:38.092183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199b37c176ed4d64bd3a9b4c7c551e04', 'request_id': 'req-67585812-0f7b-47ed-bb56-ba1be4a29fed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:38.110796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199b37c176ed4d64bd3a9b4c7c551e04', 'request_id': 'req-67585812-0f7b-47ed-bb56-ba1be4a29fed'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:38.146680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] The token cache is being invalidate because project 199b37c176ed4d64bd3a9b4c7c551e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:38.147608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:38.159889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:38.175893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4067/8169] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:37 2022] DELETE /identity/v3/projects/199b37c176ed4d64bd3a9b4c7c551e04 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:38.181135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3dffb-79fe-42df-8da6-976cf55eed9e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.181596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3dffb-79fe-42df-8da6-976cf55eed9e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.181952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3dffb-79fe-42df-8da6-976cf55eed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.218908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-12a3dffb-79fe-42df-8da6-976cf55eed9e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:38.220172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-12a3dffb-79fe-42df-8da6-976cf55eed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:38.233513 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:38.260945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.263745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:38.384215 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4103/8170] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:38.394992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.399333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.400005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.450540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:38.452066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:38.458835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67585812-0f7b-47ed-bb56-ba1be4a29fed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:38.465803 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4104/8171] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:38.470779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:38.471474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.471760 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.472042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.473566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.485554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:38.491006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c39550-8264-47e9-8344-cdc13fb6f1e4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:38.499050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:38.500201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.500715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.501264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.504807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:45:38.505891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:38.507180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.541835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4105/8172] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:45:38.546829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.560974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e699-02d8-4667-a7bf-772b14e3f722 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:38.566730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:38.567999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.568455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.568883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.569767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:38.571829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.613597 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4106/8173] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:38 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:38.618355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.654417 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:38.658505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:38.662115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.692213 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4068/8174] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:45:38.723269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f826-413b-451a-b001-fb2c57684bfb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:38.764561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:38.765261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.765548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.765857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.782095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:38.798452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.869519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4107/8175] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:38 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:38.875351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.898152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3533f1-d252-414f-aca1-571bddfadb07 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:38.909881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:38.910570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:38.914332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:38.915290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:38.917089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:38.924246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:38.960676 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4069/8176] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:38.969806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:38.992105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947b2b-1f2f-4c55-904d-845537483a8b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:39.007123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:39.008069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.008469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.008867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.009794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:39.013016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75cf7-7137-4e1d-a572-86b524f1af0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:39.040758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4108/8177] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:39.046041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:39.060416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24182d-dff5-4f99-b0eb-ad0d535df11b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:39.071306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:39.074514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.074514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.074514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] PATH_INFO: `/v3/projects/8d703a8330df4e1493213a01d1434b1f/users/551e98f6e5634dd89851f8aaff3ab009/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.106672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d703a8330df4e1493213a01d1434b1f, user_id=551e98f6e5634dd89851f8aaff3ab009, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:39.127119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:39.176635 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4070/8178] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:39 2022] PUT /identity/v3/projects/8d703a8330df4e1493213a01d1434b1f/users/551e98f6e5634dd89851f8aaff3ab009/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:39.187442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.188117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.188506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.254338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] MFA Rules not processed for user `551e98f6e5634dd89851f8aaff3ab009`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:39.257228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:39.359277 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:39.435447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4109/8179] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:39.442890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:39.625200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41381b5-defc-4464-86c0-80009fa21406 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:39.641787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:39.642746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.643176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.643600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.644459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:39.646567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:39.701399 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4071/8180] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:39 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:39.706394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:39.724440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af7d9a-0d30-4167-be3c-95469016e7d0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:39.873612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:39.875109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.875397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.875672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.877491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:39.880150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:39.912912 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4110/8181] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:39 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:39.914406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:39.933363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7b81a-b5f5-40ad-9adc-04688d9d0cd4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:39.948529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:39.949444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:39.949867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:39.950201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:39.952649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:39.973342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:40.023608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:40.032215 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4072/8182] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:40.038224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0f45-c46d-4382-83eb-ea22c4a6022d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:40.050779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:40.062101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.062426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.062703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.063519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:40.065255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:40.103363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:40.111439 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4111/8183] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:45:40.119739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6ec36-ca1a-434d-967b-01cee9754704 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:40.127440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:40.143112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:40.145395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.148643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.149079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] PATH_INFO: `/v3/projects/75caac39e2c64af3bbe2a863c07eec8d/users/9d0083d4cca64389a8296a6a6c8a462a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.241168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75caac39e2c64af3bbe2a863c07eec8d, user_id=9d0083d4cca64389a8296a6a6c8a462a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:40.247170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44e0d2-660e-40a4-8c79-6f49ba0bb014 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:40.289302 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4073/8184] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:40 2022] PUT /identity/v3/projects/75caac39e2c64af3bbe2a863c07eec8d/users/9d0083d4cca64389a8296a6a6c8a462a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:40.293739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.294072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.294353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.348574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1767e-1206-43e7-b353-4a2ab109c102 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:40.366467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] MFA Rules not processed for user `9d0083d4cca64389a8296a6a6c8a462a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:40.367722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:40.471688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:40.473182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.474151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.474404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.481178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:40.482979 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:40.489553 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4074/8185] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:40.494077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:40.533050 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:40.597933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19d26-15be-4ff4-8583-b102634e5c53 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:40.605401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:40.608763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:40.609428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.609745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.610026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.610835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:40.611853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:40.613933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:40.639158 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4112/8186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:45:40.677992 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4075/8187] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:45:40 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:40.680516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:40.719537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc4783-11b7-4d88-bfa3-e06f7fc97071 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:40.984458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:40.986551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:40.989708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:40.989708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:40.989708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:40.994555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:41.037401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4113/8188] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:45:40 2022] POST /identity/v3/users => generated 295 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:45:41.044138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:41.059925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96590033-c1ee-4bb5-8e62-bd8fa70ba7f8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:41.077953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:41.077953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.078247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.078406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.079153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:41.081331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:41.106344 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4076/8189] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:41.107074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:41.120062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce83d-8c7f-4c8f-acb1-c25c9cc54b19 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:41.134676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:41.135600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.135885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.136178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] PATH_INFO: `/v3/projects/85591b6d428041eb964389da30be2a6f/users/2ff186b2e77c451b9f4735ec6e8ca71f/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.168410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85591b6d428041eb964389da30be2a6f, user_id=2ff186b2e77c451b9f4735ec6e8ca71f, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:41.171161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:41.195403 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4114/8190] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:41 2022] PUT /identity/v3/projects/85591b6d428041eb964389da30be2a6f/users/2ff186b2e77c451b9f4735ec6e8ca71f/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:41.199111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:41.211690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea390-c9fd-44af-8230-6fc914dcc5a0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:41.398884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:41.404930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.409096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.409401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.414292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:41.421716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92938e2-ec5a-433f-b755-97cd6c1531a2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:41.460814 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4077/8191] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:45:41.464979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:41.482890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cafc4-9d51-46e4-a9cd-740bcbda637d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:41.501791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:41.504240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.504729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.506965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] PATH_INFO: `/v3/projects/85591b6d428041eb964389da30be2a6f/users/2ff186b2e77c451b9f4735ec6e8ca71f/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.515613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85591b6d428041eb964389da30be2a6f, user_id=2ff186b2e77c451b9f4735ec6e8ca71f, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:41.518366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:41.561930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4115/8192] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:45:41 2022] PUT /identity/v3/projects/85591b6d428041eb964389da30be2a6f/users/2ff186b2e77c451b9f4735ec6e8ca71f/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:41.573364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.573721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.574624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.644889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] MFA Rules not processed for user `2ff186b2e77c451b9f4735ec6e8ca71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:41.646774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:41.801959 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:41.827198 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4078/8193] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:41.842248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:41.926401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77ddf7-d6f1-4c4a-835a-30ae5c56b8d2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:41.932563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:41.934209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:41.934672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:41.935106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:41.975690 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:42.012730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:42.014481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:42.040331 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4116/8194] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:45.289948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:45.291452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:45.340413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4677-2164-4494-8f08-bee22d1b68ae None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:45.358887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:45.360011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:45.360404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:45.361307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:45.539105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:45.540947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:45.560659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4079/8195] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:46.953772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:46.971218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756414-4eb3-4544-8dbc-df55e5d732ee service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:46.975456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:46.976235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:46.983374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:46.983940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:47.004571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:47.009101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:47.037029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4117/8196] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:51.229388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:51.231750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:51.447308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5e7f2-6be9-4cc7-bd4f-158654c145e5 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:51.464122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:51.465453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:51.465782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:51.466067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:51.469069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:51.562659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:51.564780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:51.579934 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4080/8197] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:51.586329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:51.587980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:51.800419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54532dbc-8285-4ff8-b22e-40f9ab808774 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:51.810237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:51.813301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:51.813593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:51.813901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] PATH_INFO: `/v3/users/769bcdd2b058414380c3dccf14be7fa9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:51.815782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769bcdd2b058414380c3dccf14be7fa9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:51.825523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:51.953290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769bcdd2b058414380c3dccf14be7fa9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:51.954420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769bcdd2b058414380c3dccf14be7fa9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:51.972700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769bcdd2b058414380c3dccf14be7fa9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:52.177260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769bcdd2b058414380c3dccf14be7fa9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:52.222387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769bcdd2b058414380c3dccf14be7fa9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:52.242789 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4118/8198] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:51 2022] DELETE /identity/v3/users/769bcdd2b058414380c3dccf14be7fa9 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:53.969960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:54.015961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e981d8-28d2-48ad-8368-d8d5d3b5d7f6 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:54.223811 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:54.259704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:54.260602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:54.261466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:54.261774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] PATH_INFO: `/v3/projects/a27951eb7d58435681336ba0f8774b17` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:54.264270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27951eb7d58435681336ba0f8774b17)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:54.274617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:54.384538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27951eb7d58435681336ba0f8774b17', 'request_id': 'req-6ae2cb1b-3f3e-4530-ba28-843346ba684c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.401090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27951eb7d58435681336ba0f8774b17', 'request_id': 'req-6ae2cb1b-3f3e-4530-ba28-843346ba684c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.414441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27951eb7d58435681336ba0f8774b17', 'request_id': 'req-6ae2cb1b-3f3e-4530-ba28-843346ba684c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.453630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] The token cache is being invalidate because project a27951eb7d58435681336ba0f8774b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:54.453860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.458320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.461803 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4081/8199] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:53 2022] DELETE /identity/v3/projects/a27951eb7d58435681336ba0f8774b17 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:54.464182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:54.470112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:54.491360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685439a4-6270-4a33-8c97-3b75bdb21861 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:54.546998 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:54.605909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:54.606961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:54.607629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:54.608063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] PATH_INFO: `/v3/users/0b11d226d8fa44f2bc24b219a0098e53` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:54.611414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b11d226d8fa44f2bc24b219a0098e53)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:54.614808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:54.661856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:54.663801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:54.688048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2cb1b-3f3e-4530-ba28-843346ba684c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:54.713098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:54.713098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:54.713394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:54.713686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] PATH_INFO: `/v3/users/f55425342e4f473cb40d7876b250ce10` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:54.718210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55425342e4f473cb40d7876b250ce10)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:54.721046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b11d226d8fa44f2bc24b219a0098e53'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.724561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:54.724697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b11d226d8fa44f2bc24b219a0098e53'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.740674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b11d226d8fa44f2bc24b219a0098e53'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.750510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b11d226d8fa44f2bc24b219a0098e53'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.781092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-1b79254e-2009-404a-ae12-93b85f29aba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b11d226d8fa44f2bc24b219a0098e53'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.789713 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4119/8200] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:54 2022] DELETE /identity/v3/users/0b11d226d8fa44f2bc24b219a0098e53 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:54.836962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55425342e4f473cb40d7876b250ce10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.855886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55425342e4f473cb40d7876b250ce10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.872937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55425342e4f473cb40d7876b250ce10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.898233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55425342e4f473cb40d7876b250ce10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.898953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55425342e4f473cb40d7876b250ce10'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:54.923402 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4082/8201] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:54 2022] DELETE /identity/v3/users/f55425342e4f473cb40d7876b250ce10 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:45:54.928051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:54.928389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:54.928943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:54.959849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:45:54.965886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:55.192953 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4120/8202] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:45:55.227161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:55.228633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:55.346141 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:55.354889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625b6e-cb17-4abb-ab57-15457d4f342e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:55.371271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:55.372428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:55.372946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:55.373446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:55.393204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:55.395234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:55.418138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4083/8203] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:56.072549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:56.082976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:56.123461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a202-87db-497a-9583-8bcc3dcc1973 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:56.144702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:56.145603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:56.145913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:56.146191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] PATH_INFO: `/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:56.150054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1ad4ae9b3846acb6ab2af2690db6f9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:56.152578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:56.270866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1ad4ae9b3846acb6ab2af2690db6f9', 'request_id': 'req-28afc417-5ab8-47fc-a787-35a71e730ecc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:56.280122 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:56.301059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1ad4ae9b3846acb6ab2af2690db6f9', 'request_id': 'req-28afc417-5ab8-47fc-a787-35a71e730ecc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:56.329968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1ad4ae9b3846acb6ab2af2690db6f9', 'request_id': 'req-28afc417-5ab8-47fc-a787-35a71e730ecc'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:56.357461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] The token cache is being invalidate because project 7e1ad4ae9b3846acb6ab2af2690db6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:56.359003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:56.360423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:56.387851 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4121/8204] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:56 2022] DELETE /identity/v3/projects/7e1ad4ae9b3846acb6ab2af2690db6f9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:57.992426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:57.993926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:58.025825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490efcc-2884-40d8-855e-fbfd03d379ce service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:58.167999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:58.169077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:58.169532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:58.170015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] PATH_INFO: `/v3/projects/971898c5c70e45938f653d634d9dab69` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:58.171446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971898c5c70e45938f653d634d9dab69)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:58.173546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:58.275420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971898c5c70e45938f653d634d9dab69', 'request_id': 'req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.290848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971898c5c70e45938f653d634d9dab69', 'request_id': 'req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.299081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971898c5c70e45938f653d634d9dab69', 'request_id': 'req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.326395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] The token cache is being invalidate because project 971898c5c70e45938f653d634d9dab69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:45:58.326623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.327350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.336463 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4084/8205] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:45:57 2022] DELETE /identity/v3/projects/971898c5c70e45938f653d634d9dab69 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:58.337710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:58.340414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:58.373493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afc417-5ab8-47fc-a787-35a71e730ecc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:58.550032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:58.551070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:58.551354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:58.551631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] PATH_INFO: `/v3/users/f4441da7e6324556b710d53a810913b6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:58.552891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4441da7e6324556b710d53a810913b6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:58.567892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:58.748359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4441da7e6324556b710d53a810913b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.754220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4441da7e6324556b710d53a810913b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.766398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4441da7e6324556b710d53a810913b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.775328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4441da7e6324556b710d53a810913b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.800629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4441da7e6324556b710d53a810913b6'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:58.826026 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4122/8206] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:58 2022] DELETE /identity/v3/users/f4441da7e6324556b710d53a810913b6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:45:58.843568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:58.845061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:59.035580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7ff2-a674-4c4b-b8c3-da3c9bb58530 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:59.112274 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:59.146725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:59.147945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:59.148680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:59.149181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:59.153369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:59.242330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:59.246870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa417dc7-45f0-4d6f-a2d6-1966b33d8192 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:59.269420 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4085/8207] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:45:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:45:59.712594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:45:59.714877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:45:59.824468 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:45:59.828729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64ebb5-8ef3-4107-9c15-a5d17f30a91f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:45:59.846384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:45:59.847295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:45:59.847586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:45:59.847867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] PATH_INFO: `/v3/users/551e98f6e5634dd89851f8aaff3ab009` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:45:59.849107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551e98f6e5634dd89851f8aaff3ab009)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:45:59.851106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:45:59.939667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551e98f6e5634dd89851f8aaff3ab009'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:59.941713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551e98f6e5634dd89851f8aaff3ab009'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:59.957617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551e98f6e5634dd89851f8aaff3ab009'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:45:59.966854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551e98f6e5634dd89851f8aaff3ab009'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:00.011341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551e98f6e5634dd89851f8aaff3ab009'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:00.049260 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4123/8208] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:45:59 2022] DELETE /identity/v3/users/551e98f6e5634dd89851f8aaff3ab009 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:00.050592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:00.051068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:00.051173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:00.090564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:00.093319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:00.272010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4086/8209] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:00.334201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:00.336384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:00.450403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7773-5a9e-41a4-aa3d-dcecfd6f50b0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:00.454484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:00.455324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:00.455617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:00.455900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:00.467844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:00.472346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:00.494397 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4124/8210] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:01.090285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:01.092149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:01.115734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8998-8148-45b9-8c95-aa4b9fe80cd4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:01.125956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:01.126855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:01.127137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:01.127415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] PATH_INFO: `/v3/projects/2b47cb70d49e470ba539431f720f7281` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:01.128646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b47cb70d49e470ba539431f720f7281)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:01.130621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:01.234641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b47cb70d49e470ba539431f720f7281', 'request_id': 'req-05b5811a-ffc1-49f2-92ed-43a4acc05af1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.254758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b47cb70d49e470ba539431f720f7281', 'request_id': 'req-05b5811a-ffc1-49f2-92ed-43a4acc05af1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.263202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b47cb70d49e470ba539431f720f7281', 'request_id': 'req-05b5811a-ffc1-49f2-92ed-43a4acc05af1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.288031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] The token cache is being invalidate because project 2b47cb70d49e470ba539431f720f7281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:01.288571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.289371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.293956 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4087/8211] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:01 2022] DELETE /identity/v3/projects/2b47cb70d49e470ba539431f720f7281 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:01.297917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:01.308877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb3a2-4c72-4425-88c0-964ac43b9f3b service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:01.404501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:01.406004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:01.425149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:01.426080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:01.426364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:01.426638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] PATH_INFO: `/v3/users/f1bc6f3350ad47f89c0c4d5ac1036a77` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:01.427872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bc6f3350ad47f89c0c4d5ac1036a77)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:01.429900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:01.434424 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:01.484496 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:01.547193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bc6f3350ad47f89c0c4d5ac1036a77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.547416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5811a-ffc1-49f2-92ed-43a4acc05af1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:01.548127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bc6f3350ad47f89c0c4d5ac1036a77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.556939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:01.562634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:01.564447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bc6f3350ad47f89c0c4d5ac1036a77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.564805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:01.565257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] PATH_INFO: `/v3/projects/8d703a8330df4e1493213a01d1434b1f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:01.568307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d703a8330df4e1493213a01d1434b1f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:01.576866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bc6f3350ad47f89c0c4d5ac1036a77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.579053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:01.610093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bc6f3350ad47f89c0c4d5ac1036a77'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.622645 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4125/8212] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:46:01 2022] DELETE /identity/v3/users/f1bc6f3350ad47f89c0c4d5ac1036a77 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:01.715845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d703a8330df4e1493213a01d1434b1f', 'request_id': 'req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.738389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d703a8330df4e1493213a01d1434b1f', 'request_id': 'req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.758801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d703a8330df4e1493213a01d1434b1f', 'request_id': 'req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.789882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] The token cache is being invalidate because project 8d703a8330df4e1493213a01d1434b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:01.790226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.792083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:01.797997 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4088/8213] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:01 2022] DELETE /identity/v3/projects/8d703a8330df4e1493213a01d1434b1f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:46:01.799373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:01.800980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:01.979264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74227a-42ff-4a8b-b99f-185465c25bcf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:02.078932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:02.080289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:02.080854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:02.081398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] PATH_INFO: `/v3/users/9d0083d4cca64389a8296a6a6c8a462a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:02.084505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0083d4cca64389a8296a6a6c8a462a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:02.087923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:02.209352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0083d4cca64389a8296a6a6c8a462a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.210318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0083d4cca64389a8296a6a6c8a462a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.212616 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:02.228082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0083d4cca64389a8296a6a6c8a462a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.246326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0083d4cca64389a8296a6a6c8a462a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.270651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-577d28e0-a94f-468c-87da-30df6017a72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0083d4cca64389a8296a6a6c8a462a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.284757 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4126/8214] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:46:01 2022] DELETE /identity/v3/users/9d0083d4cca64389a8296a6a6c8a462a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:02.458533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:02.460310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:02.513617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a58e-9ce1-44a5-b6cc-5fe32ec2f0a0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:02.626450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:02.628673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:02.629114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:02.629887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] PATH_INFO: `/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:02.631471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7b79b49bc74858bfc26232fdc21bd8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:02.634107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:02.710468 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:02.733087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7b79b49bc74858bfc26232fdc21bd8', 'request_id': 'req-2f61b8bf-099f-476e-a6be-05b592d97546'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.742132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7b79b49bc74858bfc26232fdc21bd8', 'request_id': 'req-2f61b8bf-099f-476e-a6be-05b592d97546'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.750149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7b79b49bc74858bfc26232fdc21bd8', 'request_id': 'req-2f61b8bf-099f-476e-a6be-05b592d97546'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.776907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] The token cache is being invalidate because project ba7b79b49bc74858bfc26232fdc21bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:02.777240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.778378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f61b8bf-099f-476e-a6be-05b592d97546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:02.780440 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4089/8215] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:02 2022] DELETE /identity/v3/projects/ba7b79b49bc74858bfc26232fdc21bd8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:02.786125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:02.786615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:02.786746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:02.819008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:02.821297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:02.904881 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4127/8216] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:02.909400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:02.909717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:02.910010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:02.935573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:02.937382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:02.954646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:02.960506 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4090/8217] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:02.967892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d0002-1dee-411d-839e-77be2a276119 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:02.972813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:02.973659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:02.973980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:02.974313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:02.975058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:46:02.975369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:02.977055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:02.992280 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4128/8218] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:46:02.996663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.008072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d157c-7d9c-4d06-8723-0ebcf4be3a09 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.016985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.018375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.018874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.020045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.020983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.023395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.097035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.108337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4091/8219] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:02 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:03.113628 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652f330-4d76-4196-9c43-c7e26642d648 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.226184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.227027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.227417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.228320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.229804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.233370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.317709 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4129/8220] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:03 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:03.317910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.332675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546dea6-af17-469d-ab00-99012d841c82 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.346447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.347133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.347411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.347679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.348417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.350205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.381110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4092/8221] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:03.388599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.421207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ae0-022a-4081-9519-4b4990c4a6f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.443765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.444731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.448770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.451179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.454987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.460289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.499397 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4130/8222] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:03.504832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.519151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b29c-6541-446a-87ee-2d771072b13c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.535456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.536631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.537154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.537715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] PATH_INFO: `/v3/projects/101695253c6e40569d3cb5b391fccd61/users/c4b34bec387d42859f416aa3df7a7d0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.560965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101695253c6e40569d3cb5b391fccd61, user_id=c4b34bec387d42859f416aa3df7a7d0e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.563208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.566749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:03.578076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653bc23-0bff-46f3-826b-d6506c30e9e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.590824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3b7d9-2fcd-4a85-bb21-5f00e52702a6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:03.603973 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:03.607542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.608162 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4093/8223] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:03 2022] PUT /identity/v3/projects/101695253c6e40569d3cb5b391fccd61/users/c4b34bec387d42859f416aa3df7a7d0e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:03.608525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.609065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] PATH_INFO: `/v3/projects/75caac39e2c64af3bbe2a863c07eec8d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.613212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:03.613952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:03.614798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:03.615174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75caac39e2c64af3bbe2a863c07eec8d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:03.618996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:03.653456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:03.658713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:03.705457 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=4,keystone:DELETE=4,keystone:SELECT=92 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:03.751820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75caac39e2c64af3bbe2a863c07eec8d', 'request_id': 'req-9c87e661-c9fe-4b82-83db-899200cad6f7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:03.772994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75caac39e2c64af3bbe2a863c07eec8d', 'request_id': 'req-9c87e661-c9fe-4b82-83db-899200cad6f7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:03.800081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75caac39e2c64af3bbe2a863c07eec8d', 'request_id': 'req-9c87e661-c9fe-4b82-83db-899200cad6f7'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:03.816457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] The token cache is being invalidate because project 75caac39e2c64af3bbe2a863c07eec8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:03.816761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:03.817460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:03.824238 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4131/8224] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:03 2022] DELETE /identity/v3/projects/75caac39e2c64af3bbe2a863c07eec8d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:03.825246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.827085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:03.845168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4094/8225] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:46:03.878932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:03.880740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.066657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87e661-c9fe-4b82-83db-899200cad6f7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:04.076112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:04.077502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:04.078822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:04.078822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] PATH_INFO: `/v3/users/2ff186b2e77c451b9f4735ec6e8ca71f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:04.080812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff186b2e77c451b9f4735ec6e8ca71f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:04.082839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:04.127688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b6b5-3612-4fad-91aa-d3e49cf2a7ac None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:04.190515 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:04.211206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff186b2e77c451b9f4735ec6e8ca71f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.214325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff186b2e77c451b9f4735ec6e8ca71f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.241779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff186b2e77c451b9f4735ec6e8ca71f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.272044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff186b2e77c451b9f4735ec6e8ca71f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.273020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:04.273721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:04.275252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:04.275526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:04.278425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.310170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:04.323589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff186b2e77c451b9f4735ec6e8ca71f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.326115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:04.341014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4095/8226] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:46:04.342622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:04.344325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.353001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4132/8227] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:46:03 2022] DELETE /identity/v3/users/2ff186b2e77c451b9f4735ec6e8ca71f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:04.354948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:04.358396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.382701 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:04.537157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c61f59-7be8-4106-800c-dab5b08212d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:04.553532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:04.556152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:04.558568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:04.558823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] PATH_INFO: `/v3/users/c7fa9575362746448d135295799c6631` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:04.561855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fa9575362746448d135295799c6631)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:04.570092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:04.584022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773405-6d6a-4167-90c7-d597f075a0b0 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:04.691829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fa9575362746448d135295799c6631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.695991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fa9575362746448d135295799c6631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.726948 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fa9575362746448d135295799c6631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.742434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fa9575362746448d135295799c6631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.755698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:04.757776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:04.758082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:04.762327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:04.768450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d347859f-0fc8-487e-b089-e649a044b7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fa9575362746448d135295799c6631'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:04.768859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.785941 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4133/8228] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:46:04 2022] DELETE /identity/v3/users/c7fa9575362746448d135295799c6631 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:04.790976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:04.793244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:04.794666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:04.803800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:04.805648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:04.824835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4096/8229] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:04.837250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:04.841511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:04.984142 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4134/8230] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:05.015335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:05.016960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:05.090782 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:05.165959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9adc2-a1a7-4fda-850a-5bfde1f56954 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:05.301333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:05.302038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:05.302324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:05.302600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:05.324188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:05.326634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2a8b-b4a5-4f54-a34f-b8ba8ff1d4ce service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:05.343234 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4097/8231] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:05.349574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:05.351227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:05.370872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac15b31-7090-4ad2-887d-40c107b9e43b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:05.406583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:05.408707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:05.410027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:05.410337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] PATH_INFO: `/v3/projects/85591b6d428041eb964389da30be2a6f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:05.414548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85591b6d428041eb964389da30be2a6f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:05.415885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:05.503578 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:05.553653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85591b6d428041eb964389da30be2a6f', 'request_id': 'req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:05.563488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85591b6d428041eb964389da30be2a6f', 'request_id': 'req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:05.582163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85591b6d428041eb964389da30be2a6f', 'request_id': 'req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:05.627454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] The token cache is being invalidate because project 85591b6d428041eb964389da30be2a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:05.627910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:05.628773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-2b87ebba-89f8-4d84-9bcd-08fcc628af2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:05.639776 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4135/8232] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:05 2022] DELETE /identity/v3/projects/85591b6d428041eb964389da30be2a6f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:05.641482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:05.642042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:05.642139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:05.669078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:05.670505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:05.807934 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4098/8233] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:05.811731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:05.812094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:05.812509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:05.862518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:05.865717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:05.890550 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4136/8234] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:05.894591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:05.913541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f0d16-d7af-4004-bd12-3835c63e4a5c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:05.930012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:05.930712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:05.930997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:05.931352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:05.932020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:46:05.932360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:05.935360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:05.958324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4099/8235] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:46:05.964167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:05.983052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdffdb6-cc5d-4f57-8b51-754fd0c87cee None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.005390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.006130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.006573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.006855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.007775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.009561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.085863 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4137/8236] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:05 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:46:06.090267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.101280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbb29-eb49-4b40-96e9-a29222a0b8ed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.194180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.196335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:06.294834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.295688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.296671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.298519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.299782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.303384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.351292 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:06.368375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4100/8237] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:06 2022] POST /identity/v3/users => generated 299 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:06.370123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.394750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57505c5e-768b-4c27-820f-02a49a91a3e9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.406266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105ddd-9209-4571-b010-cd01b002a0eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.409320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.410044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.411457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.411733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.419638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.421777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.424734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.426561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.426850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.427129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] PATH_INFO: `/v3/projects/01d46f189031451f9ad4635a123c31f5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.430495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d46f189031451f9ad4635a123c31f5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.436338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.455556 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4101/8238] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:06.456526 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.482870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a45b-fe8d-46ca-b9fe-89ce7e17dca3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.496519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.497328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.497612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.497926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.498678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.501643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.544659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4102/8239] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:06.545950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.554012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d46f189031451f9ad4635a123c31f5', 'request_id': 'req-8d5552f4-a213-4a17-87a9-513a27fb6d96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:06.560872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e01b-b90f-49f0-9acd-7b78c6b260d9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.567794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d46f189031451f9ad4635a123c31f5', 'request_id': 'req-8d5552f4-a213-4a17-87a9-513a27fb6d96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:06.593661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d46f189031451f9ad4635a123c31f5', 'request_id': 'req-8d5552f4-a213-4a17-87a9-513a27fb6d96'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:06.626585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] The token cache is being invalidate because project 01d46f189031451f9ad4635a123c31f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:06.626585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:06.627268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8d5552f4-a213-4a17-87a9-513a27fb6d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:06.628996 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4138/8240] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:06 2022] DELETE /identity/v3/projects/01d46f189031451f9ad4635a123c31f5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:46:06.636960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6506d-804e-48bb-b07e-b507dc6aa340 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.637309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6506d-804e-48bb-b07e-b507dc6aa340 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.637817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6506d-804e-48bb-b07e-b507dc6aa340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.659883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.661554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.662133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.662661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] PATH_INFO: `/v3/projects/4ede3ab0c5e54f9e8265f675f0e964b3/users/95062e6caadd4965b17ff5038ea18549/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.679920 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:06.700291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-17c6506d-804e-48bb-b07e-b507dc6aa340 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:06.702120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17c6506d-804e-48bb-b07e-b507dc6aa340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:06.709808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ede3ab0c5e54f9e8265f675f0e964b3, user_id=95062e6caadd4965b17ff5038ea18549, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.715078 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4139/8241] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:06.720471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81de371-84a7-4e57-ba5e-7b3a8e2837ff admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.722716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.723284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.723865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.767120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:06.767120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:06.767379 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4103/8242] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:06 2022] PUT /identity/v3/projects/4ede3ab0c5e54f9e8265f675f0e964b3/users/95062e6caadd4965b17ff5038ea18549/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:06.768939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.769320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.769616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.806262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] MFA Rules not processed for user `95062e6caadd4965b17ff5038ea18549`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:06.807732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:06.874178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4140/8243] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:06.874980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.897361 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4104/8244] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:06.902744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae5560-16b5-4ffb-a80a-22142943169a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:06.906411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:06.908216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:06.932083 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:06.932965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:06.933242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:06.933564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:06.935367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:46:06.935683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:06.938102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:06.960288 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4141/8245] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:46:06.965312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.012024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301f31-70e6-4a48-a1ad-11c38d7405ca admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.034658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.035536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.035758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.036033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.036742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.039246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.043196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a916-1503-42ad-91e0-15cb44c119a8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.049123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.050358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.050904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.051525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.063687 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:07.069898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.074135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.086804 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4105/8246] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:46:07.087510 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4142/8247] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:06 2022] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:07.093389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.112446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6af38-13ae-456d-af80-60942b4e035d service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.219027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.219846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.220229 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.220633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.221452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.223658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.259197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4106/8248] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:07 2022] POST /identity/v3/users => generated 281 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:07.263078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.278022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea947-7023-4faf-aa5c-50b9cc9c89c3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.296620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.297517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.298100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.298550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.300305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.303388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.350896 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4143/8249] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:07.352066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.373028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0f8a-497b-42ab-9b44-b966c7e0fb2c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.389178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.392072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.392368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.394808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.395721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.401743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c43017-f0a0-4882-88a6-fec73599a173 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.451938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4107/8250] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:07.455980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.472711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668a7ae-996b-47bd-9fb3-3deea731c950 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:07.500134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:07.502479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.503163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.505341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] PATH_INFO: `/v3/projects/9e900c0edee943ad9757180a6c83e200/users/e6f618c1a0b647b58a7630e04ac916cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.571154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e900c0edee943ad9757180a6c83e200, user_id=e6f618c1a0b647b58a7630e04ac916cd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:07.576153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:07.622178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4144/8251] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:07 2022] PUT /identity/v3/projects/9e900c0edee943ad9757180a6c83e200/users/e6f618c1a0b647b58a7630e04ac916cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:07.632369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233eb7-2d2b-4a23-a222-7311d1efb110 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:07.632945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233eb7-2d2b-4a23-a222-7311d1efb110 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:07.633417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df233eb7-2d2b-4a23-a222-7311d1efb110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:07.712065 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-df233eb7-2d2b-4a23-a222-7311d1efb110 None None] MFA Rules not processed for user `e6f618c1a0b647b58a7630e04ac916cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:07.713375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df233eb7-2d2b-4a23-a222-7311d1efb110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:07.917787 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4108/8252] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:07.985924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:07.989509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:08.144552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b298d62-8c8e-4c2a-b6eb-e448621187e1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:08.160536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:08.161233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:08.162318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:08.162615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:08.191078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:08.197295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:08.225219 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4145/8253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:17.181406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:17.185793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:17.186154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:17.280167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] MFA Rules not processed for user `c4b34bec387d42859f416aa3df7a7d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:17.285052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:17.396453 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:17.450782 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4109/8254] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:17.451089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:17.453647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:17.563900 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:17.847830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6c937-000c-4010-adc1-d55e401a6375 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:17.847830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:17.847830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:17.847830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:17.853361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:17.853361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:17.853361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:17.855363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:17.855636 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4146/8255] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:17 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:17.855907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b451de-3661-427f-8b6d-3ac313619edd None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:17.929421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:17.930146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:17.930456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:17.930780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:17.931569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:17.933743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:17.982669 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4110/8256] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:17 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:17.987106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:18.005997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9569ffb-6a42-4696-b4e1-98637a63729e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:18.022863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:18.023589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:18.023925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:18.024205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:18.025071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:18.027930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:18.058893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:18.060037 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4147/8257] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:46:18.080434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f133b1-2e71-4eed-b811-3d123149515b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:18.091631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:18.092953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:18.093242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:18.093518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] PATH_INFO: `/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4/users/0ab79892fe94440799d98e1c0b53a876/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:18.133143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bfd6d87e1e48a1925b2a4753b211b4, user_id=0ab79892fe94440799d98e1c0b53a876, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:18.136408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:18.176202 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4111/8258] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:18 2022] PUT /identity/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4/users/0ab79892fe94440799d98e1c0b53a876/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:46:18.181111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:18.200683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0983e-baa5-49ac-9f91-d0f64fd441e8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:18.347458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:18.350772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:18.350772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:18.350772 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:18.353343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:18.358126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:18.396823 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4148/8259] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:18.397545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:18.423400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9927d4-d275-41ab-b754-86c2807876e9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:18.439885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:18.440806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:18.441085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:18.441338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] PATH_INFO: `/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4/users/0ab79892fe94440799d98e1c0b53a876/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:18.451351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bfd6d87e1e48a1925b2a4753b211b4, user_id=0ab79892fe94440799d98e1c0b53a876, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:18.454338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991247e-edce-4019-a7f4-697447a1b57d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:18.480592 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4112/8260] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:18 2022] PUT /identity/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4/users/0ab79892fe94440799d98e1c0b53a876/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:23.084949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:23.087638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:23.115493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255be3a-556f-43a7-91ae-920ee6be26a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:23.255624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:23.256540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:23.257031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:23.257482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] PATH_INFO: `/v3/users/95062e6caadd4965b17ff5038ea18549` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:23.262568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95062e6caadd4965b17ff5038ea18549)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:23.268340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:23.389981 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:23.402646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95062e6caadd4965b17ff5038ea18549'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:23.403390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95062e6caadd4965b17ff5038ea18549'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:23.418318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95062e6caadd4965b17ff5038ea18549'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:23.437974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95062e6caadd4965b17ff5038ea18549'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:23.485344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95062e6caadd4965b17ff5038ea18549'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:23.493581 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4149/8261] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:46:23 2022] DELETE /identity/v3/users/95062e6caadd4965b17ff5038ea18549 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:23.499721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:23.500711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:23.501250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:23.533326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:23.535088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:23.673577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4113/8262] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:23.700444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:23.702323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:23.823777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b549e-3b2e-4f03-b453-1c174aea7fa0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:23.828588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:23.830191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:23.830515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:23.830932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:23.857933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:23.864629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091e71-acb3-4a58-9b9d-2b020edd4c33 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:23.894762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4150/8263] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:25.129799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:25.135771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:25.172280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e577523-e2c5-49ff-8b4c-5df5de5de66c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:25.177424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:25.178664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:25.179099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:25.179524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] PATH_INFO: `/v3/projects/4ede3ab0c5e54f9e8265f675f0e964b3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:25.181079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ede3ab0c5e54f9e8265f675f0e964b3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:25.184134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:25.270237 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:25.325396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ede3ab0c5e54f9e8265f675f0e964b3', 'request_id': 'req-85365961-892f-43e6-b5f6-065db30af5d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:25.359417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ede3ab0c5e54f9e8265f675f0e964b3', 'request_id': 'req-85365961-892f-43e6-b5f6-065db30af5d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:25.368491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ede3ab0c5e54f9e8265f675f0e964b3', 'request_id': 'req-85365961-892f-43e6-b5f6-065db30af5d0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:25.392720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] The token cache is being invalidate because project 4ede3ab0c5e54f9e8265f675f0e964b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:46:25.394384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:25.395994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-85365961-892f-43e6-b5f6-065db30af5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:46:25.406874 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4114/8264] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:46:25 2022] DELETE /identity/v3/projects/4ede3ab0c5e54f9e8265f675f0e964b3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:25.412493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:25.413296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:25.413296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:25.484500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:25.485969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:25.670617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:25.671073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:25.671176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:25.673899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4151/8265] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:46:25.705368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:25.707358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:25.724304 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4115/8266] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:25.729710 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:25.757156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b5496-6c4e-4d1d-bf0a-58e92a7a8d6f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:25.776421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:25.777127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:25.777415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:25.778344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:25.778692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:46:25.778944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:25.787411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:25.834539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4152/8267] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:46:25.839851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:25.851270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826416ee-4d2d-4693-8de7-43f7e54bb3d7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:25.870401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:25.871503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:25.871798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:25.872545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:25.877532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:25.884829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:25.980837 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4116/8268] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:25 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:46:25.982766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:26.006893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9cb9a-df7a-4440-8bd2-8e8b9fd5b342 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:26.205095 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:26.229197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:26.230331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:26.230643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:26.230922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:26.231603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:26.233553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:26.293247 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4153/8269] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:25 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:26.294192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:26.327587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1370b-a3bb-47cc-8110-4d5a28591c90 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:26.357458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:26.359883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:26.364282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:26.369528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:26.370844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:26.374080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:26.417185 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4117/8270] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:26.421589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:26.434566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226149e-37f0-4849-a055-71394133b37c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:26.451063 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:26.453557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:26.455260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:26.455871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:26.457060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:26.460134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fec21-dd19-4f19-afdf-b61b2bfb0bd8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:26.496116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4154/8271] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:26.497577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:26.530088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c410-feb3-4eba-85d3-889dbe462dd9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:26.562171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:26.563324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:26.563776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:26.564235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] PATH_INFO: `/v3/projects/f4b5a847051449df8fc6a3f05dbb3d59/users/49542098be914013837bfe2310608c31/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:26.591387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b5a847051449df8fc6a3f05dbb3d59, user_id=49542098be914013837bfe2310608c31, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:26.595913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:26.624488 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4118/8272] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:26 2022] PUT /identity/v3/projects/f4b5a847051449df8fc6a3f05dbb3d59/users/49542098be914013837bfe2310608c31/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:26.634762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:26.635803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:26.636090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:26.679587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] MFA Rules not processed for user `49542098be914013837bfe2310608c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:26.684551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:26.881742 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4155/8273] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:26.886507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:27.081706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5ddd2-9aad-46f5-9537-4df935a02192 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:27.096745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:27.097433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:27.097737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:27.098017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:27.098723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:27.104360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:27.240996 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4119/8274] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:46:26 2022] POST /identity/v3/projects => generated 371 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:46:27.241715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:27.265161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0404699-7973-438b-9177-40a5e91b6816 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:27.494631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:27.496191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:27.496700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:27.497414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:27.498848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:27.501006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:27.580203 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4156/8275] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:46:27 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:46:27.586586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:27.610272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201574-835c-420a-92a2-d12e27bfaeb5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:27.622985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:27.623952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:27.624435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:27.624874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:27.625841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:27.630050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:27.654722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4120/8276] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:27.659181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:27.674807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69a88-64e5-4456-ab3d-eabd2cea304b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:27.689461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:27.690380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:27.692585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:27.693023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] PATH_INFO: `/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d/users/af2d47adf1834d34887dbeb6eb7b2a77/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:27.733794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8a7af9581b4732bfea9b37b732aa0d, user_id=af2d47adf1834d34887dbeb6eb7b2a77, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:27.737468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:27.770582 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4157/8277] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:27 2022] PUT /identity/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d/users/af2d47adf1834d34887dbeb6eb7b2a77/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:27.775749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:27.804947 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b415-cb88-4b54-9b2c-4716326f4ae4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:27.939274 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:28.038573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:28.039266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:28.039549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:28.039825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:28.041244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:28.047507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b5c7-8187-45d6-a24e-e638d102e596 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:28.075551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4121/8278] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:46:28.076812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:28.102647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785fb4-e7e4-44eb-860c-605289be3dfb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:28.121438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:28.122745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:28.123270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:28.123696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] PATH_INFO: `/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d/users/af2d47adf1834d34887dbeb6eb7b2a77/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:28.143099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8a7af9581b4732bfea9b37b732aa0d, user_id=af2d47adf1834d34887dbeb6eb7b2a77, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:28.154509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:28.224428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4158/8279] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:46:28 2022] PUT /identity/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d/users/af2d47adf1834d34887dbeb6eb7b2a77/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:46:28.238977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:28.239267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:28.239541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:28.274882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] MFA Rules not processed for user `af2d47adf1834d34887dbeb6eb7b2a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:28.276876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:28.503623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4122/8280] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:28.529121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:28.531503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:28.572263 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:28.710293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894a72-cb93-4df2-b077-239792ba9de0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:28.726645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:28.727345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:28.727630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:28.727910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:28.923299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:28.927322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:28.961753 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4159/8281] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:29.832037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:29.833689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:30.079397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8318d0-2372-4684-ac8f-c5891c6cf36e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:30.093163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:30.093840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:30.094121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:30.094345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:30.102618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:30.157838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:30.159532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc9c7-60ce-4b6e-a074-1ef64c80d32d service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:30.186595 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4123/8282] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:30.687647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:30.762549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f691bf-5e7e-41c3-829f-a71b79e5d044 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:30.821065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:30.823133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:30.824874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:30.825400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:30.834370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:30.894871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:30.898617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:30.977299 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4160/8283] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:32.513052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:32.513592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:32.513592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:32.620007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] MFA Rules not processed for user `0ab79892fe94440799d98e1c0b53a876`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:32.621271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:32.692354 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:32.792868 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4124/8284] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:32.807742 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:32.810153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:32.994650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e5158-f50d-4000-a3fa-d3375be3c2a1 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:33.008702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:33.011631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:33.012297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:33.012740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:33.018491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:33.176207 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:46:33.202750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:33.204705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6e0f-e0bb-4dd1-99d2-fa022cd398f3 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:33.221010 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4161/8285] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:38.902912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:38.905535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:38.938023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7a02-976b-43a2-97ed-8e38f4a4d460 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:38.953489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:38.955807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:38.956119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:38.956401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:38.993484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:39.001039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:39.034705 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4125/8286] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:39.465918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:39.466449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:39.466449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:39.505059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] MFA Rules not processed for user `c4b34bec387d42859f416aa3df7a7d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:39.506286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:39.524953 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4162/8287] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:46:41.707916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:41.710572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:41.739217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0208865-72cf-4cfe-a973-67e9c4b5dfe4 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:41.751330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:41.752364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:41.753043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:41.753603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:41.756449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:41.791575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:41.796763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:41.834534 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4126/8288] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:42.490757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:42.525957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94f11-f7e1-428d-8d7f-0469bea2d784 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:42.548794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:42.549473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:42.549778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:42.563430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:42.565836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:42.598120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:42.606110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:42.644826 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4163/8289] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:47.896007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:47.922924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ea8f-b59c-4e9b-9f58-5a4672a15ed2 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:47.955086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:47.955772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:47.958975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:47.959274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:47.963707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:48.030717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:48.032363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:48.091074 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4127/8290] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:51.247892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:51.250746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:51.624934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750e444-3bdf-472c-8141-cabd5a8d848b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:51.642476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:51.643319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:51.644547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:51.644835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:51.653531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:51.901818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:51.905180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc43ee0-0835-4e68-928e-e282df32729d service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:51.954942 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4164/8291] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:46:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:46:57.812705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:46:57.814195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:57.960113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d6aef-5b3c-4874-9ed4-2160803fc303 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:46:57.969823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:46:57.971209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:57.972206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:57.974126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:57.986849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:58.064278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:46:58.065977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:46:58.083585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4128/8292] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:46:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:46:59.253788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:46:59.255225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:46:59.255660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:46:59.317447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] MFA Rules not processed for user `49542098be914013837bfe2310608c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:46:59.319324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:46:59.370157 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4165/8293] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:46:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:00.830361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:00.847808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31856579-48b1-47e3-ad9b-63b6081bc7a8 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:00.871853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:00.872748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:00.872984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:00.873267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:00.875163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:00.915038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:00.925832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:00.965816 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4129/8294] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:05.365514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:05.370847 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=77 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:05.387538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac88f8-50e2-40ad-945a-186cf37ca07b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:05.403308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:05.403984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:05.404270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:05.413814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:05.420305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:05.646482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:05.647978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:05.674144 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4166/8295] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:09.685833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:09.690633 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:09.701298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d31e-4daf-4db6-aa79-0315ca21d2f9 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:09.714494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:09.715609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:09.727414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:09.727414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:09.746186 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:09.748931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1160f-7c1e-486f-b26c-20732fd033fe service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:09.765738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4130/8296] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:15.663764 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=38 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:16.135982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:16.137719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:16.165002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6915c9-fb05-4341-a3f6-8e09ed88905b service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:16.170145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:16.171328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:16.171844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:16.172467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] PATH_INFO: `/v3/users/e6f618c1a0b647b58a7630e04ac916cd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:16.173966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f618c1a0b647b58a7630e04ac916cd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:16.176407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:16.243434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f618c1a0b647b58a7630e04ac916cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:16.244494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f618c1a0b647b58a7630e04ac916cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:16.281486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f618c1a0b647b58a7630e04ac916cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:16.298851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f618c1a0b647b58a7630e04ac916cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:16.328898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f618c1a0b647b58a7630e04ac916cd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:16.356049 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4167/8297] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:16 2022] DELETE /identity/v3/users/e6f618c1a0b647b58a7630e04ac916cd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:16.361120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:16.361567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:16.361835 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:16.443404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:16.444644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:16.549151 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4131/8298] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:16.560241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:16.562205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:16.662102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf5678-d227-4269-84f6-a3bdf9c034eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:16.667894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:16.668711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:16.669104 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:16.669446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:16.681722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:16.683434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f46dbc-8de2-445d-9d6d-ee2f1b077fb1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:16.697348 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4168/8299] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:16.975731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:16.981084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:17.050535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349f08d-3eb1-4e10-9606-5e0c119a9740 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:17.066246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:17.068217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.070077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.072111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] PATH_INFO: `/v3/projects/9e900c0edee943ad9757180a6c83e200` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.076593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e900c0edee943ad9757180a6c83e200)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:17.087173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:17.189439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e900c0edee943ad9757180a6c83e200', 'request_id': 'req-877c314f-7845-440c-86f0-af152c53c60f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:17.208544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e900c0edee943ad9757180a6c83e200', 'request_id': 'req-877c314f-7845-440c-86f0-af152c53c60f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:17.228435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e900c0edee943ad9757180a6c83e200', 'request_id': 'req-877c314f-7845-440c-86f0-af152c53c60f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:17.272211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] The token cache is being invalidate because project 9e900c0edee943ad9757180a6c83e200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:17.272509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:17.274352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-877c314f-7845-440c-86f0-af152c53c60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:17.276960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4132/8300] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:16 2022] DELETE /identity/v3/projects/9e900c0edee943ad9757180a6c83e200 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:17.282326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.282620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.282902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.334001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:17.335518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:17.438437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4169/8301] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:17.440614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.440614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.441129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.480306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:17.480306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:17.501898 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4133/8302] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:17.506081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:17.515137 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:17.522007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49403f-0179-4643-b9c0-16a534a01ef1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:17.531815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:17.533108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.534025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.534554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.535850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:17.536530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:17.539509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:17.561721 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4170/8303] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:17.564667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:17.593411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063a7c7-9f29-4daa-8ad2-42cef396b97c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:17.612008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:17.613349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.613839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.614297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.615183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:17.623550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:17.699928 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4134/8304] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:17 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:17.704290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:17.720310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2700b-c517-4519-8c03-0a9f19d3337b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:17.862427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:17.863032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.863311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.863583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.864431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:17.866300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:17.907950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4171/8305] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:17 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:17.911831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:17.935306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4bc4c-1072-4ad1-8a99-7a938ce408b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:17.947513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:17.948478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:17.948918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:17.949348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:17.950993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:17.953480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:17.988647 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4135/8306] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:17.991589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:18.006382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1350d4-272e-43b2-979f-9cf2c0fd79c0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:18.023894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:18.025371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:18.025665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:18.026038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:18.026971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:18.033122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc967-27c5-48b6-aa4a-ec3edbcb4984 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:18.064126 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4172/8307] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:18.067788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:18.094319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d12-05e5-48e3-b6db-47ef90a0fad4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:18.109936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:18.111121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:18.111592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:18.112169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] PATH_INFO: `/v3/projects/49f791622d5b4931a12407389ab36fdf/users/dfda1384b5114e6187cc3af76d36f3dd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:18.160543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f791622d5b4931a12407389ab36fdf, user_id=dfda1384b5114e6187cc3af76d36f3dd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:18.165501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:18.196010 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4136/8308] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:18 2022] PUT /identity/v3/projects/49f791622d5b4931a12407389ab36fdf/users/dfda1384b5114e6187cc3af76d36f3dd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:18.206139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:18.206347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:18.206610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:18.270516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] MFA Rules not processed for user `dfda1384b5114e6187cc3af76d36f3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:18.271759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:18.376956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4173/8309] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:18.390090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:18.392003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:18.398601 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:18.484509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbfb24-c416-4277-9ddd-443188f63a70 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:18.488796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:18.490042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:18.490179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:18.490419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:18.503516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:18.504901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688afd3a-e707-406c-b7b8-c552695eb1c0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:18.530423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4137/8310] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:23.276204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:23.278519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:23.451977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81deac-b7b8-4967-833e-3c71b74a4742 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:23.473944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:23.475237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:23.477337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:23.478172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] PATH_INFO: `/v3/users/6e881888eab24d93b513f03556871677` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:23.493702 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:23.530292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e881888eab24d93b513f03556871677)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:23.532857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:23.650435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e881888eab24d93b513f03556871677'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:23.652907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e881888eab24d93b513f03556871677'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:23.674339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e881888eab24d93b513f03556871677'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:23.692926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e881888eab24d93b513f03556871677'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:23.725144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e881888eab24d93b513f03556871677'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:23.738550 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4174/8311] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:23 2022] DELETE /identity/v3/users/6e881888eab24d93b513f03556871677 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:23.744022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:23.746316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:23.746849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:23.783004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:23.784576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:23.891336 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4138/8312] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:24.001463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:24.003302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:24.170389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749a3c-a166-451b-9c70-2482dadcafc5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:24.180580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:24.181259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:24.181661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:24.182040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:24.199297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:24.200788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a7b24-fb82-41be-8c0e-ef30730e54dd service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:24.225799 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4175/8313] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:25.948554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:25.951752 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:25.994613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636eccef-fe9e-4778-bc13-089fecfac22a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.005154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.007118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.008220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.008756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] PATH_INFO: `/v3/projects/067f6fe185724ef0931a4cfb8680cfba` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.045172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=067f6fe185724ef0931a4cfb8680cfba)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.048708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.169846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067f6fe185724ef0931a4cfb8680cfba', 'request_id': 'req-241b3e89-1ca1-4d48-9462-d23bfb66e9df'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:26.178753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067f6fe185724ef0931a4cfb8680cfba', 'request_id': 'req-241b3e89-1ca1-4d48-9462-d23bfb66e9df'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:26.191310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067f6fe185724ef0931a4cfb8680cfba', 'request_id': 'req-241b3e89-1ca1-4d48-9462-d23bfb66e9df'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:26.220423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] The token cache is being invalidate because project 067f6fe185724ef0931a4cfb8680cfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:26.221459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:26.222459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-241b3e89-1ca1-4d48-9462-d23bfb66e9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:26.225696 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4139/8314] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:25 2022] DELETE /identity/v3/projects/067f6fe185724ef0931a4cfb8680cfba => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:26.231579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.232473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.232907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.263122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:26.264663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:26.362750 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4176/8315] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:26.375303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.376476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.377150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.418353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:26.420087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:26.431775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4140/8316] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:26.435869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.447311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db67df2-4ba0-4af7-9c47-af778c2eeaad None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.452589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.454175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.454473 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.454758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.455515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:26.455846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.457757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.473405 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:26.485307 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4177/8317] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:26.491072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.509226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dbc20-ed55-4a21-a94d-b1f8d66c4571 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.526212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.528435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.530206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.530559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.532532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.537532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.564033 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:26.617566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4141/8318] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:26 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:26.621802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.636103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9eb7-baaa-4b42-b072-71f8c95e2a87 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.742725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.743420 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.743750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.744028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.744730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.747211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.772318 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4178/8319] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:26 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:26.776414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.786881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03f8b5-c029-4bf9-b196-85ba832871f6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.793725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.793725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.794198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.794198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.794903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.796603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.812763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4142/8320] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:26.815303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.828058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4c42-7f5d-46a0-980d-1797291bea70 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.833408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.834269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.834635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.835802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.836177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.838492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551d43f-fb6d-4473-b65c-56bd84f3ab6d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.855862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:26.863190 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4179/8321] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:26.870534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275f20d-252e-4491-a33a-3ec8d753bbda admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:26.875484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:26.876404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.876682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.876956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] PATH_INFO: `/v3/projects/e4e482c072c4405ba250948dbaf52dfa/users/cd25841a585d49bc9ecb683ca8078735/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:26.896273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e482c072c4405ba250948dbaf52dfa, user_id=cd25841a585d49bc9ecb683ca8078735, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:26.899254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:26.917865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4143/8322] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:26 2022] PUT /identity/v3/projects/e4e482c072c4405ba250948dbaf52dfa/users/cd25841a585d49bc9ecb683ca8078735/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:26.927322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:26.927677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:26.927966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:27.022775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] MFA Rules not processed for user `cd25841a585d49bc9ecb683ca8078735`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:27.027688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:27.287101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:27.288290 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4180/8323] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:27.290301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:27.414354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6bd49-a51b-4bde-9b65-5bee65c51445 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:27.419049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:27.419918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:27.420366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:27.420847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:27.432191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:27.433924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:27.456543 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4144/8324] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:29.931164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:29.940733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:30.044311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae925-8f8c-474e-b6e9-1e23a78d7d77 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:30.058535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:30.059642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:30.060087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:30.060578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] PATH_INFO: `/v3/users/8f38ad0b87584fb498dc0479b0656b7f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:30.063441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f38ad0b87584fb498dc0479b0656b7f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:30.065688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:30.079513 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:30.184371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f38ad0b87584fb498dc0479b0656b7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:30.186115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f38ad0b87584fb498dc0479b0656b7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:30.228428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f38ad0b87584fb498dc0479b0656b7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:30.250007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f38ad0b87584fb498dc0479b0656b7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:30.282352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f38ad0b87584fb498dc0479b0656b7f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:30.294649 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4181/8325] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:29 2022] DELETE /identity/v3/users/8f38ad0b87584fb498dc0479b0656b7f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:30.821929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:30.857433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee474f-d4ae-48cd-aa40-dc73a2d76ae3 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:30.986251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:30.988215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:30.988723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:30.989367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] PATH_INFO: `/v3/projects/9594d185ff204f60b15075242c4a9d4c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:30.990961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9594d185ff204f60b15075242c4a9d4c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:30.996350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:31.070462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9594d185ff204f60b15075242c4a9d4c', 'request_id': 'req-34a68ea6-0f81-41a3-803b-24f20b1cf675'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.078922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9594d185ff204f60b15075242c4a9d4c', 'request_id': 'req-34a68ea6-0f81-41a3-803b-24f20b1cf675'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.092315 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:31.103703 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9594d185ff204f60b15075242c4a9d4c', 'request_id': 'req-34a68ea6-0f81-41a3-803b-24f20b1cf675'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.128117 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] The token cache is being invalidate because project 9594d185ff204f60b15075242c4a9d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:31.128553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.130142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.134772 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4145/8326] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:30 2022] DELETE /identity/v3/projects/9594d185ff204f60b15075242c4a9d4c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:31.138839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:31.140531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:31.166041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044776c1-b82c-497f-ad71-e29e3af30c8a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:31.279700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:31.281282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:31.281854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:31.282319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] PATH_INFO: `/v3/users/8bd7836fac9243ef9e0a2e363274c545` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:31.284933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd7836fac9243ef9e0a2e363274c545)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:31.288205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:31.365483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd7836fac9243ef9e0a2e363274c545'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.374976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd7836fac9243ef9e0a2e363274c545'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.394348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd7836fac9243ef9e0a2e363274c545'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.410557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd7836fac9243ef9e0a2e363274c545'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.428527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ceacc187-d057-4e49-82e8-a4367d40b7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd7836fac9243ef9e0a2e363274c545'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:31.440472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4182/8327] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:31 2022] DELETE /identity/v3/users/8bd7836fac9243ef9e0a2e363274c545 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:32.136722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.139430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:32.168154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68ea6-0f81-41a3-803b-24f20b1cf675 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.255876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.257208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.257790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.258341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] PATH_INFO: `/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.259761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2819399aa5e14dc5bfd98cbce7b830f9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.261898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.365538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2819399aa5e14dc5bfd98cbce7b830f9', 'request_id': 'req-dd5f6745-57d8-486d-8351-46cea9bdd1da'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:32.374999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2819399aa5e14dc5bfd98cbce7b830f9', 'request_id': 'req-dd5f6745-57d8-486d-8351-46cea9bdd1da'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:32.384294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2819399aa5e14dc5bfd98cbce7b830f9', 'request_id': 'req-dd5f6745-57d8-486d-8351-46cea9bdd1da'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:32.404248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] The token cache is being invalidate because project 2819399aa5e14dc5bfd98cbce7b830f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:32.407375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:32.408417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-dd5f6745-57d8-486d-8351-46cea9bdd1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:32.411600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4146/8328] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:32 2022] DELETE /identity/v3/projects/2819399aa5e14dc5bfd98cbce7b830f9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:32.418057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.418685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.419391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.430855 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:32.453924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:32.455397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:32.563726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4183/8329] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:32.566231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.566523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.566807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.591911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:32.594264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:32.603537 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4147/8330] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:32.607851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.620804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538825-6c64-4572-abf5-1c293e4e6155 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.626788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.627817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.628332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.629010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.630004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:32.630651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.633630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.653967 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4184/8331] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:32.658551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.670096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c732629-a79f-4156-81ce-98c0a0d32442 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.674872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.675538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.675817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.676098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.676796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.678907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.715656 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4148/8332] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:32 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:32.716638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.737659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6529-40fc-4946-81e3-533b5daaa1e1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.847629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.848556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.849013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.849453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.850364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.853759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.907888 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4185/8333] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:32 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:47:32.909303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.924414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b3926-34e6-4d4d-a0cc-6d2dabfb42b9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.929170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.930011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.930292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.930565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.931302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.932954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.954326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4149/8334] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:32.958558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:32.969975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea74a-fb8f-4e49-96c7-9b41a8fc0c17 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:32.974899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:32.975644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:32.976437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:32.976711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:32.977462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:32.979120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705155a5-772c-49d1-86fa-4b4b7a489364 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:32.994412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4186/8335] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:32.995667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:33.006669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04604571-f55f-4eaa-a0d7-85fb3b16c011 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:33.012262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:33.013198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:33.013479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:33.013806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] PATH_INFO: `/v3/projects/03e5e1c5805b4c8895ecc39da9838803/users/36ad5b8d2523473fa2111be3a6b8523e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:33.030731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e5e1c5805b4c8895ecc39da9838803, user_id=36ad5b8d2523473fa2111be3a6b8523e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:33.033390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:33.051289 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4150/8336] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:32 2022] PUT /identity/v3/projects/03e5e1c5805b4c8895ecc39da9838803/users/36ad5b8d2523473fa2111be3a6b8523e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:33.053107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:33.054226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:33.054734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:33.078699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:33.080337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:33.167811 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4187/8337] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:33.177464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:33.180059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:33.200758 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:33.253658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50286b-d33e-4391-9e7c-092ca8eeaf1c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:33.259607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:33.260288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:33.260773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:33.261054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:33.271225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:33.272634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee91d5-fbed-44b0-92c6-2449b5d8d9e5 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:33.282924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4151/8338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:47:33.638174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:33.642040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:33.676829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f997b-6865-4386-aa17-0e0f621d8b17 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:33.698102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:33.699020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:33.699294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:33.700219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] PATH_INFO: `/v3/users/cd25841a585d49bc9ecb683ca8078735` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:33.703217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd25841a585d49bc9ecb683ca8078735)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:33.705336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:33.713279 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:33.791485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd25841a585d49bc9ecb683ca8078735'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:33.792345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd25841a585d49bc9ecb683ca8078735'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:33.805085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd25841a585d49bc9ecb683ca8078735'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:33.820201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd25841a585d49bc9ecb683ca8078735'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:33.839970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd25841a585d49bc9ecb683ca8078735'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:33.849711 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4188/8339] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:33 2022] DELETE /identity/v3/users/cd25841a585d49bc9ecb683ca8078735 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:33.854285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:33.854569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:33.855290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:33.893974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:33.895565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:34.045447 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4152/8340] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:34.074986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:34.077012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:34.170956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c1986-9781-456a-b106-50763659f20a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:34.175159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:34.175825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:34.176106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:34.177516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:34.197319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:34.200007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f4b25-a3eb-4f5c-a6cd-fc7c107c645a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:34.253305 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4189/8341] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:35.415302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:35.416811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:35.428981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c256f7d-59d2-4eaf-98b8-e1e062f08149 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:35.434981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:35.436112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:35.436855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:35.437476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] PATH_INFO: `/v3/projects/e4e482c072c4405ba250948dbaf52dfa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:35.439045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e482c072c4405ba250948dbaf52dfa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:35.441216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:35.525447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e482c072c4405ba250948dbaf52dfa', 'request_id': 'req-e73fb25f-fe48-495a-8b7a-755dd5e4f238'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:35.532912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e482c072c4405ba250948dbaf52dfa', 'request_id': 'req-e73fb25f-fe48-495a-8b7a-755dd5e4f238'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:35.539793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e482c072c4405ba250948dbaf52dfa', 'request_id': 'req-e73fb25f-fe48-495a-8b7a-755dd5e4f238'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:35.561001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] The token cache is being invalidate because project e4e482c072c4405ba250948dbaf52dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:35.561406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:35.562198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e73fb25f-fe48-495a-8b7a-755dd5e4f238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:35.564986 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4153/8342] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:35 2022] DELETE /identity/v3/projects/e4e482c072c4405ba250948dbaf52dfa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:35.571088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:35.571584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:35.571699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:35.621811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:35.623630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:35.705973 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4190/8343] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:35.714561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:35.715263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:35.715263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:35.751459 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:35.752866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:35.770964 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4154/8344] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:35.773586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:35.787322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351255-7a9f-4a18-8003-718f91204e71 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:35.796479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:35.798533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:35.799283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:35.800156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:35.802271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:35.802937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:35.807803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:35.820974 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:35.828783 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4191/8345] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:35.832958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:35.843398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddfd28-ea09-4e95-9e75-3b8359737e40 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:35.849217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:35.849925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:35.850212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:35.850584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:35.851671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:35.853685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:35.894266 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4155/8346] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:35 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:35.895933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:35.909298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f57ca-e44a-455b-b842-609e0a0ebb32 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:36.038658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:36.039514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.039695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.040110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.040899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:36.043524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:36.088529 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4192/8347] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:35 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:47:36.092333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:36.111738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5eda-412d-4270-bd48-b9b64bef2b98 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:36.122506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:36.123380 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.123772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.124150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.125111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:36.128924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:36.155995 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4156/8348] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:36.159984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:36.182367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af47c4-bbb9-48c1-a4e3-97b3f72088b8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:36.198494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:36.199242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.199530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.199805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.201441 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:36.203111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91402187-b002-41b5-9977-6b80c5a30c42 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:36.219217 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4193/8349] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:36.223365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:36.229471 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:36.244867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fa78-3344-4aac-8b3c-f957e6708b99 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:36.255061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:36.257646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.258088 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.258470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] PATH_INFO: `/v3/projects/08b733b4f170443c8723bc99b1da0081/users/7736b34c56c64f2387bfd794cfccf8a2/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.299061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b733b4f170443c8723bc99b1da0081, user_id=7736b34c56c64f2387bfd794cfccf8a2, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:36.306042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:36.357937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4157/8350] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:36 2022] PUT /identity/v3/projects/08b733b4f170443c8723bc99b1da0081/users/7736b34c56c64f2387bfd794cfccf8a2/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:36.360960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.361372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.361822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.421564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] MFA Rules not processed for user `7736b34c56c64f2387bfd794cfccf8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:36.423107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:36.579508 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4194/8351] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:36.593598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:36.596608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:36.699766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f5632-83d3-474e-94f7-854fb4e84555 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:36.706676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:36.709041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:36.709694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:36.710306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:36.728972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:36.731006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8601e6-4df4-492f-859c-8c453dc350f5 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:36.770092 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4158/8352] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:39.302666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:39.307942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:39.480889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ccdb2-f7cb-4766-b9d4-dd4b35104b86 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:39.496364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:39.498242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:39.498529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:39.498812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] PATH_INFO: `/v3/users/ac2fbaa21804488685946a455e08ffa8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:39.500689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2fbaa21804488685946a455e08ffa8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:39.502687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:39.516697 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:39.605239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2fbaa21804488685946a455e08ffa8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:39.606281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2fbaa21804488685946a455e08ffa8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:39.618029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2fbaa21804488685946a455e08ffa8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:39.637784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2fbaa21804488685946a455e08ffa8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:39.661824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2fbaa21804488685946a455e08ffa8'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:39.689031 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4195/8353] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:39 2022] DELETE /identity/v3/users/ac2fbaa21804488685946a455e08ffa8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:39.696164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:39.696584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:39.696777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:39.754770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:39.760845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:39.888308 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4159/8354] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:39.909697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:39.911447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:40.056230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4b85-2544-40f8-ae4b-728d48f8b18c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:40.064910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:40.065980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:40.066358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:40.067622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:40.087571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:40.089562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5dc89-d991-45f3-a3da-80b0c18f34c0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:40.111177 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4196/8355] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:40.458925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:40.461558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:40.483343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476e0e4-1e78-4e82-a3b7-24de046e4216 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:40.494060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:40.495247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:40.495531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:40.495805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] PATH_INFO: `/v3/projects/c86aed30e16244d3b980f7d82265d8af` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:40.497475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86aed30e16244d3b980f7d82265d8af)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:40.499635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:40.595730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86aed30e16244d3b980f7d82265d8af', 'request_id': 'req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:40.608564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86aed30e16244d3b980f7d82265d8af', 'request_id': 'req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:40.617569 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86aed30e16244d3b980f7d82265d8af', 'request_id': 'req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:40.653225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] The token cache is being invalidate because project c86aed30e16244d3b980f7d82265d8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:40.654090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:40.656964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ae7ad2b-079e-4d3b-b400-e9c433fb7eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:40.660000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4160/8356] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:40 2022] DELETE /identity/v3/projects/c86aed30e16244d3b980f7d82265d8af => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:40.665646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:40.666142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:40.666142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:40.687609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:40.689152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:40.825195 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4197/8357] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:40.833613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:40.834130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:40.834230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:40.847498 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:40.874690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:40.878661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:40.901746 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4161/8358] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:40.906130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:40.929178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc329db-92a8-4560-9868-3afff1426ca4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:40.948549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:40.949641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:40.950066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:40.950464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:40.951877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:40.952284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:40.954071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:40.977279 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4198/8359] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:40.982096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:40.997147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181734e-097f-4312-a4e5-0c699892b1d6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:41.015500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:41.017135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.018820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.019268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.020156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:41.023158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:41.102871 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4162/8360] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:40 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:41.107428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:41.120681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e666a-04bc-4498-b5f6-c9de594623cc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:41.138660 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:41.262874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:41.263571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.263857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.264138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.264848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:41.267514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:41.303534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4199/8361] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:41 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:41.308850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:41.331146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8208a-ddf5-4ebc-ae62-c6481e644d83 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:41.345705 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:41.346636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.346986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.347326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.348433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:41.350363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:41.372650 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4163/8362] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:41.376613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:41.395591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39ba1-4765-4b32-a76a-3e4b322c3dae admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:41.402735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:41.403177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.403648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.404480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.407339 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:41.409823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82881f26-51e2-4838-8ebb-1d3fe46f9489 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:41.438655 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4200/8363] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:41.440997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:41.463308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc7e15-dad6-449a-936f-8bc910c3a7ed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:41.474858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:41.476779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.478029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.479023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] PATH_INFO: `/v3/projects/f0f3021486f74036a55dc16af9f4100d/users/f01089a99f4f43c8a2156294f215b66f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.519927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f3021486f74036a55dc16af9f4100d, user_id=f01089a99f4f43c8a2156294f215b66f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:41.525723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:41.586515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4164/8364] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:41 2022] PUT /identity/v3/projects/f0f3021486f74036a55dc16af9f4100d/users/f01089a99f4f43c8a2156294f215b66f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:41.588638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:41.588946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:41.589246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:41.643373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] MFA Rules not processed for user `f01089a99f4f43c8a2156294f215b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:41.644633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:41.817235 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4201/8365] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:41.856125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:41.859030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.065307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cebb2-183f-47fa-99a5-c1bd267826d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:42.088908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:42.089592 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.089902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.090190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.110627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:42.112108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ef98-03e4-45e9-8505-a667b1eb044f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:42.137135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4165/8366] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:42.174474 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:42.297400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.297739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.298026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.309301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f12a3-f113-4cd0-9bdc-ca73baf555d1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:42.314230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:42.315108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.315386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.315658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] PATH_INFO: `/v3/users/f01089a99f4f43c8a2156294f215b66f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.316856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01089a99f4f43c8a2156294f215b66f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:42.319097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:42.343253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:42.347785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.371489 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:42.407038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01089a99f4f43c8a2156294f215b66f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:42.407804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01089a99f4f43c8a2156294f215b66f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:42.421500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01089a99f4f43c8a2156294f215b66f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:42.441014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01089a99f4f43c8a2156294f215b66f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:42.482390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7088e9ed-798c-48d9-9b4d-4de5baf87f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01089a99f4f43c8a2156294f215b66f'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:42.509384 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4202/8367] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:42 2022] DELETE /identity/v3/users/f01089a99f4f43c8a2156294f215b66f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:42.511896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.512196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.512476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.526231 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4166/8368] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:42.530272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:42.534549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.572190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:42.575070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.579658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8f46d-e3e7-4453-b424-a5e172635e99 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:42.656690 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:42.721156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:42.721401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4203/8369] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:42.722365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:42.722477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.722658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.722945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.723652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:42.723758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.726910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:42.789015 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4167/8370] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:42 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:47:42.790078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:42.792545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:42.853050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ef24e-d6fa-4033-9c1e-f0b4a0921b65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:42.922184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dc17-4894-4c9c-82e1-6b8511a4084c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:42.928147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:42.930584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.933492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.934061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.976724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:42.977486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:42.980435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:42.980731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:42.998275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:43.032502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.041791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.061642 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4204/8371] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:43.062964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.067184 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:43.096382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.099195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.203367 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4168/8372] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:43.295400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71a836-44c0-4b78-8614-1ea51fc1f956 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.306312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:43.307258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:43.307600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:43.307897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:43.309771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.312681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.359519 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4205/8373] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:43 2022] POST /identity/v3/users => generated 296 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:43.364425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.386547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0e91-abcf-42e5-9e12-dbfa6f01d08b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.393581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:43.394138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:43.394793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:43.395089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:43.396580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.400209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.417854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.418317 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4169/8374] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:43.432288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fedb6-864d-4da1-8452-a32a3ac11723 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.448205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:43.449130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:43.449416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:43.455554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] PATH_INFO: `/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a/users/8fb3126827a34c10a42e46231d48cd5d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:43.494154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb43d0f5ef7d4633aceea86ef6eb289a, user_id=8fb3126827a34c10a42e46231d48cd5d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.504713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.564228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4206/8375] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:43 2022] PUT /identity/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a/users/8fb3126827a34c10a42e46231d48cd5d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:43.569451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.585022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594475-a1d5-4952-8ae9-ff1ddfd33331 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.759424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.767087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:43.778867 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:43.799389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:43.800083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:43.801684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:43.802003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:43.802764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.805023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.837069 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4170/8376] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:43.842262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:43.869180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb164f-e01e-4ecb-8d05-10846d513bdc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.885107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:43.889810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:43.891917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:43.892371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] PATH_INFO: `/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a/users/8fb3126827a34c10a42e46231d48cd5d/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:43.901966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb43d0f5ef7d4633aceea86ef6eb289a, user_id=8fb3126827a34c10a42e46231d48cd5d, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:43.906898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448540e3-664a-4d01-9f01-41ff7506a514 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:43.947329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f5b5c-b4ba-4a8f-993c-690dafa76878 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:43.961736 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4171/8377] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:43 2022] PUT /identity/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a/users/8fb3126827a34c10a42e46231d48cd5d/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:47:44.149059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:44.150156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:44.150301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:44.150554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] PATH_INFO: `/v3/projects/f0f3021486f74036a55dc16af9f4100d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:44.152580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f3021486f74036a55dc16af9f4100d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:44.154584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:44.203753 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:44.283926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f3021486f74036a55dc16af9f4100d', 'request_id': 'req-4b5d4d1b-6af1-4481-aa17-d8de6db50222'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:44.316562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f3021486f74036a55dc16af9f4100d', 'request_id': 'req-4b5d4d1b-6af1-4481-aa17-d8de6db50222'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:44.341921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f3021486f74036a55dc16af9f4100d', 'request_id': 'req-4b5d4d1b-6af1-4481-aa17-d8de6db50222'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:44.369263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] The token cache is being invalidate because project f0f3021486f74036a55dc16af9f4100d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:44.369563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:44.372896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4b5d4d1b-6af1-4481-aa17-d8de6db50222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:44.376726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4207/8378] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:43 2022] DELETE /identity/v3/projects/f0f3021486f74036a55dc16af9f4100d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:44.382243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:44.382528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:44.382805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:44.422512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:44.425477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:44.581906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4172/8379] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:44.590325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:44.590664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:44.590895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:44.622045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:44.623302 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:44.652857 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4208/8380] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:44.654241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:44.670344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb890-cc3e-40cd-99db-92398c23a4a4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:44.688575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:44.689373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:44.689731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:44.690082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:44.690908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:44.691424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:44.698090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:44.747880 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4173/8381] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:47:44.752840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:44.771091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922aa6-5f23-4c5d-ba0f-f037e7ce058a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:44.802942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:44.804449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:44.804736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:44.805010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:44.805930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:44.807903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:44.914666 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4209/8382] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:44 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:44.916231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:44.935075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ee0d-6ae9-4a5c-880b-024e274df519 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:45.163463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:45.167644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:45.169870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:45.170174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:45.171685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:45.174463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:45.273001 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4174/8383] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:44 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:45.276866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:45.291985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab13c-c627-4d64-84ba-830b17f363b6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:45.299222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25263-3619-4434-b523-10e285010523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:45.300133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25263-3619-4434-b523-10e285010523 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:45.300517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25263-3619-4434-b523-10e285010523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:45.300897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a25263-3619-4434-b523-10e285010523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:45.302057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a25263-3619-4434-b523-10e285010523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:45.304476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a25263-3619-4434-b523-10e285010523 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:45.326556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4210/8384] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:45.330262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:45.357220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8916d-76ed-4cd6-ace3-bfeb4c110930 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:45.372260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:45.373514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:45.374115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:45.374634 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:45.375641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:45.382689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2453-8acb-4c8b-93ad-49ca4c4c6072 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:45.408495 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4175/8385] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:45.412349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25263-3619-4434-b523-10e285010523 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:45.442455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a25263-3619-4434-b523-10e285010523 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:45.458535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:45.461185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:45.463111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:45.463494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] PATH_INFO: `/v3/projects/708bfbb8d8bb45fda488ddf8fb6b230c/users/31e3208b74d449fc8025376fc798da3d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:45.527687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=708bfbb8d8bb45fda488ddf8fb6b230c, user_id=31e3208b74d449fc8025376fc798da3d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:45.533801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:45.574433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4211/8386] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:45 2022] PUT /identity/v3/projects/708bfbb8d8bb45fda488ddf8fb6b230c/users/31e3208b74d449fc8025376fc798da3d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:47:45.586970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:45.587279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:45.587691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:45.673052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] MFA Rules not processed for user `31e3208b74d449fc8025376fc798da3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:45.674551 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:45.774466 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:45.868917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4176/8387] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:45.874215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.151227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e24650-f28b-488d-a6df-c79ecf9ec0dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.180298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.183056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.183576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.185225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.187915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.194477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.264231 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4212/8388] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:45 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:46.268187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.300320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf047e3-da6b-4cda-bb63-540dc333eedc None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.433555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.434313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.434590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.435044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.435906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.445295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.482130 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4177/8389] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:46 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:47:46.486557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.516483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db0be9-bb29-430f-95c9-77b4a14657fc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.524638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.525689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.526051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.526402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.527213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.529839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.551407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4213/8390] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:46.555985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.580230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e8b20-f054-4617-9a76-1a5cf375d563 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.598202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.605686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.606350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.606850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] PATH_INFO: `/v3/projects/785a988d11174a1bb9eccea0eb9e1004/users/f88ca3782d87414d8e13ef565d4f1888/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.652617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785a988d11174a1bb9eccea0eb9e1004, user_id=f88ca3782d87414d8e13ef565d4f1888, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.660578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.692989 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4178/8391] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:46 2022] PUT /identity/v3/projects/785a988d11174a1bb9eccea0eb9e1004/users/f88ca3782d87414d8e13ef565d4f1888/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:46.697872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.718676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63006853-d91c-4bd2-bac8-5de63c180ca7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.757307 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:46.845993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.846764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.847119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.847460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.848267 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.851458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f3c89-2025-469c-ac09-95a4d9190ef9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.889725 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4214/8392] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:46.894045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:46.910987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f8c8-fc18-49ea-80b6-c1a5f00ebf95 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:46.922810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:46.923744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.924021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.924301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] PATH_INFO: `/v3/projects/785a988d11174a1bb9eccea0eb9e1004/users/f88ca3782d87414d8e13ef565d4f1888/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:46.926961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=785a988d11174a1bb9eccea0eb9e1004, user_id=f88ca3782d87414d8e13ef565d4f1888, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:46.930126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:46.956744 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4179/8393] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:46 2022] PUT /identity/v3/projects/785a988d11174a1bb9eccea0eb9e1004/users/f88ca3782d87414d8e13ef565d4f1888/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:46.958358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:46.958652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:46.958933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:47.011691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] MFA Rules not processed for user `f88ca3782d87414d8e13ef565d4f1888`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:47.013035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:47.213898 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4215/8394] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:47.227435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:47.230732 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:47.425573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaa683-2148-434a-8434-bb620f4c0b0d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:47.433830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:47.434782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:47.440955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:47.441662 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:47.464819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:47.466577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:47.501144 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4180/8395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:47.666721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:47.692690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fa57b-b5cf-4c57-8a12-7748d53f4741 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:47.710150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:47.710944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:47.711152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:47.711437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:47.920460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:47.922016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852470e-8e81-4da0-83ad-25f98d499be0 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:47.958460 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4216/8396] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:51.398626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:51.476877 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:51.526875 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d58c7-4d94-407f-a798-aae161c8e1ed service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:51.541940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:51.542866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:51.543154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:51.543432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] PATH_INFO: `/v3/users/31e3208b74d449fc8025376fc798da3d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:51.544884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e3208b74d449fc8025376fc798da3d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:51.546880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:51.651282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e3208b74d449fc8025376fc798da3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:51.664429 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e3208b74d449fc8025376fc798da3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:51.684194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e3208b74d449fc8025376fc798da3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:51.715491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e3208b74d449fc8025376fc798da3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:51.717413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e3208b74d449fc8025376fc798da3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:51.736491 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4181/8397] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:51 2022] DELETE /identity/v3/users/31e3208b74d449fc8025376fc798da3d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:51.742737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:51.743717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:51.744364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:51.764705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:51.766390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:51.845706 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:51.926306 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4217/8398] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:51.948937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:51.950122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:52.156231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419f2a2-06bc-4663-855a-7daf0e399a55 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:52.172695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:52.173476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:52.173654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:52.173956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:52.202820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:52.204808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:52.243761 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4182/8399] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:52.794283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:52.795728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:52.817148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7074-3445-4e96-a1ab-52297629ae87 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:52.837004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:52.837925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:52.839480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:52.839923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] PATH_INFO: `/v3/projects/708bfbb8d8bb45fda488ddf8fb6b230c` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:52.841529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=708bfbb8d8bb45fda488ddf8fb6b230c)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:52.845746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:52.967590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708bfbb8d8bb45fda488ddf8fb6b230c', 'request_id': 'req-d7a83663-a497-450d-b901-4380810c8674'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:52.986457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708bfbb8d8bb45fda488ddf8fb6b230c', 'request_id': 'req-d7a83663-a497-450d-b901-4380810c8674'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:52.995680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708bfbb8d8bb45fda488ddf8fb6b230c', 'request_id': 'req-d7a83663-a497-450d-b901-4380810c8674'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.019148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] The token cache is being invalidate because project 708bfbb8d8bb45fda488ddf8fb6b230c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:53.019815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.025895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d7a83663-a497-450d-b901-4380810c8674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.033921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:53.035761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4218/8400] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:52 2022] DELETE /identity/v3/projects/708bfbb8d8bb45fda488ddf8fb6b230c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:53.048044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9f0a-39b7-41df-aad4-c833b14a63fa service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:53.224676 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:53.245655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:53.246747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:53.247425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:53.247425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] PATH_INFO: `/v3/users/f88ca3782d87414d8e13ef565d4f1888` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:53.257480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88ca3782d87414d8e13ef565d4f1888)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:53.259818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:53.375231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88ca3782d87414d8e13ef565d4f1888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.404373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88ca3782d87414d8e13ef565d4f1888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.419332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88ca3782d87414d8e13ef565d4f1888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.453509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88ca3782d87414d8e13ef565d4f1888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.454287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88ca3782d87414d8e13ef565d4f1888'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:53.475833 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4183/8401] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:47:53 2022] DELETE /identity/v3/users/f88ca3782d87414d8e13ef565d4f1888 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:47:53.839941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:53.840472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:53.841124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:53.885627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] MFA Rules not processed for user `8fb3126827a34c10a42e46231d48cd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:53.891669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.079056 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4219/8402] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:54.168485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:54.170931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.307392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:54.308933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.328602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa82a5-f323-45d8-97d1-7a546d41b016 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:54.338112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:54.339412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.339862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.340977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.358454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:54.361067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:54.383699 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4184/8403] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:54.444579 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:54.485616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62ae12-1ff9-4f43-af17-174ba39e4c72 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:54.501716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:54.504906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.505622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.506650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] PATH_INFO: `/v3/projects/785a988d11174a1bb9eccea0eb9e1004` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.508839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] RBAC: Authorizing `identity:delete_project(project_id=785a988d11174a1bb9eccea0eb9e1004)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:54.510841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:54.601210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785a988d11174a1bb9eccea0eb9e1004', 'request_id': 'req-6b3d740d-ff98-40aa-ab29-f0a53303721e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:54.614373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:54.621437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785a988d11174a1bb9eccea0eb9e1004', 'request_id': 'req-6b3d740d-ff98-40aa-ab29-f0a53303721e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:54.627432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dba43c-1e1f-40d2-a1d7-46b4400327b3 service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:54.636978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785a988d11174a1bb9eccea0eb9e1004', 'request_id': 'req-6b3d740d-ff98-40aa-ab29-f0a53303721e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:54.667839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] The token cache is being invalidate because project 785a988d11174a1bb9eccea0eb9e1004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:47:54.668137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:54.668841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b3d740d-ff98-40aa-ab29-f0a53303721e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:47:54.675583 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4220/8404] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:47:54 2022] DELETE /identity/v3/projects/785a988d11174a1bb9eccea0eb9e1004 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:47:54.679010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f572f-b260-4289-9285-811f0be9c056 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.682018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f572f-b260-4289-9285-811f0be9c056 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.683116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f572f-b260-4289-9285-811f0be9c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.730179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ee5f572f-b260-4289-9285-811f0be9c056 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:54.732023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee5f572f-b260-4289-9285-811f0be9c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.787811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:54.788833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.789119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.789393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.791893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.858765 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:54.885585 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4221/8405] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:54.894430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.894750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.894946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.918999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:54.920238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:54.929433 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4222/8406] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:54.931905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:54.933879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:54.935840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:54.950584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0113f68-ecea-4332-9194-570b9bf17940 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:54.961598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:54.962413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:54.962750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:54.963091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:54.964349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:47:54.964349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:54.966585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:54.969105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4185/8407] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:47:55.015623 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4223/8408] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:47:55.019839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:55.041177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f933a-35f9-41ec-a273-b55e56b6889e service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:55.056294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:55.058650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.058941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.059226 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.060780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:55.062818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:55.113143 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4186/8409] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:55 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:55.117214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:55.134942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d030d-4f07-4990-93f1-d4042fd7bd6f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:55.288815 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:55.311351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:55.313887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.314283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.318057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.319839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:55.322546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:55.381656 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4224/8410] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:55 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:55.383210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:55.420555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ea43-492b-4cb5-976b-e7099be2645c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:55.430342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:55.452169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.452902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.453768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.455213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:55.458957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:55.512357 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4187/8411] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:47:55.515818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:55.533749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ef37d-f950-45bb-a9d5-cc0976fafa7c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:55.549579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:55.550304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.551107 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.551394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.554158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:55.577039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db8c7e-4a58-4477-8206-9c393f8bd4f4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:55.612562 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4225/8412] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:55.620993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:55.642409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ecf7-07ac-4dd4-b420-cd91512c4592 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:55.676856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:55.676856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.678421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.680542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] PATH_INFO: `/v3/projects/e12ec8d8a7ff435b9d8f5e9e80866da0/users/a3f1931072db4e26a3cac822d1c3b4cb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.723555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12ec8d8a7ff435b9d8f5e9e80866da0, user_id=a3f1931072db4e26a3cac822d1c3b4cb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:55.727168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:55.754956 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4188/8413] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:55 2022] PUT /identity/v3/projects/e12ec8d8a7ff435b9d8f5e9e80866da0/users/a3f1931072db4e26a3cac822d1c3b4cb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:55.767393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:55.767679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:55.768027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:55.809114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] MFA Rules not processed for user `a3f1931072db4e26a3cac822d1c3b4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:55.810382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:55.941250 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4226/8414] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:55.946823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.069454 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b81b5-1897-4ebc-a900-46d58030ab4e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.087406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.088122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.088412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.088768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.089498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.093884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.196320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4189/8415] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:47:55 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:56.200442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.222378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a93a1b-654c-42ec-8cfc-fac5de4c885e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.387035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.387732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.388102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.388387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.389094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.391575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.432721 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4227/8416] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:47:56 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:47:56.436513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.457883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b98caa-fa31-4918-9226-ce8d88393b95 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.464375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.465307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.469981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.470472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.471450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.485200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.511789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4190/8417] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:56.516108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.531884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715efeb5-7133-49f9-95cc-63e7b8532630 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.538336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.539260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.539550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.539828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] PATH_INFO: `/v3/projects/7ca45c9396194d44b5944722d4f9ab3a/users/61658be5d4a24167a7289a5c6ae7764a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.561941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca45c9396194d44b5944722d4f9ab3a, user_id=61658be5d4a24167a7289a5c6ae7764a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.564944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.597228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4228/8418] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:56 2022] PUT /identity/v3/projects/7ca45c9396194d44b5944722d4f9ab3a/users/61658be5d4a24167a7289a5c6ae7764a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:56.598490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.612409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b5bd-5314-40c0-beca-e84d2f95f464 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.740143 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:56.774508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.775200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.775481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.775756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.776500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.778148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc90b-449d-4d66-a46e-bb2d0b3eb4e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.810452 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4191/8419] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:47:56.811982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:56.824279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3c53-f5c6-4979-bf0b-2450f196216d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:56.829501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:56.830453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.830745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.831431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] PATH_INFO: `/v3/projects/7ca45c9396194d44b5944722d4f9ab3a/users/61658be5d4a24167a7289a5c6ae7764a/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.834543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca45c9396194d44b5944722d4f9ab3a, user_id=61658be5d4a24167a7289a5c6ae7764a, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:56.837596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:56.853902 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4229/8420] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:47:56 2022] PUT /identity/v3/projects/7ca45c9396194d44b5944722d4f9ab3a/users/61658be5d4a24167a7289a5c6ae7764a/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:47:56.864149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:56.864471 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:56.864711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:56.909658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] MFA Rules not processed for user `61658be5d4a24167a7289a5c6ae7764a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:56.910929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:56.994025 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4192/8421] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:47:57.007794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:57.009508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:57.042873 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:47:57.145860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f2a3-2217-47b4-ae86-06e9399f79ec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:57.149926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:57.150816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:57.150946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:57.151131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:57.170967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:57.172657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b41a5e-5445-4abe-a8b5-ffaf3ae9f81e service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:57.190654 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4230/8422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:47:57.323661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:57.355308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfb4de-a0ab-478a-b7de-84e3331a88f8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:57.360949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:57.361998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:57.362136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:57.362418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:57.446314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:57.447904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:57.462335 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4193/8423] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:47:58.262771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:58.263725 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:58.264155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:58.308623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:47:58.310361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:58.501761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4231/8424] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:47:59.026865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:47:59.029024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:59.144477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c6c2a-1829-437f-a1d5-3b392bed114a service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:47:59.151486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:47:59.152946 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:47:59.153460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:47:59.153939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:47:59.172308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:47:59.198289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:47:59.199698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10583-66d3-43c1-99de-25ac762fc19b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:47:59.231663 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4194/8425] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:47:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:03.680675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:03.795952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255466c-ab4a-49d3-9283-61632b289ab3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:03.801447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:03.803478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:03.803952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:03.804464 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] PATH_INFO: `/v3/users/a3f1931072db4e26a3cac822d1c3b4cb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:03.821127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f1931072db4e26a3cac822d1c3b4cb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:03.826527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:03.950196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f1931072db4e26a3cac822d1c3b4cb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:03.952337 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f1931072db4e26a3cac822d1c3b4cb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:03.972042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f1931072db4e26a3cac822d1c3b4cb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:03.985353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f1931072db4e26a3cac822d1c3b4cb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:03.994992 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:04.037819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f1931072db4e26a3cac822d1c3b4cb'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:04.051619 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4232/8426] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:03 2022] DELETE /identity/v3/users/a3f1931072db4e26a3cac822d1c3b4cb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:04.054445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:04.054899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:04.054981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:04.091584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:04.094074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:04.104210 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:04.242852 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4195/8427] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:04.260564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:04.262894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:04.437069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7adf9-0e7c-4ec3-a83e-bf2261b3859f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:04.460870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:04.461595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:04.461901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:04.462186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:04.482644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:04.484112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:04.508427 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4233/8428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:05.435661 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:05.443599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:05.463438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdef93-d57e-4ee2-9937-cb5f8c056a95 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:05.468550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:05.469637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:05.470120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:05.470553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] PATH_INFO: `/v3/projects/e12ec8d8a7ff435b9d8f5e9e80866da0` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:05.471977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12ec8d8a7ff435b9d8f5e9e80866da0)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:05.484268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:05.586334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12ec8d8a7ff435b9d8f5e9e80866da0', 'request_id': 'req-a70e3ecc-8c80-4e7b-b317-66313cc372c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.605785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12ec8d8a7ff435b9d8f5e9e80866da0', 'request_id': 'req-a70e3ecc-8c80-4e7b-b317-66313cc372c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.627576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12ec8d8a7ff435b9d8f5e9e80866da0', 'request_id': 'req-a70e3ecc-8c80-4e7b-b317-66313cc372c1'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.653829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] The token cache is being invalidate because project e12ec8d8a7ff435b9d8f5e9e80866da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:05.655050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.656509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.662574 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4196/8429] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:05 2022] DELETE /identity/v3/projects/e12ec8d8a7ff435b9d8f5e9e80866da0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:05.666586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:05.683988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085847ca-e2af-497a-8184-092f1476edc6 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:05.815421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:05.816478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:05.817475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:05.817475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] PATH_INFO: `/v3/users/61658be5d4a24167a7289a5c6ae7764a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:05.819535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61658be5d4a24167a7289a5c6ae7764a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:05.822616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:05.930531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61658be5d4a24167a7289a5c6ae7764a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.932317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61658be5d4a24167a7289a5c6ae7764a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.972527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61658be5d4a24167a7289a5c6ae7764a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:05.993901 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61658be5d4a24167a7289a5c6ae7764a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:06.026132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-108e526f-c6ab-4641-9a65-53c08b9ce022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61658be5d4a24167a7289a5c6ae7764a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:06.037456 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4234/8430] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:05 2022] DELETE /identity/v3/users/61658be5d4a24167a7289a5c6ae7764a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:06.805937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:06.807724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:06.831399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3ecc-8c80-4e7b-b317-66313cc372c1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.022753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.027493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.027792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.028077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] PATH_INFO: `/v3/projects/7ca45c9396194d44b5944722d4f9ab3a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.033614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca45c9396194d44b5944722d4f9ab3a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.038588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.103514 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:07.133790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca45c9396194d44b5944722d4f9ab3a', 'request_id': 'req-b5a82d4d-93f2-4810-941f-8b41eb9d4440'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:07.149390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca45c9396194d44b5944722d4f9ab3a', 'request_id': 'req-b5a82d4d-93f2-4810-941f-8b41eb9d4440'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:07.160453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca45c9396194d44b5944722d4f9ab3a', 'request_id': 'req-b5a82d4d-93f2-4810-941f-8b41eb9d4440'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:07.207903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] The token cache is being invalidate because project 7ca45c9396194d44b5944722d4f9ab3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:07.210023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:07.212660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5a82d4d-93f2-4810-941f-8b41eb9d4440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:07.218753 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4197/8431] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:06 2022] DELETE /identity/v3/projects/7ca45c9396194d44b5944722d4f9ab3a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:07.220482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.220917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.221106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.231104 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:07.250782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:07.252751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:07.337833 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4235/8432] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:07.346100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.346347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.346898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.371524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:07.372765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:07.387653 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4198/8433] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:07.388787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.399889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0311c-b8f1-44a6-ba8d-52f501ee8523 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.405174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.406241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.406722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.407187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.408318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:48:07.408847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.410859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.430216 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4236/8434] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:48:07.431161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.441722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c1cd-0c8b-491e-8e7d-286ef8cba3ce None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.448031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.448788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.449304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.449643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.450432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.452816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.488015 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4199/8435] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:07.489273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.503558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f158-5580-4684-8669-225bd3fb2236 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.596019 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.597038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.597370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.597796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.598708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.601245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.635539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4237/8436] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:07.640515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.655707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676af90-8d69-4e09-876b-ef0913b76b7f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.666225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.667786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.669221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.669723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.670684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.674887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.701697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4200/8437] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:07.705655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.718489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e132ed-4dee-4e89-b8d8-eda142a20351 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.723542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.724338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.724851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.725184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.726186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.731027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc56ec-985b-463c-88b3-7a10322b9d24 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.752100 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4238/8438] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:07.757627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:07.778350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a928-4317-4602-bff7-e15541dc2f29 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:07.786682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:07.788282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.788644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.789199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] PATH_INFO: `/v3/projects/d8ccde5d84a7497992275a7f82e98498/users/0837f7d919f64551a2cd0746e7e7e7c9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.816525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ccde5d84a7497992275a7f82e98498, user_id=0837f7d919f64551a2cd0746e7e7e7c9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:07.820024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:07.838275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4201/8439] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:07 2022] PUT /identity/v3/projects/d8ccde5d84a7497992275a7f82e98498/users/0837f7d919f64551a2cd0746e7e7e7c9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:07.849152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:07.849372 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:07.849663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:07.889559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] MFA Rules not processed for user `0837f7d919f64551a2cd0746e7e7e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:07.890848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:07.971214 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:07.981726 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4239/8440] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:07.982437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.059774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917a15d-2ed5-49d3-87a5-53982928298b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.065536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.066237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.066518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.066791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.067639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.070656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.099074 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4202/8441] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:07 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:08.103482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.117947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a283-ed9f-42f5-b000-4edf2aa4408f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.196676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.197458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.197874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.198226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.199009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.201018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.228694 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4240/8442] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:08 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:48:08.229557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.241509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b51bf-2ac9-484a-9177-fe9953a44766 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.246389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.247064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.247341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.247613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.248349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.249995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.262657 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4203/8443] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:08.266450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.279270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8bdf-5431-4a4b-b94e-c4329f1d0ae4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.284603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.285493 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.286053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.286333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] PATH_INFO: `/v3/projects/067d9f440a3e4b65b57f1b530df670b2/users/659b6287dcae47edb330a1b35ffa2ba8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.302599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067d9f440a3e4b65b57f1b530df670b2, user_id=659b6287dcae47edb330a1b35ffa2ba8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.305245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.325068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4241/8444] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:08 2022] PUT /identity/v3/projects/067d9f440a3e4b65b57f1b530df670b2/users/659b6287dcae47edb330a1b35ffa2ba8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:48:08.328784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.343911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab742-6205-45f2-b0cb-55ff9cdf96e7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.389832 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:08.430193 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.431176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.431620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.432349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.433333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.435195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc24aa-60c7-4007-bba9-9c67e3e150dc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.447138 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4204/8445] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:48:08.451386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.466766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47154-197a-4440-b727-8175edabeeb4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.471810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.472715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.472983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.473257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] PATH_INFO: `/v3/projects/067d9f440a3e4b65b57f1b530df670b2/users/659b6287dcae47edb330a1b35ffa2ba8/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.475859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] RBAC: Authorizing `identity:create_grant(project_id=067d9f440a3e4b65b57f1b530df670b2, user_id=659b6287dcae47edb330a1b35ffa2ba8, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.478594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.493794 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4242/8446] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:08 2022] PUT /identity/v3/projects/067d9f440a3e4b65b57f1b530df670b2/users/659b6287dcae47edb330a1b35ffa2ba8/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:08.504191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.504649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.504940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.534587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] MFA Rules not processed for user `659b6287dcae47edb330a1b35ffa2ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:08.535791 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:08.616540 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4205/8447] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:08.624447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:08.626242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:08.701503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa29d8-2ea5-48d8-ba09-ac66b66c144f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:08.706193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:08.706943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:08.707248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:08.707568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:08.719914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:08.721122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684f33f-702c-4899-9f20-54367eb0977a service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:08.732645 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4243/8448] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:09.541881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:09.694075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6eb0f-ccea-449c-b2ba-b4b3ffa89d5c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:09.707640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:09.709757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:09.710224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:09.710651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] PATH_INFO: `/v3/users/0837f7d919f64551a2cd0746e7e7e7c9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:09.713462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0837f7d919f64551a2cd0746e7e7e7c9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:09.716911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:09.823246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0837f7d919f64551a2cd0746e7e7e7c9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:09.833606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0837f7d919f64551a2cd0746e7e7e7c9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:09.844685 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:09.858255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0837f7d919f64551a2cd0746e7e7e7c9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:09.880177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0837f7d919f64551a2cd0746e7e7e7c9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:09.881656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0837f7d919f64551a2cd0746e7e7e7c9'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:09.891634 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4206/8449] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:09 2022] DELETE /identity/v3/users/0837f7d919f64551a2cd0746e7e7e7c9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:09.894500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618227b-1151-40d0-87bb-705507511050 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:09.894952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618227b-1151-40d0-87bb-705507511050 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:09.896666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618227b-1151-40d0-87bb-705507511050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:09.923730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1618227b-1151-40d0-87bb-705507511050 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:09.927093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1618227b-1151-40d0-87bb-705507511050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:10.063404 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:10.089254 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4244/8450] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:10.097309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:10.098935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:10.255188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be323f7-3351-47f4-9c21-351e11b83581 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:10.271374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:10.272086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:10.272392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:10.272698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:10.284422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:10.286361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:10.299439 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4207/8451] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:10.897381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618227b-1151-40d0-87bb-705507511050 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:10.899067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1618227b-1151-40d0-87bb-705507511050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:10.924846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618227b-1151-40d0-87bb-705507511050 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:10.934115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:10.935050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:10.935341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:10.935612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] PATH_INFO: `/v3/projects/d8ccde5d84a7497992275a7f82e98498` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:10.937743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ccde5d84a7497992275a7f82e98498)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:10.939757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:11.012556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ccde5d84a7497992275a7f82e98498', 'request_id': 'req-acf6b19d-62de-461c-b671-115979ec0aaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.023269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ccde5d84a7497992275a7f82e98498', 'request_id': 'req-acf6b19d-62de-461c-b671-115979ec0aaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.035322 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ccde5d84a7497992275a7f82e98498', 'request_id': 'req-acf6b19d-62de-461c-b671-115979ec0aaf'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.051056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] The token cache is being invalidate because project d8ccde5d84a7497992275a7f82e98498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:11.051764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.053575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.055666 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4245/8452] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:10 2022] DELETE /identity/v3/projects/d8ccde5d84a7497992275a7f82e98498 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:11.059464 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:11.072261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc5b6d-98bf-4447-a500-8945e9ea0a7c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:11.148034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:11.149021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:11.149314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:11.149577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] PATH_INFO: `/v3/users/659b6287dcae47edb330a1b35ffa2ba8` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:11.150936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659b6287dcae47edb330a1b35ffa2ba8)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:11.152909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:11.209565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659b6287dcae47edb330a1b35ffa2ba8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.218781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659b6287dcae47edb330a1b35ffa2ba8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.229183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659b6287dcae47edb330a1b35ffa2ba8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.243323 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:11.244775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659b6287dcae47edb330a1b35ffa2ba8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.245821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b1e6eacf-c12f-4ed7-afaf-a300b137d082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659b6287dcae47edb330a1b35ffa2ba8'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.257338 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4208/8453] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:11 2022] DELETE /identity/v3/users/659b6287dcae47edb330a1b35ffa2ba8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:11.634202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:11.635988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:11.658766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b19d-62de-461c-b671-115979ec0aaf admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:11.750537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:11.752078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:11.752482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:11.752847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] PATH_INFO: `/v3/projects/067d9f440a3e4b65b57f1b530df670b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:11.754255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067d9f440a3e4b65b57f1b530df670b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:11.757320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:11.839070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067d9f440a3e4b65b57f1b530df670b2', 'request_id': 'req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.845565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067d9f440a3e4b65b57f1b530df670b2', 'request_id': 'req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.859921 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067d9f440a3e4b65b57f1b530df670b2', 'request_id': 'req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.886513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] The token cache is being invalidate because project 067d9f440a3e4b65b57f1b530df670b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:11.886787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.887702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f2ecb6c6-c1c3-44d4-87ad-ead4847ad773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:11.889916 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4246/8454] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:11 2022] DELETE /identity/v3/projects/067d9f440a3e4b65b57f1b530df670b2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:11.894584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:11.894986 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:11.895369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:11.924521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:11.925956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:12.010241 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4209/8455] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:12.012818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.013806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.013806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.044402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:12.046163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:12.057029 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4247/8456] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:12.061456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.074790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a49f3-f879-4f8e-b937-663780e6d828 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.089397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.090134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.090415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.091011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.091439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:48:12.091741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.093390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.113741 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4210/8457] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:48:12.121103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.131090 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:12.140749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56414488-4edd-4f66-8d02-2021a056e154 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.154354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.159023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.160447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.165981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.166904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.168851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.228808 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4248/8458] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:12 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:12.229133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.240724 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd878121-6684-4bc4-b841-e9a598ebd23b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.367144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.367870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.368150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.368423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.369297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.371586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.405916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4211/8459] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:12 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:12.409551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.425098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b387aa-8d42-4059-bdb1-c18c46bdaf25 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.437460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.438275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.438566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.438847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.439813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.443648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.471579 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4249/8460] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:12.475536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.490908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e128ff-a8b4-4185-89ca-520b691a3946 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.511814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.512517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.512797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.513073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.513850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.515680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def1a8f-09ad-4b63-95be-9078078e9b93 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.531091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4212/8461] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:12.531833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.549906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21300-cf60-4d19-9e5f-04eade89fb45 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.556257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.557181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.557445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.557801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] PATH_INFO: `/v3/projects/350bf01fefc0474b871a27065d3a73da/users/87091e4f807d4adbbaa743b3ca3ad5e3/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.577461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350bf01fefc0474b871a27065d3a73da, user_id=87091e4f807d4adbbaa743b3ca3ad5e3, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.580818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:12.607917 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4250/8462] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:12 2022] PUT /identity/v3/projects/350bf01fefc0474b871a27065d3a73da/users/87091e4f807d4adbbaa743b3ca3ad5e3/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:12.611547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.612219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.613014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.668567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] MFA Rules not processed for user `87091e4f807d4adbbaa743b3ca3ad5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:12.670567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:12.751859 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:12.792520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4213/8463] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:12.828907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:12.830949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:12.963192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7e064-49dc-4f32-a873-b59560f45aa4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:12.968757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:12.969516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:12.969992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:12.970271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:12.996966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:12.997705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bf423-cc5b-4250-8bef-1723ed4f5066 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:13.009437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4251/8464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:13.026362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:13.179873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ab08c-f92f-438e-a415-e2d92f392d2b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:13.188058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:13.189170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:13.189583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:13.190017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] PATH_INFO: `/v3/users/87091e4f807d4adbbaa743b3ca3ad5e3` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:13.191345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] RBAC: Authorizing `identity:delete_user(user_id=87091e4f807d4adbbaa743b3ca3ad5e3)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:13.194716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:13.244491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87091e4f807d4adbbaa743b3ca3ad5e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.251894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87091e4f807d4adbbaa743b3ca3ad5e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.261523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87091e4f807d4adbbaa743b3ca3ad5e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.275161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87091e4f807d4adbbaa743b3ca3ad5e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.275902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87091e4f807d4adbbaa743b3ca3ad5e3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.282857 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4214/8465] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:13 2022] DELETE /identity/v3/users/87091e4f807d4adbbaa743b3ca3ad5e3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:13.288052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:13.288545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:13.289467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:13.309763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:13.311226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:13.374384 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4252/8466] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:13.389205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:13.390707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:13.486077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25005ee-66cf-4caf-80a3-90dab247910e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:13.491475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:13.492455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:13.492789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:13.493135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:13.504196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:13.506447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:13.519012 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4215/8467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:13.808307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:13.810584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:13.826223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccf7bd-93ac-4963-b732-1013462cb19e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:13.834599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:13.835513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:13.835809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:13.836120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] PATH_INFO: `/v3/projects/350bf01fefc0474b871a27065d3a73da` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:13.837325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] RBAC: Authorizing `identity:delete_project(project_id=350bf01fefc0474b871a27065d3a73da)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:13.839404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:13.887645 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:13.892310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350bf01fefc0474b871a27065d3a73da', 'request_id': 'req-819af3e8-30ac-401d-b293-80185232343e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.899506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350bf01fefc0474b871a27065d3a73da', 'request_id': 'req-819af3e8-30ac-401d-b293-80185232343e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.912903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350bf01fefc0474b871a27065d3a73da', 'request_id': 'req-819af3e8-30ac-401d-b293-80185232343e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.925852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] The token cache is being invalidate because project 350bf01fefc0474b871a27065d3a73da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:13.926152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.926818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:13.928992 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4253/8468] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:13 2022] DELETE /identity/v3/projects/350bf01fefc0474b871a27065d3a73da => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:21.140192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:21.141614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:21.155922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f155-ebb9-4b74-952b-d693ca3f237d service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:21.167331 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:21.222770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:21.224311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:21.224648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:21.225480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:21.227538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:21.345650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:21.347480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:21.370257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4216/8469] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:23.922413 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:26.878018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:26.881126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:26.926093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af3e8-30ac-401d-b293-80185232343e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:26.944346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:26.945101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:26.945763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:26.945895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:26.950567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:26.974575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:26.977125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f58d7-5760-45a0-b375-b4ac1358ab7b service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:27.015473 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4254/8470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:31.150011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:31.151510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:31.283940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe26b49-c642-441a-975b-ef31080eba8b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:31.288933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:31.289869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:31.290149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:31.290422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] PATH_INFO: `/v3/users/7736b34c56c64f2387bfd794cfccf8a2` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:31.291694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7736b34c56c64f2387bfd794cfccf8a2)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:31.293658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:31.365000 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:31.377261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7736b34c56c64f2387bfd794cfccf8a2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:31.397616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7736b34c56c64f2387bfd794cfccf8a2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:31.411619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7736b34c56c64f2387bfd794cfccf8a2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:31.443441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7736b34c56c64f2387bfd794cfccf8a2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:31.444211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7736b34c56c64f2387bfd794cfccf8a2'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:31.452178 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4217/8471] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:31 2022] DELETE /identity/v3/users/7736b34c56c64f2387bfd794cfccf8a2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:31.456578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:31.457932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:31.458561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:31.501327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:31.511229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:31.648971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4255/8472] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:31.687609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:31.689187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:31.823273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd26d95-5291-460a-8f88-34cb3cc6ff83 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:31.832468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:31.834014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:31.834306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:31.834609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:31.846103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:31.847937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ce421-d8e9-404f-95b0-43e9fd390739 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:31.871419 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4218/8473] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:32.703655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:32.705140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:32.729365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc9584-4682-41bb-9f8e-274fe06d3590 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:32.743562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:32.744466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:32.744755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:32.745035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] PATH_INFO: `/v3/projects/08b733b4f170443c8723bc99b1da0081` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:32.746325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b733b4f170443c8723bc99b1da0081)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:32.748492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:32.863496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b733b4f170443c8723bc99b1da0081', 'request_id': 'req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:32.887655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b733b4f170443c8723bc99b1da0081', 'request_id': 'req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:32.904606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b733b4f170443c8723bc99b1da0081', 'request_id': 'req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:32.933161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] The token cache is being invalidate because project 08b733b4f170443c8723bc99b1da0081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:32.933448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:32.939980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f4ada1d8-4888-4764-a5f2-f156b4a3ec13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:32.950829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4256/8474] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:32 2022] DELETE /identity/v3/projects/08b733b4f170443c8723bc99b1da0081 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:32.951252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:32.951710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:32.952085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:32.986547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:32.988372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:33.142855 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4219/8475] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:48:33.155605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.155911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.156952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.204765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:33.210196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:33.239819 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4257/8476] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:33.244111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.260247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4f62-f3da-401d-91fb-03e05638755c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.267492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.268819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.268819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.269339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.272248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:48:33.273712 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.278257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.304990 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4220/8477] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:48:33.305562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.322047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c850a-472b-4f25-af3c-5810eb70e15f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.327993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.328677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.328965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.329240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.330001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.335100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.376475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4258/8478] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:33 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:48:33.378511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.398037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd372ec-183c-466d-8e35-921bf1aec4b1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.468308 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:33.487042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.487854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.489356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.490426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.491686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.494357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.523198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.523448 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4221/8479] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:33 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:33.534672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447c1dc-b94f-42fe-aeef-58ca0ad4b8fb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.539700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.540652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.540972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.541318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.542249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.544176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.562276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4259/8480] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:48:33.563486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.575357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c424-1681-45ed-bf37-c565650a05d4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.592125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.592831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.593177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.597207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.598376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.602536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35ac50-b3aa-4ad5-905a-8b12c6e07ab0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.632787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:33.644494 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4222/8481] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:33.646891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ae187-32f9-4e15-9034-70c722ae824c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:33.653601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:33.655779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.656070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.656332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] PATH_INFO: `/v3/projects/58d67c6162df45bebdca6608c97b83b5/users/ccb56c2ed29f4a7aa0fd3210d99d0005/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.677637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d67c6162df45bebdca6608c97b83b5, user_id=ccb56c2ed29f4a7aa0fd3210d99d0005, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:33.680395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:33.727455 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4260/8482] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:33 2022] PUT /identity/v3/projects/58d67c6162df45bebdca6608c97b83b5/users/ccb56c2ed29f4a7aa0fd3210d99d0005/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:33.740930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:33.748750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:33.749726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:33.843100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] MFA Rules not processed for user `ccb56c2ed29f4a7aa0fd3210d99d0005`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:33.854375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:34.195353 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4223/8483] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:34.209454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:34.213553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:34.238441 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:34.358373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d28-276c-443a-a2eb-d8146d868f9a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:34.373697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:34.375206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:34.377341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:34.377795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:34.415498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:34.420930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931ec9a-b9ba-4b53-ac72-71fcaf852d1b service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:34.487744 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4261/8484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:34.545952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:34.714848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27976-7a12-4ad7-9efe-8d7d5fa8da0b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:34.724822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:34.727522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:34.727810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:34.728108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] PATH_INFO: `/v3/users/ccb56c2ed29f4a7aa0fd3210d99d0005` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:34.731963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb56c2ed29f4a7aa0fd3210d99d0005)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:34.734646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:34.869352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb56c2ed29f4a7aa0fd3210d99d0005'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:34.882757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb56c2ed29f4a7aa0fd3210d99d0005'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:34.886335 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:34.912106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb56c2ed29f4a7aa0fd3210d99d0005'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:34.951701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb56c2ed29f4a7aa0fd3210d99d0005'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:34.955982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb56c2ed29f4a7aa0fd3210d99d0005'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:34.981147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4224/8485] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:34 2022] DELETE /identity/v3/users/ccb56c2ed29f4a7aa0fd3210d99d0005 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:34.986977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef17692-4509-4e3a-bad4-316aa7d0817e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:34.987555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef17692-4509-4e3a-bad4-316aa7d0817e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:34.987555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef17692-4509-4e3a-bad4-316aa7d0817e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:35.014871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cef17692-4509-4e3a-bad4-316aa7d0817e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:35.016781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cef17692-4509-4e3a-bad4-316aa7d0817e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:35.190659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4262/8486] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:48:35.205114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:35.207589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:35.414021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f795e-fecb-4c75-9381-e2729b242534 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:35.418386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:35.419236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:35.419519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:35.419793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:35.449512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:35.451043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:35.470924 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4225/8487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:36.029191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f434a2-55cf-41d8-a7ce-2c7cf01d1852 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:36.030989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f434a2-55cf-41d8-a7ce-2c7cf01d1852 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:36.031520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f434a2-55cf-41d8-a7ce-2c7cf01d1852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:36.087848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a7f434a2-55cf-41d8-a7ce-2c7cf01d1852 None None] MFA Rules not processed for user `49542098be914013837bfe2310608c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:36.089166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7f434a2-55cf-41d8-a7ce-2c7cf01d1852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:36.264163 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4263/8488] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:36.556428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:36.560587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:36.642544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303c39-1d9d-477d-b9cd-cb0812f87163 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:36.649185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:36.650382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:36.650851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:36.651301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] PATH_INFO: `/v3/projects/58d67c6162df45bebdca6608c97b83b5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:36.652716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d67c6162df45bebdca6608c97b83b5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:36.656358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:36.755227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d67c6162df45bebdca6608c97b83b5', 'request_id': 'req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:36.769139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d67c6162df45bebdca6608c97b83b5', 'request_id': 'req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:36.797055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d67c6162df45bebdca6608c97b83b5', 'request_id': 'req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:36.815039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] The token cache is being invalidate because project 58d67c6162df45bebdca6608c97b83b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:36.815338 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:36.822547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5b73ddf2-5a46-4d8a-a0e7-8b39b9cb77e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:36.824402 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4226/8489] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:36 2022] DELETE /identity/v3/projects/58d67c6162df45bebdca6608c97b83b5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:36.833289 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:36.833936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:36.835691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:36.870702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:36.876366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:36.955553 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:36.969096 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4264/8490] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:36.977801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:36.978383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:36.978904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.007652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:37.009044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:37.033577 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4227/8491] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:37.035252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.055393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e2258-63dc-41f4-91cb-0a49ff0976a3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.064678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.067655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.068178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.074258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.075070 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:48:37.075387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.077157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.100359 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4265/8492] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:48:37.104438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.135091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a490cc3-95c9-4c1e-bae4-1e8555b8d59e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.141030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.141960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.143291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.143744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.144612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.146797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.199505 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4228/8493] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:37 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:37.202599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.217752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab17c-1658-4cc9-8471-a27bb1c1fc8a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.345965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.352697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.353593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.354130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.355343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.366042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.433437 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4266/8494] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:37 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:37.437331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.471032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762291e-2540-4605-99f4-ed0f262676d5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.477818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.478535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.478821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.479102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.480185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.482140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.496659 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4229/8495] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:37.500932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.524514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fd848-7db9-4631-97a9-1e6ee79b93c1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.538608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.539323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.539609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.539892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.540648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.542315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38352ca-09fc-4423-8427-74ee3a7922b7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.561587 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4267/8496] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:37.566090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.588243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5ad8-ee83-4864-bd93-45ec08e559a2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:37.593433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:37.594654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.595150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.595719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] PATH_INFO: `/v3/projects/7ed354c5acd046ef905bf36496a364b2/users/d87ca59d307d4bc888b5465298c6acaa/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.614000 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:37.646698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed354c5acd046ef905bf36496a364b2, user_id=d87ca59d307d4bc888b5465298c6acaa, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:37.650376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:37.670386 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4230/8497] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:37 2022] PUT /identity/v3/projects/7ed354c5acd046ef905bf36496a364b2/users/d87ca59d307d4bc888b5465298c6acaa/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:37.681867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:37.682209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:37.682429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:37.734249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] MFA Rules not processed for user `d87ca59d307d4bc888b5465298c6acaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:37.736621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:37.871324 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4268/8498] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:37.883699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:37.885458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:38.027951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf750-38c3-4d7f-80c9-3e173598eb10 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:38.032346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:38.033018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:38.033301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:38.033576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:38.054025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:38.055484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd7e5e-dc7b-49b5-ac1e-3ac05d6673b9 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:38.075293 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4231/8499] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:47.866924 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:48.070785 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:56.569226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:56.571528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:56.748764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a085c1-a8cf-4715-8ec2-7dc493388fd0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:56.763726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:56.764629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:56.764916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:56.765205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] PATH_INFO: `/v3/users/dfda1384b5114e6187cc3af76d36f3dd` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:56.767460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfda1384b5114e6187cc3af76d36f3dd)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:56.769459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:56.888288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfda1384b5114e6187cc3af76d36f3dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:56.889014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfda1384b5114e6187cc3af76d36f3dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:56.907675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfda1384b5114e6187cc3af76d36f3dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:56.923305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfda1384b5114e6187cc3af76d36f3dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:56.945117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfda1384b5114e6187cc3af76d36f3dd'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:56.965465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4269/8500] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:48:56 2022] DELETE /identity/v3/users/dfda1384b5114e6187cc3af76d36f3dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:56.966532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:56.966969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:56.967110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:56.996553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:56.998141 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:57.137507 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4232/8501] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:57.148459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:57.150001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:57.270190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96637d6-1bf7-4e68-b484-9e3403d2a9ed admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:57.276195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:57.276195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:57.276195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:57.276195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:57.289410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:57.290919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42985b33-23f1-4277-b3ed-7002153951c9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:57.308412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4270/8502] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:48:57.616525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:57.618150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:57.652381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d0b9-e0c1-40d1-a15c-bda7a9a44478 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:57.667965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:57.669363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:57.669646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:57.670136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] PATH_INFO: `/v3/projects/49f791622d5b4931a12407389ab36fdf` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:57.671648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f791622d5b4931a12407389ab36fdf)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:57.673579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:57.793541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f791622d5b4931a12407389ab36fdf', 'request_id': 'req-2f37ae6c-6385-438f-9a4a-85207ddea103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:57.812987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f791622d5b4931a12407389ab36fdf', 'request_id': 'req-2f37ae6c-6385-438f-9a4a-85207ddea103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:57.822778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f791622d5b4931a12407389ab36fdf', 'request_id': 'req-2f37ae6c-6385-438f-9a4a-85207ddea103'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:57.837176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] The token cache is being invalidate because project 49f791622d5b4931a12407389ab36fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:48:57.837557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:57.838283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2f37ae6c-6385-438f-9a4a-85207ddea103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:48:57.839985 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4233/8503] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:48:57 2022] DELETE /identity/v3/projects/49f791622d5b4931a12407389ab36fdf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:57.845240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:57.846098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:57.846533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:57.876962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:57.879501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:57.907549 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:58.025925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.026440 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4271/8504] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:58.026921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.027203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.054829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:58.056596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:58.067362 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4234/8505] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:48:58.071525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.087112 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ccbfd-b0fb-4265-911b-8d0d09fbb17a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.095203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.095882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.096163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.096438 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.098279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:48:58.098590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.100220 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.121092 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4272/8506] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:48:58.130954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.142530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1ea8-0208-4821-8704-0dc16a75cad0 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.151895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.152505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.152784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.153060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.153834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.155727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.207987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.210273 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4235/8507] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:58.222031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e22b-f776-4390-9b44-a6385597b3a8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.330388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.331074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.331363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.331672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.332838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.335505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.367206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.375261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4273/8508] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:48:58.381058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04392-db9a-42cb-afc9-43c405ad713d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.386136 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.386824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.387106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.387386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.388128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.390978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.413613 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4236/8509] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:48:58.415072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.431076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318ca7-006a-4b7b-8632-ca2598c9e844 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.459580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.461393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.461987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.463007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.464713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.466709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c07cc-524c-4928-aa5a-55d11ce98740 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.497717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4274/8510] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:58.497924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.508277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284feaf-ae5a-44f5-b864-955969131a1c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.513642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.514671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.515017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.515366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] PATH_INFO: `/v3/projects/80c01d38555f48efb236a8cd55947ba9/users/9192f6f7b29d48e4b5ccfdd57c7ae074/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.533622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c01d38555f48efb236a8cd55947ba9, user_id=9192f6f7b29d48e4b5ccfdd57c7ae074, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.537543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.569843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4237/8511] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:58 2022] PUT /identity/v3/projects/80c01d38555f48efb236a8cd55947ba9/users/9192f6f7b29d48e4b5ccfdd57c7ae074/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:48:58.575426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.575721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.576016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.632277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] MFA Rules not processed for user `9192f6f7b29d48e4b5ccfdd57c7ae074`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:58.635152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:58.731583 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4275/8512] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:58.735826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.762377 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:58.820753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c8d42-0ed7-4194-b819-c300f06bda03 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.825892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.826584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.826870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.827149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.827866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.829914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.866948 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4238/8513] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:58.870754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:58.883713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51ff3-2fdf-405e-8135-ce147b018052 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:58.899068 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:48:58.959273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:58.960031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:58.960316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:58.960590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:58.961330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:58.963965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:58.989441 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4276/8514] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:48:58 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:48:58.993829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:59.007983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75eb9e-5463-4633-a77d-bb1a89310ec9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:59.013856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:59.014611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.014966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.015317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.016132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:59.017778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:59.033374 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4239/8515] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:59.041031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:59.058349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f1e8-29d5-4cc5-afa9-521a9fca9635 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:59.068855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:59.070158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.070449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.070730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] PATH_INFO: `/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a/users/6b6fbb349f0f4a4686c8f706a8dbdd20/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.094674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b22a0bbb4fb4114b55b49117e07ef3a, user_id=6b6fbb349f0f4a4686c8f706a8dbdd20, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:59.101021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:59.116264 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4277/8516] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:59 2022] PUT /identity/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a/users/6b6fbb349f0f4a4686c8f706a8dbdd20/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:48:59.120149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:59.131607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a8c9-ca77-4f7b-bd25-58674b31a66d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:59.202764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:59.203466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.203725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.204008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.204742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:59.206376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768384f8-4eb5-490f-9c9b-85f2a0800990 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:59.218171 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4240/8517] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:48:59.222130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:59.234015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de050143-11ba-42f2-b387-60efa9ecf080 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:59.239307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:59.241657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.241657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.241657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] PATH_INFO: `/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a/users/6b6fbb349f0f4a4686c8f706a8dbdd20/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.242916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b22a0bbb4fb4114b55b49117e07ef3a, user_id=6b6fbb349f0f4a4686c8f706a8dbdd20, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:59.245567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:59.258383 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4278/8518] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:48:59 2022] PUT /identity/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a/users/6b6fbb349f0f4a4686c8f706a8dbdd20/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:48:59.271174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.271528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.271868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.303467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] MFA Rules not processed for user `6b6fbb349f0f4a4686c8f706a8dbdd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:48:59.304776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:59.393549 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4241/8519] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:48:59.404972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:48:59.406746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:48:59.486615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd313d-cc25-4a97-9102-b0b5197ac1f1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:48:59.492258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:48:59.493306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:48:59.494276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:48:59.494734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:48:59.563953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:48:59.565403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e56fd-b25b-48b2-a09d-abf570c89cca service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:48:59.575772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4279/8520] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:48:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:00.130241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:00.132337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:00.161135 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:00.216138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d408dc-80ff-4c24-8144-f491b05a5088 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:00.221104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:00.222533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:00.223022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:00.223382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] PATH_INFO: `/v3/users/d87ca59d307d4bc888b5465298c6acaa` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:00.224655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87ca59d307d4bc888b5465298c6acaa)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:00.226918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:00.312217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87ca59d307d4bc888b5465298c6acaa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:00.325451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87ca59d307d4bc888b5465298c6acaa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:00.334951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87ca59d307d4bc888b5465298c6acaa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:00.349706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87ca59d307d4bc888b5465298c6acaa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:00.350836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87ca59d307d4bc888b5465298c6acaa'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:00.363180 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4242/8521] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:00 2022] DELETE /identity/v3/users/d87ca59d307d4bc888b5465298c6acaa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:00.363838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:00.364462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:00.364462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:00.383585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:00.384721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:00.420585 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:00.475190 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4280/8522] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:00.486981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:00.489562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:00.573733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d7e2b-7e2b-4ff8-890f-7cd2f73a5c4f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:00.577789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:00.578455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:00.578736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:00.579027 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:00.591164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:00.594773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75526b-4f72-4c11-8d4f-e2741156bdeb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:00.620144 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4243/8523] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:01.021381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.022942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:01.045132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad007c7e-6943-42f0-a1e7-ca9133e2d6d0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.062118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.063562 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.063880 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.064229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] PATH_INFO: `/v3/projects/7ed354c5acd046ef905bf36496a364b2` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.065932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed354c5acd046ef905bf36496a364b2)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.067914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.121268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed354c5acd046ef905bf36496a364b2', 'request_id': 'req-ed2dfb5b-4613-4505-a26d-0414a4a43550'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:01.128242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed354c5acd046ef905bf36496a364b2', 'request_id': 'req-ed2dfb5b-4613-4505-a26d-0414a4a43550'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:01.136917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed354c5acd046ef905bf36496a364b2', 'request_id': 'req-ed2dfb5b-4613-4505-a26d-0414a4a43550'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:01.150597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] The token cache is being invalidate because project 7ed354c5acd046ef905bf36496a364b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:01.150896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:01.151629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ed2dfb5b-4613-4505-a26d-0414a4a43550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:01.153564 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4281/8524] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:01 2022] DELETE /identity/v3/projects/7ed354c5acd046ef905bf36496a364b2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:01.158466 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.158971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.159073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.178445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:01.179690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:01.217328 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:01.251999 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4244/8525] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:01.259587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.259877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.260166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.280845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:01.282100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:01.291186 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4282/8526] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:01.295829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.306567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073c208-2190-474d-9cc3-3a28a5762110 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.311275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.311944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.312227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.312764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.313511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:49:01.313851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.316431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.329853 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4245/8527] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:49:01.336131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.346187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c41ae-7553-4734-b3b2-764b484279ab None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.352552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.353253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.353544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.353853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.354826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.356734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.387462 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4283/8528] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:01 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:01.391458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.402473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4439cb-726d-4166-96f1-e74f5c7e4dcd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.464775 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.465739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.466024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.466297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.467000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.468907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.491963 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4246/8529] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:01 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:01.496149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.507801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcdd7c-d248-4f36-9bc2-afda59e09e76 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.512935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.513608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.513922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.514199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.514929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.516552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.527872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4284/8530] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:01.531872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.543012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba34ee-555f-42e7-bd5e-c8a1fa68274c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.547861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.548534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.548814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.549086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.549904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.552310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652958c-3185-4609-b403-95e8911383b9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.566355 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4247/8531] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:01.567728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.578218 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fbbd7-2dc6-4112-8354-83d04d4bd9ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.583136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.584020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.584297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.584567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] PATH_INFO: `/v3/projects/e6205931cc6a41f990d36b703e7b7467/users/e9c6b9605c8f4c6a81352db2cefad8cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.602232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6205931cc6a41f990d36b703e7b7467, user_id=e9c6b9605c8f4c6a81352db2cefad8cd, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.605350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.619584 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4285/8532] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:01 2022] PUT /identity/v3/projects/e6205931cc6a41f990d36b703e7b7467/users/e9c6b9605c8f4c6a81352db2cefad8cd/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:01.624821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5d82-c0b2-4cd6-a21a-5eeead938a15 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.625116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5d82-c0b2-4cd6-a21a-5eeead938a15 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.625417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5d82-c0b2-4cd6-a21a-5eeead938a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.646362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-dbbb5d82-c0b2-4cd6-a21a-5eeead938a15 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:01.647511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-dbbb5d82-c0b2-4cd6-a21a-5eeead938a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:01.714936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4248/8533] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:01.725317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:01.727054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:01.779209 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:01.794102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200939f-9ce6-4b62-9843-94d4a7325740 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:01.798122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:01.798792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:01.799071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:01.799345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:01.811488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:01.813090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:01.824447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4286/8534] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:02.612783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:02.613322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:02.613322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:02.644978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] MFA Rules not processed for user `e9c6b9605c8f4c6a81352db2cefad8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:02.646116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:02.685277 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:02.739906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4249/8535] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:02.752601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:02.756065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:02.848087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739e938-71e1-476a-84a7-3d60f6472e2a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:02.852201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:02.852861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:02.853144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:02.853415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:02.864774 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:02.866546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cf13c-e6c6-4a89-aef2-2d475e6aabe2 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:02.878268 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4287/8536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:04.388948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:04.401169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be97591-eede-4b8d-9add-5ea190406708 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:04.406008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:04.406748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:04.407097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:04.407903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:04.409882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:04.484970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:04.486585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:04.500092 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4250/8537] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:12.875969 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=32 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:13.132538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:13.142468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:13.142991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:13.188596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:13.193131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:13.281811 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4288/8538] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:14.495738 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=42 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:23.274165 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=25 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:25.356756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:25.361144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:25.532441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a897-1d44-41c5-a8b5-a9546611a6fa service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:25.546324 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:25.547001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:25.547286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:25.547570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:25.571741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:25.575696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59252fb-6a34-4ef5-8826-8e53327f02dc service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:25.588970 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4251/8539] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:49:32.349422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:32.351171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:32.385712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90e1d7-d674-4c50-bf61-d52c88ec013d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:32.391758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:32.393190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:32.393653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:32.394116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] PATH_INFO: `/v3/users/9192f6f7b29d48e4b5ccfdd57c7ae074` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:32.395750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9192f6f7b29d48e4b5ccfdd57c7ae074)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:32.397946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:32.527965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9192f6f7b29d48e4b5ccfdd57c7ae074'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:32.529452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9192f6f7b29d48e4b5ccfdd57c7ae074'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:32.553224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9192f6f7b29d48e4b5ccfdd57c7ae074'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:32.564576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9192f6f7b29d48e4b5ccfdd57c7ae074'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:32.582402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9192f6f7b29d48e4b5ccfdd57c7ae074'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:32.611372 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4289/8540] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:32 2022] DELETE /identity/v3/users/9192f6f7b29d48e4b5ccfdd57c7ae074 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:32.616041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:32.616511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:32.616511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:32.635368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:32.636608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:32.705820 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4252/8541] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:32.716128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:32.718084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:32.826580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb8ad-6a70-4c92-b306-8c103adb931b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:32.831612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:32.832381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:32.832809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:32.833074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:32.856013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:32.858633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:32.895311 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4290/8542] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:33.719543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:33.721214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:33.743105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817c9cc-c37d-4638-ad92-0095c8aef26b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:33.759541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:33.760573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:33.761099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:33.761847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] PATH_INFO: `/v3/projects/80c01d38555f48efb236a8cd55947ba9` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:33.764874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c01d38555f48efb236a8cd55947ba9)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:33.769817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:33.839104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c01d38555f48efb236a8cd55947ba9', 'request_id': 'req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:33.851706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c01d38555f48efb236a8cd55947ba9', 'request_id': 'req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:33.859863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c01d38555f48efb236a8cd55947ba9', 'request_id': 'req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:33.877643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] The token cache is being invalidate because project 80c01d38555f48efb236a8cd55947ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:33.878278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:33.879105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:33.884693 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4253/8543] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:33 2022] DELETE /identity/v3/projects/80c01d38555f48efb236a8cd55947ba9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:33.885362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:33.899370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2e72-c0a7-44ec-9412-8645d6c25d8a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:33.992129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:33.993502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:33.993836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:33.994179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] PATH_INFO: `/v3/users/6b6fbb349f0f4a4686c8f706a8dbdd20` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:34.001398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6fbb349f0f4a4686c8f706a8dbdd20)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:34.004407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:34.031964 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:34.083856 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6fbb349f0f4a4686c8f706a8dbdd20'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.084541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6fbb349f0f4a4686c8f706a8dbdd20'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.093411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6fbb349f0f4a4686c8f706a8dbdd20'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.103954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6fbb349f0f4a4686c8f706a8dbdd20'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.135689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fe7319c6-5778-4ec4-9a48-54a86427ca5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6fbb349f0f4a4686c8f706a8dbdd20'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.143013 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4291/8544] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:33 2022] DELETE /identity/v3/users/6b6fbb349f0f4a4686c8f706a8dbdd20 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:49:34.515601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:34.517064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:34.543458 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09541bab-cd3c-4ff9-b930-68cbdf2ebaa5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:34.561809 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:34.664739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:34.667759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:34.668050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:34.668931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] PATH_INFO: `/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:34.670641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b22a0bbb4fb4114b55b49117e07ef3a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:34.678819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:34.784945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b22a0bbb4fb4114b55b49117e07ef3a', 'request_id': 'req-15873f64-2385-4c42-a4e0-f90a3eb7220b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.794153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b22a0bbb4fb4114b55b49117e07ef3a', 'request_id': 'req-15873f64-2385-4c42-a4e0-f90a3eb7220b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.804593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b22a0bbb4fb4114b55b49117e07ef3a', 'request_id': 'req-15873f64-2385-4c42-a4e0-f90a3eb7220b'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.821260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] The token cache is being invalidate because project 1b22a0bbb4fb4114b55b49117e07ef3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:34.821876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.822741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-15873f64-2385-4c42-a4e0-f90a3eb7220b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:34.824792 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4254/8545] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:34 2022] DELETE /identity/v3/projects/1b22a0bbb4fb4114b55b49117e07ef3a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:34.829807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:34.830822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:34.831223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:34.852923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:34.854435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:34.956805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4292/8546] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:34.964375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:34.964727 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:34.964953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:34.989406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:34.990931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:35.023078 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4255/8547] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:35.027555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.040129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc577b-cd1d-44ce-9746-9fa2d5003f89 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.047496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.048192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.048484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.048755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.050277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:49:35.050576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.052484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.070504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.076735 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4293/8548] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:49:35.084887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f76f-41ac-48b0-a395-c12b1cd18413 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.091157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.100375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.100375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.100375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.100964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.103333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.146817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.158235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600b6a4-3d82-4b3e-8721-be350b2142f3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.158951 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4256/8549] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:35 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:35.246181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.247208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.247711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.248381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.249303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.251605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.280193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4294/8550] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:35 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:35.284370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.299723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64ba86-5acb-4f79-80c5-9d15345b0aad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.307951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.308641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.308932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.309202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.309984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.311606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.325111 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4257/8551] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:35.328933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.350885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f53f8-71b7-421c-8740-16aec2f23fb6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.356741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.357876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.358666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.359446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.360546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.363373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695369e-5d05-484d-a1bc-cb0e58be7b0e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.370385 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:35.377652 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4295/8552] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:35.381472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.393237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2a69-2a6c-48b7-8da8-3352d201c6e0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.420180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.421312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.421641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.421956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] PATH_INFO: `/v3/projects/cd6453b980d545d3ae3c574ba2cc5509/users/d1338db386984f3491ef5daebfc601eb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.457359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6453b980d545d3ae3c574ba2cc5509, user_id=d1338db386984f3491ef5daebfc601eb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.461233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.511306 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4258/8553] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:35 2022] PUT /identity/v3/projects/cd6453b980d545d3ae3c574ba2cc5509/users/d1338db386984f3491ef5daebfc601eb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:35.513290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.513736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.514158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.571348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] MFA Rules not processed for user `d1338db386984f3491ef5daebfc601eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:35.572749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:35.677999 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4296/8554] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:35.682743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.776164 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:35.823942 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e36089-c0c9-47de-bef7-08f5c0cc996c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:35.835564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:35.836255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:35.836546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:35.836832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:35.837698 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:35.839635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:35.897203 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4259/8555] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:35 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:35.901367 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:35.916999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c4d55-c688-4efc-b44a-888a11003fd1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.006442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.008828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.008828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.009237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.010376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.012890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.065727 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4297/8556] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:35 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:36.071147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:36.094408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6702-23d7-437e-a61b-a6aafff96c00 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.122181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.124139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.124659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.125183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.126194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.138147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.225105 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4260/8557] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:36.229075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:36.241440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b3cb3-28e5-4062-bbb7-95e374b64d4e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.248370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.249428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.249908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.250391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.251427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.254482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3316f4-7fb9-4d23-996b-2993c9f3e7f1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.269858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4298/8558] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:36.273915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:36.287632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6dcb0-c00f-452a-99e6-6237d10c74a4 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.304642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.305553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.305877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.306152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] PATH_INFO: `/v3/projects/17c6fd21b93c49e8ac27f99a58b41cfb/users/17522350ecf4429aa9404074bb196d85/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.326762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c6fd21b93c49e8ac27f99a58b41cfb, user_id=17522350ecf4429aa9404074bb196d85, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.329574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.360598 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4261/8559] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:36 2022] PUT /identity/v3/projects/17c6fd21b93c49e8ac27f99a58b41cfb/users/17522350ecf4429aa9404074bb196d85/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:49:36.471686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.472073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.472954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.527137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] MFA Rules not processed for user `17522350ecf4429aa9404074bb196d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:36.529536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:36.655254 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:36.670819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:36.677257 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4299/8560] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:36.746284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52847f4d-c313-417e-a632-1a5716e48f2c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.751510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.753326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.754096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.754566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.755915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.758326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.801936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4262/8561] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:36 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:36.803300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:36.830727 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfec66-3792-4b65-9ff8-2056accddb25 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:36.913494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:36.914605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:36.915084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:36.915525 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:36.916447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:36.918597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:36.987127 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4300/8562] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:36 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:36.990984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:37.003689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fcbb3-2030-43b0-ae48-14a7b0edc2d6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:37.008683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:37.009764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.010294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.010764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.018624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:37.021009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:37.036501 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4263/8563] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:37.040789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:37.053189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52260f5-42fe-4d17-a045-809226d08b5d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:37.060681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:37.061821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.062340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.062931 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] PATH_INFO: `/v3/projects/dbb504a584cd4ecfabdfa80c5f663653/users/907097073eca46dbb7c6362f07cf50c7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.083811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb504a584cd4ecfabdfa80c5f663653, user_id=907097073eca46dbb7c6362f07cf50c7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:37.087047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:37.115159 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4301/8564] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:37 2022] PUT /identity/v3/projects/dbb504a584cd4ecfabdfa80c5f663653/users/907097073eca46dbb7c6362f07cf50c7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:37.116687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:37.137529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029231b-c50c-4ccb-8929-0475040e4712 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:37.260375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:37.261552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.262094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.262599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.264625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:37.267252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734689-9f40-42a9-bc6a-18aef36d9a64 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:37.274687 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:37.285536 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4264/8565] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:49:37.286064 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:37.298057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be304-f771-431c-be0a-545e7a8f59bd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:37.305160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:37.306018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.306303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.306576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] PATH_INFO: `/v3/projects/dbb504a584cd4ecfabdfa80c5f663653/users/907097073eca46dbb7c6362f07cf50c7/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.308718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb504a584cd4ecfabdfa80c5f663653, user_id=907097073eca46dbb7c6362f07cf50c7, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:37.311572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:37.368228 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4302/8566] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:37 2022] PUT /identity/v3/projects/dbb504a584cd4ecfabdfa80c5f663653/users/907097073eca46dbb7c6362f07cf50c7/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:49:37.379059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.379342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.379622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.429051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] MFA Rules not processed for user `907097073eca46dbb7c6362f07cf50c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:37.430312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:37.569070 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4265/8567] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:37.581848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:37.585073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:37.705281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8daa74-d92a-4c4c-b28c-f6f6c23cf03d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:37.714914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:37.715595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:37.715879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:37.716216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:37.767784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:37.770558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:37.805536 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4303/8568] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:38.415180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:38.416670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:38.555714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689501-4b86-4e66-a4f3-e43327bb526b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:38.600129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:38.602023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:38.602746 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:38.604975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:38.614258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:38.657331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:38.662859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6840-557c-4632-9899-d1304a10b6f4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:38.695775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4266/8569] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:38.889808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:38.915884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f019f2-1293-440f-a775-8c2d5cfd95d1 service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:38.925127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:38.925883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:38.926131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:38.926553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:39.039775 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:39.077376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:39.078892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:39.155249 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4304/8570] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:43.632041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:43.633068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:43.633984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:43.672021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] MFA Rules not processed for user `49542098be914013837bfe2310608c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:43.673574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:43.759852 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4267/8571] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:48.490907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:48.492905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:48.535766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88a98c-4797-446f-bd3d-cf6af3140dfe service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:48.549909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:48.550848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:48.551290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:48.551720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:48.649492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:48.652689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199906a-dae7-47ed-89a1-fa971ea9e818 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:48.686580 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4305/8572] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:53.350215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:53.391383 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:53.438928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7c5d0-df13-4aaf-bab9-57054da060a1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:53.448150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:53.449047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:53.449330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:53.449612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] PATH_INFO: `/v3/users/d1338db386984f3491ef5daebfc601eb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:53.451917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1338db386984f3491ef5daebfc601eb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:53.452802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:53.532898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1338db386984f3491ef5daebfc601eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:53.545583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1338db386984f3491ef5daebfc601eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:53.554605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1338db386984f3491ef5daebfc601eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:53.568288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1338db386984f3491ef5daebfc601eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:53.569238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1338db386984f3491ef5daebfc601eb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:53.575502 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4268/8573] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:53 2022] DELETE /identity/v3/users/d1338db386984f3491ef5daebfc601eb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:53.579716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:53.581427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:53.581427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:53.599365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:53.600693 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:53.663178 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4306/8574] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:53.674788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:53.678764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:53.772959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a285-4b51-428c-b986-99a8e68fc506 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:53.777538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:53.778418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:53.778709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:53.778985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:53.792253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:53.793767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:53.805219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4269/8575] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:54.094042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:54.096264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:54.120342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62688579-c82d-4b88-abd1-b10a15daa6d7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:54.134061 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:54.134953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:54.135236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:54.135513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] PATH_INFO: `/v3/projects/cd6453b980d545d3ae3c574ba2cc5509` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:54.136760 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6453b980d545d3ae3c574ba2cc5509)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:54.138718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:54.188044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6453b980d545d3ae3c574ba2cc5509', 'request_id': 'req-641b883e-5b7e-45d0-984e-ea104bde71ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.194180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6453b980d545d3ae3c574ba2cc5509', 'request_id': 'req-641b883e-5b7e-45d0-984e-ea104bde71ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.201881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6453b980d545d3ae3c574ba2cc5509', 'request_id': 'req-641b883e-5b7e-45d0-984e-ea104bde71ef'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.213833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] The token cache is being invalidate because project cd6453b980d545d3ae3c574ba2cc5509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:54.214124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.214769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.216329 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4307/8576] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:54 2022] DELETE /identity/v3/projects/cd6453b980d545d3ae3c574ba2cc5509 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:54.220379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:54.231153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6bddd-8a08-4934-834d-2417500d491b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:54.282077 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:54.340978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:54.342011 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:54.342188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:54.342434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] PATH_INFO: `/v3/users/17522350ecf4429aa9404074bb196d85` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:54.343628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17522350ecf4429aa9404074bb196d85)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:54.346406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:54.401968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17522350ecf4429aa9404074bb196d85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.411527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17522350ecf4429aa9404074bb196d85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.418552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17522350ecf4429aa9404074bb196d85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.431903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17522350ecf4429aa9404074bb196d85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.432628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17522350ecf4429aa9404074bb196d85'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.438872 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4270/8577] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:54 2022] DELETE /identity/v3/users/17522350ecf4429aa9404074bb196d85 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:54.735211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:54.736737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:54.761305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b883e-5b7e-45d0-984e-ea104bde71ef admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:54.784986 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:54.840750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:54.841652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:54.841963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:54.842235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] PATH_INFO: `/v3/projects/17c6fd21b93c49e8ac27f99a58b41cfb` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:54.843415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c6fd21b93c49e8ac27f99a58b41cfb)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:54.845370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:54.902340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c6fd21b93c49e8ac27f99a58b41cfb', 'request_id': 'req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.909941 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c6fd21b93c49e8ac27f99a58b41cfb', 'request_id': 'req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.918323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c6fd21b93c49e8ac27f99a58b41cfb', 'request_id': 'req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.930779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] The token cache is being invalidate because project 17c6fd21b93c49e8ac27f99a58b41cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:54.931069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.931729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:54.933616 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4308/8578] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:54 2022] DELETE /identity/v3/projects/17c6fd21b93c49e8ac27f99a58b41cfb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:54.937333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:54.938818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:54.952610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca6c6-6b05-4e7e-82a7-d7ac1e461d33 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:55.024614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:55.026076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:55.026697 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:55.027150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] PATH_INFO: `/v3/users/907097073eca46dbb7c6362f07cf50c7` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:55.028785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907097073eca46dbb7c6362f07cf50c7)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:55.030888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:55.094877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907097073eca46dbb7c6362f07cf50c7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.103811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907097073eca46dbb7c6362f07cf50c7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.110559 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:55.115525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907097073eca46dbb7c6362f07cf50c7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.133275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907097073eca46dbb7c6362f07cf50c7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.134277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7b452996-d218-42e3-9865-9d8d2edf5398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907097073eca46dbb7c6362f07cf50c7'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.141710 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4271/8579] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:49:54 2022] DELETE /identity/v3/users/907097073eca46dbb7c6362f07cf50c7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:55.688315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:55.690191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:55.722855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2f1d-eee2-4e29-9120-3f9a64a4fd2e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:55.785646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:55.786541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:55.786818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:55.787089 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] PATH_INFO: `/v3/projects/dbb504a584cd4ecfabdfa80c5f663653` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:55.788533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb504a584cd4ecfabdfa80c5f663653)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:55.790428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:55.845380 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:55.849366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb504a584cd4ecfabdfa80c5f663653', 'request_id': 'req-7191622f-e000-4ac2-9449-ddbcc46f63c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.857212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb504a584cd4ecfabdfa80c5f663653', 'request_id': 'req-7191622f-e000-4ac2-9449-ddbcc46f63c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.867359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb504a584cd4ecfabdfa80c5f663653', 'request_id': 'req-7191622f-e000-4ac2-9449-ddbcc46f63c3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.881897 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] The token cache is being invalidate because project dbb504a584cd4ecfabdfa80c5f663653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:49:55.882305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.883110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7191622f-e000-4ac2-9449-ddbcc46f63c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:49:55.884772 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4309/8580] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:49:55 2022] DELETE /identity/v3/projects/dbb504a584cd4ecfabdfa80c5f663653 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:49:55.890991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:55.891491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:55.891580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:55.913070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:55.914796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:56.000437 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4272/8581] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:56.009024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.009316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.009595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.028866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:56.030108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:56.038789 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4310/8582] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:56.043072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.053163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bdea6-5ffc-48b0-aa68-984b3d4918a4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.058444 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.059341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.059687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.060028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.060833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:49:56.061358 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.063282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.075539 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4273/8583] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:49:56.079702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.089849 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040948a-ef86-4125-adf1-0aadd6be2f96 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.094605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.095253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.096246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.096531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.097229 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.099263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.131276 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4311/8584] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:56.135513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.146777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95e57b-b4be-44ab-bcac-3afa661e7d1c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.206045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.206801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.207090 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.207368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.208067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.210080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.237789 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4274/8585] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/users => generated 304 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:49:56.239256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.250126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6b045-e8d6-48fe-a98a-e3b1ce057bf4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.255534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.256274 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.256874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.257253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.258130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.259806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.274850 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4312/8586] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:56.276024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.287960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc09991-247c-40cb-b808-4ccb249363b3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.292695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.293366 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.294282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.294577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.295314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.297399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb712a-14f8-4d57-a1e4-525ec24e87a7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.313500 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4275/8587] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:56.315805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.328280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287472-8dbf-426b-a76e-ea431d34f7c4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.334452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.335336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.335634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.335889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] PATH_INFO: `/v3/projects/7698fae8add94cdca1211043a314108d/users/05c42190afd54ff38e9bccbc8e511bf9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.351365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7698fae8add94cdca1211043a314108d, user_id=05c42190afd54ff38e9bccbc8e511bf9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.354026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.369211 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4313/8588] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:56 2022] PUT /identity/v3/projects/7698fae8add94cdca1211043a314108d/users/05c42190afd54ff38e9bccbc8e511bf9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:56.381313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.381608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.381918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.426632 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] MFA Rules not processed for user `05c42190afd54ff38e9bccbc8e511bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:56.427859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:56.462279 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:56.509210 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4276/8589] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:49:56.519694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.583099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46938-e2c3-4313-9ac7-6dbba80821d0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.587756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.588411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.588689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.588961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.589648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.591560 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.619954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4314/8590] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/projects => generated 407 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:56.621455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.632572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b08b8-1edf-40dd-a3a4-f55d5b886c83 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.690356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.691049 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.691327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.691595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.692297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.694273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.727794 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4277/8591] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:49:56.732249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.744024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957ee2-d83d-4e93-bbd6-025626db1505 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.749002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.749821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.750197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.750568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.751394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.753653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.765774 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4315/8592] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:49:56.772383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.788343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5233a3-f92a-43df-947c-0146629cf7c7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.794376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.795284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.795561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.795830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] PATH_INFO: `/v3/projects/1acc8c799760456e83fcbf972a1714ed/users/8bea1ba84c3b4695af9eca0664890907/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.813755 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acc8c799760456e83fcbf972a1714ed, user_id=8bea1ba84c3b4695af9eca0664890907, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.817685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.834110 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4278/8593] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:56 2022] PUT /identity/v3/projects/1acc8c799760456e83fcbf972a1714ed/users/8bea1ba84c3b4695af9eca0664890907/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:56.838205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.848850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf9e18-352f-47a5-97ff-32c66742431b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.894255 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:56.910879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.911552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.911834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.912108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.912847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.914478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981bd9-cd50-45a6-bdaf-4a5e8d037483 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.925428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4316/8594] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:49:56.929514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:56.940901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2791f2-a43f-4cda-9ded-3fcf0e67f0a0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:56.945749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:56.946644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.946924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.947200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] PATH_INFO: `/v3/projects/1acc8c799760456e83fcbf972a1714ed/users/8bea1ba84c3b4695af9eca0664890907/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:56.950740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acc8c799760456e83fcbf972a1714ed, user_id=8bea1ba84c3b4695af9eca0664890907, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:56.953443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:56.968893 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4279/8595] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:49:56 2022] PUT /identity/v3/projects/1acc8c799760456e83fcbf972a1714ed/users/8bea1ba84c3b4695af9eca0664890907/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:49:56.981786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:56.982164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:56.982576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:57.014150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] MFA Rules not processed for user `8bea1ba84c3b4695af9eca0664890907`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:49:57.015568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:57.151385 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4317/8596] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:49:57.159470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:57.161223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:57.235148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d6-006f-41bd-bd92-a7b4514c34f7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:57.240267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:57.240609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:57.240920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:57.241247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:57.252794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:57.254663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:57.282225 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4280/8597] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:57.469341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:57.484593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6134b-daf1-44cd-94cb-bde21bc97eba None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:57.488873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:57.489777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:57.490209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:57.490634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:57.581088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:57.594101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:57.623337 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4318/8598] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:49:58.153704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:49:58.155520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:58.257118 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:49:58.407110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8411-2b5e-43d6-a0ef-36dd60c6cfbd service cinder] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:49:58.420639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:49:58.420898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:49:58.421386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:49:58.423139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:49:58.431879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:49:58.477738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:49:58.482294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e57d8-4054-4d5c-9b0d-cef16d9c3b79 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:49:58.505365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4281/8599] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:49:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:07.396169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:07.489694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dd765-b783-443f-b188-393696f9ec3e service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:07.495834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:07.497494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:07.498039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:07.498542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] PATH_INFO: `/v3/users/05c42190afd54ff38e9bccbc8e511bf9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:07.500305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c42190afd54ff38e9bccbc8e511bf9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:07.503606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:07.511847 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:07.577899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c42190afd54ff38e9bccbc8e511bf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:07.579182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c42190afd54ff38e9bccbc8e511bf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:07.593830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c42190afd54ff38e9bccbc8e511bf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:07.604824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c42190afd54ff38e9bccbc8e511bf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:07.622469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c42190afd54ff38e9bccbc8e511bf9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:07.633458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4319/8600] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:50:07 2022] DELETE /identity/v3/users/05c42190afd54ff38e9bccbc8e511bf9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:07.637802 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:07.638376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:07.638376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:07.657881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:07.659125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:07.732189 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4282/8601] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:07.740801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:07.742705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:07.828995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f558d9-e4c5-45c2-b9fe-0904a3c308b0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:07.833917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:07.834678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:07.835003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:07.835348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:07.846261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:07.847971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:07.859829 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4320/8602] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:08.219682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:08.221798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:08.238702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49541b87-59fd-4405-a9cc-f1b0d35e61e5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:08.259890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:08.260914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:08.261068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:08.261349 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] PATH_INFO: `/v3/projects/7698fae8add94cdca1211043a314108d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:08.262624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7698fae8add94cdca1211043a314108d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:08.264577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:08.354123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7698fae8add94cdca1211043a314108d', 'request_id': 'req-ca91fb96-d1e9-47bb-9160-957d3c717339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.366428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7698fae8add94cdca1211043a314108d', 'request_id': 'req-ca91fb96-d1e9-47bb-9160-957d3c717339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.372889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7698fae8add94cdca1211043a314108d', 'request_id': 'req-ca91fb96-d1e9-47bb-9160-957d3c717339'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.388347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] The token cache is being invalidate because project 7698fae8add94cdca1211043a314108d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:50:08.388681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.389453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.391339 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4283/8603] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:50:08 2022] DELETE /identity/v3/projects/7698fae8add94cdca1211043a314108d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:08.396020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:08.408655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164a53-7290-4076-be59-c0b049a8f772 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:08.478626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:08.479746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:08.480125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:08.481095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] PATH_INFO: `/v3/users/8bea1ba84c3b4695af9eca0664890907` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:08.483885 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bea1ba84c3b4695af9eca0664890907)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:08.486247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:08.549601 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:08.582001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bea1ba84c3b4695af9eca0664890907'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.583424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bea1ba84c3b4695af9eca0664890907'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.604058 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bea1ba84c3b4695af9eca0664890907'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.619751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bea1ba84c3b4695af9eca0664890907'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.638451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-23eb088a-aff5-4464-bf18-063ff57075c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bea1ba84c3b4695af9eca0664890907'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:08.649556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4321/8604] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:50:08 2022] DELETE /identity/v3/users/8bea1ba84c3b4695af9eca0664890907 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:09.090798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.093127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:09.127184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fb96-d1e9-47bb-9160-957d3c717339 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.221581 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:09.276968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.277989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.278525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.278812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] PATH_INFO: `/v3/projects/1acc8c799760456e83fcbf972a1714ed` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.280069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1acc8c799760456e83fcbf972a1714ed)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.282033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.355882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1acc8c799760456e83fcbf972a1714ed', 'request_id': 'req-10374f0b-06b5-47a8-a86c-bbb8705e1927'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:09.365630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1acc8c799760456e83fcbf972a1714ed', 'request_id': 'req-10374f0b-06b5-47a8-a86c-bbb8705e1927'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:09.373251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1acc8c799760456e83fcbf972a1714ed', 'request_id': 'req-10374f0b-06b5-47a8-a86c-bbb8705e1927'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:09.408486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] The token cache is being invalidate because project 1acc8c799760456e83fcbf972a1714ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:50:09.408912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:09.409817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-10374f0b-06b5-47a8-a86c-bbb8705e1927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:09.415938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4284/8605] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:50:09 2022] DELETE /identity/v3/projects/1acc8c799760456e83fcbf972a1714ed => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:09.418037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.418545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.418545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.455652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:09.457159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:09.554234 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4322/8606] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:09.561993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.562293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.562575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.596039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:09.597500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:09.607461 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4285/8607] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:09.611655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.624794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5b67d-90d7-4db9-9478-063bb556f543 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.634627 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.635448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.635836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.637985 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.638983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:50:09.639468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.641805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.659565 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4323/8608] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:50:09.663866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.675185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4263727-2e67-4618-b4e2-5c677dc78677 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.681023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.681978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.682515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.683021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.684130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.686495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.724564 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4286/8609] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:50:09 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:50:09.725690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.745965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d0c-2b73-4aae-8eb1-fa135a21d919 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.824488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60419370-e961-4653-9983-431c52591d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.825306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419370-e961-4653-9983-431c52591d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.825709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419370-e961-4653-9983-431c52591d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.826239 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419370-e961-4653-9983-431c52591d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.827101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60419370-e961-4653-9983-431c52591d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.829133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60419370-e961-4653-9983-431c52591d2b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.861060 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4324/8610] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:50:09 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:50:09.862617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.878417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99d738-7f91-426d-9716-2af0038214bd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.884301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.885420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.885853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.886256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.887451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.889176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.905722 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4287/8611] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:50:09.909329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60419370-e961-4653-9983-431c52591d2b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.921506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60419370-e961-4653-9983-431c52591d2b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.926734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.927583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.927871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.928150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.928887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:09.930570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9fce-b6e3-4d13-b072-bf16846892a7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:09.958721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:09.966461 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4325/8612] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:50:09.970695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339703de-e8f7-428b-9054-eb3cbd18c5ad admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:09.975813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:09.977004 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:09.977398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:09.977961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] PATH_INFO: `/v3/projects/77f9746b43e7453ab10920efc8a218da/users/4dbd4e0059b4436d9321a3a931888815/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:09.999542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f9746b43e7453ab10920efc8a218da, user_id=4dbd4e0059b4436d9321a3a931888815, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:10.003101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:10.024691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4288/8613] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:50:09 2022] PUT /identity/v3/projects/77f9746b43e7453ab10920efc8a218da/users/4dbd4e0059b4436d9321a3a931888815/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:10.029468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:10.029753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:10.030018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:10.054638 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:10.078223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] MFA Rules not processed for user `4dbd4e0059b4436d9321a3a931888815`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:10.080277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:10.185131 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4326/8614] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:10.200811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:10.202631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:10.319284 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc2550-5f54-48c0-a3cc-6f70acf67231 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:10.325652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:10.326776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:10.327402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:10.328262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:10.336877 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:10.344085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:10.347726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325cdcd-ba11-45aa-b2aa-43f461df97e8 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:10.379021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4289/8615] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:10.405275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:10.498378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3a32-12fb-4092-bdc0-3eaf394b3e78 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:10.505981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:10.507451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:10.508069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:10.508524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] PATH_INFO: `/v3/users/4dbd4e0059b4436d9321a3a931888815` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:10.511008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbd4e0059b4436d9321a3a931888815)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:10.514311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:10.601133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbd4e0059b4436d9321a3a931888815'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:10.602048 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbd4e0059b4436d9321a3a931888815'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:10.612968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbd4e0059b4436d9321a3a931888815'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:10.621401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbd4e0059b4436d9321a3a931888815'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:10.637577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbd4e0059b4436d9321a3a931888815'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:10.652490 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4327/8616] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:50:10 2022] DELETE /identity/v3/users/4dbd4e0059b4436d9321a3a931888815 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:10.656922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:10.657154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:10.657410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:10.687926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:10.689445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:10.766149 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4290/8617] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:50:10.777205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:10.778646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:10.823852 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:10.882573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058032-3fa3-4c1b-b090-7f5e4ef65f6c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:10.888662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:10.888662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:10.888662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:10.888662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:10.901475 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:10.904149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09f5b-aadf-4de6-a419-5aae1f083f1c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:10.917293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4328/8618] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:50:11.309041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.311216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:11.337238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d57fd1-c12f-4fd1-8b5b-c9a0ffe2e171 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.349066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.350261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.350759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.351271 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] PATH_INFO: `/v3/projects/77f9746b43e7453ab10920efc8a218da` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.353539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f9746b43e7453ab10920efc8a218da)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.368883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.429910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f9746b43e7453ab10920efc8a218da', 'request_id': 'req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:11.437966 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f9746b43e7453ab10920efc8a218da', 'request_id': 'req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:11.445132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f9746b43e7453ab10920efc8a218da', 'request_id': 'req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:11.463995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] The token cache is being invalidate because project 77f9746b43e7453ab10920efc8a218da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:50:11.464573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:11.465486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-ac95813e-c5c9-483e-ad1b-b6bbf11ca06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:11.468046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4291/8619] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:50:11 2022] DELETE /identity/v3/projects/77f9746b43e7453ab10920efc8a218da => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:50:11.477224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.477991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.478481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.501866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:11.503215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:11.603944 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4329/8620] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:11.611964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.612152 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.612422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.638217 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:11.639687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:11.649573 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4292/8621] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:11.654009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.665877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65dad-4cff-4ba4-bfdf-e50b583cd45f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.678947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.679741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.680096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.680448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.681374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:50:11.681805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.683676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.701739 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4330/8622] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:50:11.705113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.719899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4735ce3-931b-44a4-bdfe-a77aaa9c6d10 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.729448 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.730192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.730874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.731166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.731895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.734038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.773896 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4293/8623] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:50:11 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:50:11.778129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.801773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676ab35-46f5-4fc1-a908-5f314a54d916 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.876748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.878193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.879294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.879832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.881071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.887188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.913740 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4331/8624] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:50:11 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:50:11.915322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.928743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d345-e639-4cfc-917a-80c5c84b87c0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.934423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.936200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.936492 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.936771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.940244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.941985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.957233 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4294/8625] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:50:11.958712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:11.972287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781209b-02ae-4a43-b9b6-8dd101eeed5e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:11.978297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:11.978823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:11.979111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:11.979395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:11.980103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:11.982003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dd23c-5852-4c8a-9c11-b8647e91657c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:11.997720 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4332/8626] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:50:11.999171 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.011345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbe776-8cf3-4191-a09d-cc67a26a5a73 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.017192 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.018155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.018434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.018707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] PATH_INFO: `/v3/projects/9cd3d18dd66e4321b11cf7b5fe9a3400/users/ecbfd92ba65f40758afcaf692c8aa33d/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.039838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd3d18dd66e4321b11cf7b5fe9a3400, user_id=ecbfd92ba65f40758afcaf692c8aa33d, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.042874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.061478 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4295/8627] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:50:11 2022] PUT /identity/v3/projects/9cd3d18dd66e4321b11cf7b5fe9a3400/users/ecbfd92ba65f40758afcaf692c8aa33d/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:50:12.072930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.073351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.073726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.104384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] MFA Rules not processed for user `ecbfd92ba65f40758afcaf692c8aa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:12.105913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:12.129846 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:12.207366 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4333/8628] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:12.212270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.233065 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:12.290110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d8205-6301-4ba1-a76e-8cfce1235385 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.295848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.296790 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.297280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.297558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.298371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.300816 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.331551 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4296/8629] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:50:12 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:50:12.335979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.348865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca7741-c7fc-4e59-8916-1e808fad406d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.423017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.424283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.424569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.424917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.425626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.427603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.454814 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4334/8630] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:50:12 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:50:12.460983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.479493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfede4-3c92-4f16-a348-578e5691ab4b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.489869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.490827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.491121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.491409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.492369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.494111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.512147 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4297/8631] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:50:12.513130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.527886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782fd66-acb9-48e6-b765-398b7ad35b94 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.533879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.534997 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.535279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.535573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] PATH_INFO: `/v3/projects/bc08658a31624318825a55992df8ff12/users/4a16eebe673c4b27a4468aea1a4db43e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.559306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08658a31624318825a55992df8ff12, user_id=4a16eebe673c4b27a4468aea1a4db43e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.562655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.581083 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4335/8632] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:50:12 2022] PUT /identity/v3/projects/bc08658a31624318825a55992df8ff12/users/4a16eebe673c4b27a4468aea1a4db43e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:50:12.585142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.599767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b81ffe-95e5-4e85-a7bb-dc2a8787d2d7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.670242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.670944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.671238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.671566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.672560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.674483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fef4c8-d159-4166-9e6e-1d62ec2ea087 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.691068 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4298/8633] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:50:12.695496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.708567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ffb07-d030-41c9-a487-bb96d55c65dc admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.714413 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.715445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.715736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.716015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] PATH_INFO: `/v3/projects/bc08658a31624318825a55992df8ff12/users/4a16eebe673c4b27a4468aea1a4db43e/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.718060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08658a31624318825a55992df8ff12, user_id=4a16eebe673c4b27a4468aea1a4db43e, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:12.721092 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:12.733762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4336/8634] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:50:12 2022] PUT /identity/v3/projects/bc08658a31624318825a55992df8ff12/users/4a16eebe673c4b27a4468aea1a4db43e/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:12.744558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de72d-b2a8-45db-978a-7c1d6530b23f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.744843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de72d-b2a8-45db-978a-7c1d6530b23f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.745120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957de72d-b2a8-45db-978a-7c1d6530b23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.777110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-957de72d-b2a8-45db-978a-7c1d6530b23f None None] MFA Rules not processed for user `4a16eebe673c4b27a4468aea1a4db43e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:12.778833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-957de72d-b2a8-45db-978a-7c1d6530b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:12.865946 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4299/8635] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:12.881509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:12.883597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:12.972879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546d89-e139-4ab2-bb77-b4339d2c31e7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:12.978721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:12.979737 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:12.980093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:12.980707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:12.986999 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:13.045949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:13.047637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:13.057863 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4337/8636] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:13.227428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:13.227720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:13.228222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:13.249063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] MFA Rules not processed for user `e9c6b9605c8f4c6a81352db2cefad8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:13.250348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:13.256788 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:13.328917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4300/8637] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:50:16.213613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:16.215099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:16.300894 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3dbc8-0ba2-490e-8f7e-be32613704d1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:16.305662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:16.306740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:16.306740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:16.306932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:16.308669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:16.323389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:16.325845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f853b-20f1-4f11-b6e3-c4abba207cfa service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:16.343412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4338/8638] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:17.188533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:17.191995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:17.211841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56410ebe-be2c-4265-9f30-9c56237a79b6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:17.216059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:17.216976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:17.217427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:17.217900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:17.231881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:17.233700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:17.257883 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4301/8639] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:21.391712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce0eb-ef04-4e8f-99ba-ff6230a99768 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:21.392557 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce0eb-ef04-4e8f-99ba-ff6230a99768 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:21.393091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce0eb-ef04-4e8f-99ba-ff6230a99768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:21.416762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-ac1ce0eb-ef04-4e8f-99ba-ff6230a99768 None None] MFA Rules not processed for user `ecbfd92ba65f40758afcaf692c8aa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:21.419078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ac1ce0eb-ef04-4e8f-99ba-ff6230a99768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:21.431043 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4339/8640] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:25.049701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:25.070763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95f3d3-366d-49ef-b7e8-1a4a86c95477 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:25.080161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:25.080821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:25.081101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:25.081393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:25.083599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:25.106276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:25.107893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:25.123077 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4302/8641] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:50:31.409221 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=53 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:35.118338 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=32 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:36.414824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4da2-3c67-46d2-a50d-69a50331978e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:36.415321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4da2-3c67-46d2-a50d-69a50331978e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:36.416001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4da2-3c67-46d2-a50d-69a50331978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:36.460425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1f0e4da2-3c67-46d2-a50d-69a50331978e None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:36.461699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1f0e4da2-3c67-46d2-a50d-69a50331978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:36.611805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4340/8642] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:37.373824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:37.374251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:37.487785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3b99-dd26-4e5e-b1f8-cf70589cff91 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:37.493590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:37.494206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:37.494517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:37.494814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] PATH_INFO: `/v3/users/49542098be914013837bfe2310608c31` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:37.495990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49542098be914013837bfe2310608c31)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:37.498134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:37.578593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49542098be914013837bfe2310608c31'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:37.590646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49542098be914013837bfe2310608c31'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:37.602064 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49542098be914013837bfe2310608c31'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:37.618824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49542098be914013837bfe2310608c31'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:37.619846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49542098be914013837bfe2310608c31'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:37.627885 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4303/8643] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:50:37 2022] DELETE /identity/v3/users/49542098be914013837bfe2310608c31 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:37.633364 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:37.634317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:37.634966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:37.661785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:37.664580 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:37.759041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4341/8644] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:37.765304 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:37.770704 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:37.888879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097d65b-2c16-436f-9345-fdcbb808cf37 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:37.896640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:37.897657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:37.898066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:37.898531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:37.911376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:37.914910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:37.928585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4304/8645] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:50:38.195430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:38.197614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:38.225914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b371eb-4c38-4059-b7f8-bc2a9e6fbb65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:38.244691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:38.245648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:38.246068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:38.246447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] PATH_INFO: `/v3/projects/f4b5a847051449df8fc6a3f05dbb3d59` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:38.247796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b5a847051449df8fc6a3f05dbb3d59)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:38.250510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:38.331049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b5a847051449df8fc6a3f05dbb3d59', 'request_id': 'req-9629cbb0-467a-47a9-95f6-8eb83d376830'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.339706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b5a847051449df8fc6a3f05dbb3d59', 'request_id': 'req-9629cbb0-467a-47a9-95f6-8eb83d376830'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.353037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b5a847051449df8fc6a3f05dbb3d59', 'request_id': 'req-9629cbb0-467a-47a9-95f6-8eb83d376830'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.367437 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] The token cache is being invalidate because project f4b5a847051449df8fc6a3f05dbb3d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:50:38.367788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.368565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.373068 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4342/8646] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:50:38 2022] DELETE /identity/v3/projects/f4b5a847051449df8fc6a3f05dbb3d59 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:38.374554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:38.386346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5785c-9117-4f25-b0b3-3df698bd2292 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:38.415286 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:38.466356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:38.467354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:38.467640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:38.467918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] PATH_INFO: `/v3/users/af2d47adf1834d34887dbeb6eb7b2a77` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:38.469161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2d47adf1834d34887dbeb6eb7b2a77)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:38.472280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:38.543306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2d47adf1834d34887dbeb6eb7b2a77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.557091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2d47adf1834d34887dbeb6eb7b2a77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.572504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2d47adf1834d34887dbeb6eb7b2a77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.602408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2d47adf1834d34887dbeb6eb7b2a77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.603190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-09b53180-c1c8-4767-93b2-f5ff5fe61cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2d47adf1834d34887dbeb6eb7b2a77'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:38.613115 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4305/8647] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:50:38 2022] DELETE /identity/v3/users/af2d47adf1834d34887dbeb6eb7b2a77 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:38.980552 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:38.982911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:39.019658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629cbb0-467a-47a9-95f6-8eb83d376830 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:39.074985 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:39.138893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:39.139791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:39.140599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:39.140893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] PATH_INFO: `/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:39.142777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8a7af9581b4732bfea9b37b732aa0d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:39.147154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:39.218886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8a7af9581b4732bfea9b37b732aa0d', 'request_id': 'req-6b10a6f1-45fd-49bc-976d-0e970f55fad3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:39.233060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8a7af9581b4732bfea9b37b732aa0d', 'request_id': 'req-6b10a6f1-45fd-49bc-976d-0e970f55fad3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:39.250368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8a7af9581b4732bfea9b37b732aa0d', 'request_id': 'req-6b10a6f1-45fd-49bc-976d-0e970f55fad3'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:39.274529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] The token cache is being invalidate because project 0a8a7af9581b4732bfea9b37b732aa0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:50:39.275046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:39.276114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:50:39.278061 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4343/8648] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:50:38 2022] DELETE /identity/v3/projects/0a8a7af9581b4732bfea9b37b732aa0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:50:48.607414 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:49.270991 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:50:58.637484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd19a-5ae3-49e2-a944-456bffa071b8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:58.637984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd19a-5ae3-49e2-a944-456bffa071b8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:58.638236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd19a-5ae3-49e2-a944-456bffa071b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:58.701287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-01dcd19a-5ae3-49e2-a944-456bffa071b8 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:50:58.702691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-01dcd19a-5ae3-49e2-a944-456bffa071b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:58.770807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4306/8649] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:50:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:50:58.818038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:50:58.819491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:50:58.904688 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10a6f1-45fd-49bc-976d-0e970f55fad3 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:50:58.910164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:50:58.910839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:50:58.911124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:50:58.911404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:50:58.920986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:50:58.923587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14471d-96a1-4242-a504-e92a0756eb54 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:50:58.932396 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4344/8650] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:50:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:51:00.203260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:00.203762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:00.203886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:00.222097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:51:00.223288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:00.277066 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4307/8651] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:51:08.928810 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=36 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:10.270736 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=69 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:32.868514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:32.869049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:32.869049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:32.889704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] MFA Rules not processed for user `e9c6b9605c8f4c6a81352db2cefad8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:51:32.890928 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:32.953109 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4345/8652] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:51:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:51:36.684382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:36.685837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:36.793729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b747a-cecf-4cb3-8c61-e06a9a89d192 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:36.799276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:36.800309 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:36.801319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:36.801707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:36.804054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:36.821114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:36.823975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:36.841204 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4308/8653] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:42.945721 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=25 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:43.528154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:43.544253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa991ed-f133-4549-8e7b-8034ee6ce732 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:43.549515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:43.550343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:43.551470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:43.551816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:43.553708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:43.568074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:43.569812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0c02a-ffc8-4837-a41c-75769727171e service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:43.583172 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4346/8654] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:43.749840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:43.751989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:43.827820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211e87-9c58-46a5-b090-8ba3d234b97c service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:43.834550 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:43.835241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:43.835593 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:43.835938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:43.838420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:43.853655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:43.854994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca3310-7697-4b79-80cb-9ffa861a1482 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:43.868882 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4309/8655] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:43.958281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e430b4-e0bc-4eb4-af7b-770a7390d421 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:43.958833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e430b4-e0bc-4eb4-af7b-770a7390d421 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:43.958833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e430b4-e0bc-4eb4-af7b-770a7390d421 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:43.960213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4347/8656] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:51:43.965098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:43.965490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:43.965890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:44.005238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:51:44.006552 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:44.015763 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4310/8657] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:51:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:51:44.036510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e430b4-e0bc-4eb4-af7b-770a7390d421 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:44.055951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e430b4-e0bc-4eb4-af7b-770a7390d421 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:44.061312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:44.062074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:44.062425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:44.062778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:44.072657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:44.074386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:44.085502 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4348/8658] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:44.275181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:44.276708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:44.292024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33830fb-2943-45a6-89f4-966a3ac8f5a1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:44.295719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:44.296517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:44.296914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:44.297196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:44.298992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:44.371014 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:51:44.408346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:44.411182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:44.435714 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4311/8659] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:44.509153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:44.526295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d746e-b0e8-4a5f-8ed2-30bf605ebdcb service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:44.531188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:44.531930 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:44.532327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:44.532481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:44.535556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:44.554714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:44.557024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:44.570791 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4349/8660] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:45.457948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:45.473048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7242a-1fdf-43d7-92da-514c714e4d19 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:45.478465 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:45.479116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:45.479401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:45.479673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:45.481416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:45.496504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:45.498936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:45.525980 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4312/8661] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:48.159514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:48.161844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:48.180401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea7e66-0341-4fec-8892-eb9638ccb34b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:48.185758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:48.186396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:48.186677 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:48.186952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:48.188687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:48.248546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:48.250097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:48.259396 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4350/8662] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:54.202160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:54.214546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e0286-7a77-4118-8fd8-9b3044c79145 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:54.218527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:54.219209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:54.219519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:54.219797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:54.221591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:54.290379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:54.291845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16efa53-c24e-44fe-b575-25ba52ecd530 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:54.302436 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4313/8663] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:51:57.950800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:57.952370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:57.980596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad6363-9ca8-467c-ac32-a894e34b12fd service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:57.991656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:57.993744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:57.994223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:57.994696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:58.000714 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:58.027079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:58.028819 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:58.053297 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4351/8664] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:51:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:51:59.136067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:59.136643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:59.136643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:59.158354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:51:59.159795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:51:59.179843 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4314/8665] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 01:51:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:51:59.247029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:51:59.268391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881d4a1-55cd-4f74-a2a2-5f3f403ee173 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:51:59.291067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:51:59.291745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:51:59.292034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:51:59.292315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:51:59.303270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:51:59.304895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:51:59.323467 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4352/8666] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:52:01.994381 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:02.016028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3885a7-603d-4f6c-9d74-4cd665d116a1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:02.024025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:02.025985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:02.026490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:02.026922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:02.029211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:02.054600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:02.056334 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:02.080585 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4315/8667] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:52:02.139076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:02.141242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:02.158824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3056dd-482a-4db4-aa9b-852d45cce993 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:02.164596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:02.165626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:02.166029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:02.166393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] PATH_INFO: `/v3/users/c4b34bec387d42859f416aa3df7a7d0e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:02.167682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b34bec387d42859f416aa3df7a7d0e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:02.169689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:02.244484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b34bec387d42859f416aa3df7a7d0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.245188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b34bec387d42859f416aa3df7a7d0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.255523 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b34bec387d42859f416aa3df7a7d0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.265495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b34bec387d42859f416aa3df7a7d0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.280719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b34bec387d42859f416aa3df7a7d0e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.288194 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4353/8668] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:52:02 2022] DELETE /identity/v3/users/c4b34bec387d42859f416aa3df7a7d0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:02.498894 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:02.519874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da469ebd-f97e-4a03-bc13-2f51420d97f7 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:02.656983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:02.658009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:02.658710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:02.659062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] PATH_INFO: `/v3/projects/101695253c6e40569d3cb5b391fccd61` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:02.660720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=101695253c6e40569d3cb5b391fccd61)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:02.663450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:02.720069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101695253c6e40569d3cb5b391fccd61', 'request_id': 'req-f4feddae-bd84-4ea2-969f-efe0cd8274ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.723370 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:02.728499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101695253c6e40569d3cb5b391fccd61', 'request_id': 'req-f4feddae-bd84-4ea2-969f-efe0cd8274ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.739472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101695253c6e40569d3cb5b391fccd61', 'request_id': 'req-f4feddae-bd84-4ea2-969f-efe0cd8274ea'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.755438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] The token cache is being invalidate because project 101695253c6e40569d3cb5b391fccd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:52:02.755829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.756599 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.758434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4316/8669] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:52:02 2022] DELETE /identity/v3/projects/101695253c6e40569d3cb5b391fccd61 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:02.762416 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:02.764103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:02.777502 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:02.783599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fac743-eccd-41cc-9b54-dd26b1fb2c6c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:02.868826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:02.869702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:02.869983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:02.870262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] PATH_INFO: `/v3/users/0ab79892fe94440799d98e1c0b53a876` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:02.871526 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab79892fe94440799d98e1c0b53a876)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:02.873640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:02.930810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab79892fe94440799d98e1c0b53a876'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.931537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab79892fe94440799d98e1c0b53a876'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.939908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab79892fe94440799d98e1c0b53a876'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.949456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab79892fe94440799d98e1c0b53a876'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.964812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-d9457791-38d9-4c04-9e65-59afef697870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab79892fe94440799d98e1c0b53a876'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:02.972445 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4354/8670] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:52:02 2022] DELETE /identity/v3/users/0ab79892fe94440799d98e1c0b53a876 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:03.175927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.178246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:03.210115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feddae-bd84-4ea2-969f-efe0cd8274ea admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.314164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.314787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.315066 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.317434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] PATH_INFO: `/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.319622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bfd6d87e1e48a1925b2a4753b211b4)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.321595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:03.457003 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bfd6d87e1e48a1925b2a4753b211b4', 'request_id': 'req-0ff7d620-2ca7-499b-8d83-b0abba93a049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:03.471611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bfd6d87e1e48a1925b2a4753b211b4', 'request_id': 'req-0ff7d620-2ca7-499b-8d83-b0abba93a049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:03.479200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bfd6d87e1e48a1925b2a4753b211b4', 'request_id': 'req-0ff7d620-2ca7-499b-8d83-b0abba93a049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:03.500993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] The token cache is being invalidate because project 76bfd6d87e1e48a1925b2a4753b211b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:52:03.501425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:03.502129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ff7d620-2ca7-499b-8d83-b0abba93a049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:03.504436 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4317/8671] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:52:03 2022] DELETE /identity/v3/projects/76bfd6d87e1e48a1925b2a4753b211b4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:03.510323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.510867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.510979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.530286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:03.531528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:03.613344 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4355/8672] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:52:03.620973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.621260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.621541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.646975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:03.648195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:03.662659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.666326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4318/8673] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:52:03.673185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e809-f264-42f5-9c72-f45310ade470 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.678705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.679357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.679637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.679914 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.681191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:52:03.681191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.701515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:03.715806 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4356/8674] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:52:03.720268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.732328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9093-2800-47c3-a436-a88422af5e26 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.737700 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.738437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.738864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.739158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.739879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.741843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:03.774548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4319/8675] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:52:03 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:52:03.775652 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.786256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53d5c-74ca-4430-ac53-0cdaf1b174ef admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.795899 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:03.876612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.877631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.877955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.878315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.879245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.881235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:03.912007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4357/8676] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:52:03 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:52:03.915876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.928538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a10fdc-d22b-4b50-8ea7-179cf04199e8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.933709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.934665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.935151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.935626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.936609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.938725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:03.954873 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4320/8677] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:52:03.955673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:03.969341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d4b7-d94e-4311-8298-9bf94165afc7 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:03.982180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:03.983185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:03.983482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:03.983956 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:03.984703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:03.989262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6df7b-3032-4a34-80c5-981edb17f518 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:04.009731 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4358/8678] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:52:04.014699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:04.028351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d3da-5e77-43c1-8f3a-3090eaf4e2cb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:04.036133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:04.041394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:04.042059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:04.042491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] PATH_INFO: `/v3/projects/37768cd67356449ca5578785112a4ef5/users/b760b0a244d34248bf79b62970d61ccb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:04.070505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=37768cd67356449ca5578785112a4ef5, user_id=b760b0a244d34248bf79b62970d61ccb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:04.073262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:04.092850 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4321/8679] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:52:04 2022] PUT /identity/v3/projects/37768cd67356449ca5578785112a4ef5/users/b760b0a244d34248bf79b62970d61ccb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:04.096386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4f2-de81-4cc0-b26c-df72d164c9bb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:04.096682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4f2-de81-4cc0-b26c-df72d164c9bb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:04.097189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a4f2-de81-4cc0-b26c-df72d164c9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:04.124867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b391a4f2-de81-4cc0-b26c-df72d164c9bb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:04.126331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b391a4f2-de81-4cc0-b26c-df72d164c9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:04.209007 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4359/8680] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:52:04.222772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:04.225095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:04.241094 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:04.311000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24475e3-20f4-471c-82d7-efc0de5d68ed admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:04.314968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:04.316185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:04.316473 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:04.316748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:04.331240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:04.332718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:04.344865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4322/8681] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:52:12.845167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:12.845603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:12.845603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:12.901571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] MFA Rules not processed for user `b760b0a244d34248bf79b62970d61ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:12.904310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:13.022882 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4360/8682] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:52:13.024706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:13.042581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e5e48-95e5-4d4a-a2b8-97dbe1a9a042 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:13.047285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:13.048223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.048570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.048911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.050850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:13.053372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:13.103698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:13.104464 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4323/8683] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:52:13 2022] POST /identity/v3/users => generated 287 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:52:13.142981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3217ee-b9a9-4907-829a-71443a0ccef9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:13.152917 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:13.154214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.154597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.154975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.155815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:13.158582 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368fcc-8e49-4825-9a77-202f1fb4cbf1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:13.172459 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4361/8684] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:52:13.177272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:13.194198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a6a53-e1b5-49cf-8d76-7fa804ecd3b7 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:13.202169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:13.203516 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.204038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.204531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] PATH_INFO: `/v3/system/users/d5828f7f70544a6a8a8762fcfa9e6049/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.231733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5828f7f70544a6a8a8762fcfa9e6049, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:13.233821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:13.243877 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4324/8685] 10.222.0.27 () {60 vars in 1377 bytes} [Sun Jul 24 01:52:13 2022] PUT /identity/v3/system/users/d5828f7f70544a6a8a8762fcfa9e6049/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:13.255281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.255506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.255785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.276359 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:13.289001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] MFA Rules not processed for user `d5828f7f70544a6a8a8762fcfa9e6049`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:13.290269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:13.391680 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4362/8686] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:13 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:52:13.397689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:13.558207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e98f1-586c-45fd-8891-a74224ce68a1 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:13.588298 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:13.614560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5828f7f70544a6a8a8762fcfa9e6049', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:13.617858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.618426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.619061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] PATH_INFO: `/v3/services` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.620606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:13.622815 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:13.631267 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4325/8687] 10.222.0.27 () {58 vars in 1109 bytes} [Sun Jul 24 01:52:13 2022] GET /identity/v3/services => generated 2191 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:52:13.635361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:13.773394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6092ae-42f1-4b30-a753-180f4d128350 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:13.807912 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:13.821144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5828f7f70544a6a8a8762fcfa9e6049', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:13.821875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:13.822163 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:13.822446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] PATH_INFO: `/v3/limits` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:13.823234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:13.824528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 24 01:52:13.885636 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 24 01:52:13.887322 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:52:13.888132 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4363/8688] 10.222.0.27 () {60 vars in 1125 bytes} [Sun Jul 24 01:52:13 2022] POST /identity/v3/limits => generated 124 bytes in 253 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 24 01:52:13.892765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:14.074212 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae9ae-df40-4a12-9405-dfa5eab91380 None tempest-ImageQuotaTest-753649691-system-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:14.134532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5828f7f70544a6a8a8762fcfa9e6049', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:14.135230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:14.135513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:14.135785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:14.136482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:14.137553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:14.145453 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4326/8689] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:52:13 2022] GET /identity/v3/registered_limits => generated 129 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:52:14.151755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:14.295577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc0ac-8ae7-4153-aea0-d436a496bd5e None tempest-ImageQuotaTest-753649691-system-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:14.363540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5828f7f70544a6a8a8762fcfa9e6049', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:14.364244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:14.364530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:14.364811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:14.365518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:14.366617 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:14.377637 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4364/8690] 10.222.0.27 () {58 vars in 1136 bytes} [Sun Jul 24 01:52:14 2022] GET /identity/v3/registered_limits => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:52:18.548534 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:18.564187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444854a-20df-46ff-b936-196c90691bf0 None tempest-ImageQuotaTest-753649691-system-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:18.571053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:18.572240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:18.572769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:18.573150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] PATH_INFO: `/v3/users/b760b0a244d34248bf79b62970d61ccb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:18.574699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b760b0a244d34248bf79b62970d61ccb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:18.577046 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:18.665241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b760b0a244d34248bf79b62970d61ccb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:18.667380 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:18.691859 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b760b0a244d34248bf79b62970d61ccb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:18.713055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b760b0a244d34248bf79b62970d61ccb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:18.728914 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b760b0a244d34248bf79b62970d61ccb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:18.730151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b760b0a244d34248bf79b62970d61ccb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:18.738815 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4327/8691] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:52:18 2022] DELETE /identity/v3/users/b760b0a244d34248bf79b62970d61ccb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:18.951469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:18.954176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:19.050692 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=100 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:19.068382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce16b-eb2f-4c77-8fe3-d52a7f8a43ea None tempest-ImageQuotaTest-753649691-system-admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:19.073235 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:19.074173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:19.074455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:19.074730 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] PATH_INFO: `/v3/projects/37768cd67356449ca5578785112a4ef5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:19.075974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=37768cd67356449ca5578785112a4ef5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:19.078313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:19.147957 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37768cd67356449ca5578785112a4ef5', 'request_id': 'req-4579d459-b4b5-41dc-ab56-153c54a3d4ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.154531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37768cd67356449ca5578785112a4ef5', 'request_id': 'req-4579d459-b4b5-41dc-ab56-153c54a3d4ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.167743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37768cd67356449ca5578785112a4ef5', 'request_id': 'req-4579d459-b4b5-41dc-ab56-153c54a3d4ec'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.182450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] The token cache is being invalidate because project 37768cd67356449ca5578785112a4ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:52:19.182749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.183419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.185426 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4365/8692] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:52:18 2022] DELETE /identity/v3/projects/37768cd67356449ca5578785112a4ef5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:19.189231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:19.203766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1624-f6f1-40cc-8bfa-d9d381dd1302 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:19.270185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:19.271560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:19.272037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:19.272504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] PATH_INFO: `/v3/users/d5828f7f70544a6a8a8762fcfa9e6049` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:19.273972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5828f7f70544a6a8a8762fcfa9e6049)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:19.276359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:19.345720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5828f7f70544a6a8a8762fcfa9e6049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.355354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5828f7f70544a6a8a8762fcfa9e6049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.364627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5828f7f70544a6a8a8762fcfa9e6049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.378650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5828f7f70544a6a8a8762fcfa9e6049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.379364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-fda2e8e7-bef1-4a73-b261-df5187d8d7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5828f7f70544a6a8a8762fcfa9e6049'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:52:19.387483 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4328/8693] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:52:19 2022] DELETE /identity/v3/users/d5828f7f70544a6a8a8762fcfa9e6049 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:52:19.686546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:19.688129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:19.719981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579d459-b4b5-41dc-ab56-153c54a3d4ec admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:19.787103 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:19.787975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:19.788263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:19.788539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:19.797198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:19.799140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:52:19.823348 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 24 01:52:19.824573 n-d-master-1 devstack@keystone.service[80590]: ERROR keystone.server.flask.application Jul 24 01:52:19.826350 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4366/8694] 10.222.0.27 () {58 vars in 1148 bytes} [Sun Jul 24 01:52:19 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:52:25.432952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:25.433506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:25.433506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:25.451278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:25.452488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:25.482180 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=2,keystone:DELETE=14,keystone:SELECT=84 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:25.511117 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4329/8695] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:52:25.844312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:25.846161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:25.915510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942991-47e2-44e6-8941-67bfe490ce9f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:25.919395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:25.920095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:25.920371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:25.920644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:25.922417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:25.935589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:25.937046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51902e7a-ff05-471e-8925-25f5ea91df8c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:25.949367 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4367/8696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:52:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:52:35.504331 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=10 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:35.942615 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:42.715124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:52:42.716834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:42.806811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c257c9f-817f-4a48-8fba-97210024cbb3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:52:42.814594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:52:42.815880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:42.816162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:42.816435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:42.819565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:42.840061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:52:42.842054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:52:42.856423 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4330/8697] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:52:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:52:52.849195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=34 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:52:55.439980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:52:55.441042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:52:55.441566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:52:55.479017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] MFA Rules not processed for user `ecbfd92ba65f40758afcaf692c8aa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:52:55.480805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:52:55.583858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4368/8698] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:52:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:05.574822 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=25 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:16.707022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:16.708783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:16.725273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644da6c-5af4-49e0-be65-71a2046900d8 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:16.729978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:16.730850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:16.731132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:16.731409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] PATH_INFO: `/v3/users/e9c6b9605c8f4c6a81352db2cefad8cd` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:16.732660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c6b9605c8f4c6a81352db2cefad8cd)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:16.735083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:16.788322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c6b9605c8f4c6a81352db2cefad8cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:16.795414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c6b9605c8f4c6a81352db2cefad8cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:16.803020 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c6b9605c8f4c6a81352db2cefad8cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:16.815863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c6b9605c8f4c6a81352db2cefad8cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:16.816527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-f4fa030b-c0ce-455a-9c4c-ca411d9f8af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c6b9605c8f4c6a81352db2cefad8cd'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:16.822568 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4331/8699] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:53:16 2022] DELETE /identity/v3/users/e9c6b9605c8f4c6a81352db2cefad8cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:17.005454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.018836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b88e5-55a7-472b-88c7-90c2031d2dc1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.081299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.082193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.082477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.082754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] PATH_INFO: `/v3/projects/e6205931cc6a41f990d36b703e7b7467` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.084050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6205931cc6a41f990d36b703e7b7467)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.086027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.134934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6205931cc6a41f990d36b703e7b7467', 'request_id': 'req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:17.140909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6205931cc6a41f990d36b703e7b7467', 'request_id': 'req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:17.149651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6205931cc6a41f990d36b703e7b7467', 'request_id': 'req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:17.161045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] The token cache is being invalidate because project e6205931cc6a41f990d36b703e7b7467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:53:17.161330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:17.161989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cb81a933-6b3c-413b-bbb0-47a1561a7d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:17.163540 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4369/8700] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:53:17 2022] DELETE /identity/v3/projects/e6205931cc6a41f990d36b703e7b7467 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:17.168507 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.168744 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.169048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.187818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:17.189013 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:17.249373 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4332/8701] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:17.257975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.258268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.258578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.277561 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:17.278796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:17.286858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4370/8702] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:17.291054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.300936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c026ce-6bb7-4305-8adc-04ae0bfd5e89 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.305519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.306206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.306490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.306767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.307496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:53:17.307804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.309411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.321606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4333/8703] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:53:17.325922 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.335995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c587f-e4d9-4bc0-8371-c1fa59cce8f0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.340729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.341419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.341733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.342018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.342711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.344644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.369899 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4371/8704] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:53:17 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:53:17.374031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.389706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e53a0-76ea-4999-8633-aa1d89165832 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.457230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.457867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.458153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.458431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.459143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.461257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.467886 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:17.482434 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4334/8705] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:53:17 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:53:17.487615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.499031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e070-fba0-4ac9-ba48-18f8e49a3c56 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.505056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.506042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.506386 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.506673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.507403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.508996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.522264 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4372/8706] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:53:17.526833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.537761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563490d-35a8-4b56-b529-3f224bbb5b93 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.542581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.543245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.543532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.543812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.544545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.546202 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ea1fb-3dc0-493d-8322-26bba6837260 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.559347 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4335/8707] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:53:17.563708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.575208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9a8b-c342-41a1-8124-c4b7698467a2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.580222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.581374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.581664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.581965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] PATH_INFO: `/v3/projects/e1caddd55cba4df29bcc9d58708a469f/users/8a1cff92817945989fd19cfae90eff46/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.597778 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1caddd55cba4df29bcc9d58708a469f, user_id=8a1cff92817945989fd19cfae90eff46, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.600429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.614661 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4373/8708] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:53:17 2022] PUT /identity/v3/projects/e1caddd55cba4df29bcc9d58708a469f/users/8a1cff92817945989fd19cfae90eff46/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:17.624985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.625277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.625684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.652887 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] MFA Rules not processed for user `8a1cff92817945989fd19cfae90eff46`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:17.654139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:17.719236 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4336/8709] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:17.730341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:17.732049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:17.765883 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:17.805492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdbfa-14c5-47c2-9beb-b250d9a9d2fd admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:17.809149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:17.809820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:17.810102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:17.810374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:17.819451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:17.820869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dca13-ae47-4f3c-864f-f47ec38d1af6 service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:17.829653 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4374/8710] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:53:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:53:27.716142 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:27.825629 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=18 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:35.171686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:35.236114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6340a-2a6d-40d0-9c7a-87f4aa1942c6 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:35.241352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:35.242260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:35.242542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:35.242812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] PATH_INFO: `/v3/users/8a1cff92817945989fd19cfae90eff46` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:35.244000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1cff92817945989fd19cfae90eff46)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:35.245948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:35.293883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1cff92817945989fd19cfae90eff46'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.302373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1cff92817945989fd19cfae90eff46'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.309871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1cff92817945989fd19cfae90eff46'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.322058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1cff92817945989fd19cfae90eff46'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.322734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1cff92817945989fd19cfae90eff46'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.328775 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4337/8711] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:53:35 2022] DELETE /identity/v3/users/8a1cff92817945989fd19cfae90eff46 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:35.333587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:35.334228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:35.334228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:35.352043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:35.353252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:35.414213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4375/8712] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:53:35.426517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:35.427952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:35.490272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c680-db7f-4c98-8eac-894cfe8f0071 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:35.494211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:35.494906 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:35.495187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:35.495463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:35.505750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:35.507231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be9906-6de8-4f18-8640-b52ad3a3f91d service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:35.518173 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4338/8713] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:53:35.799567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:35.802249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:35.818172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8509-129a-434b-b2b4-717100b786b6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:35.826358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:35.827234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:35.827517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:35.827810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] PATH_INFO: `/v3/projects/e1caddd55cba4df29bcc9d58708a469f` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:35.829029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1caddd55cba4df29bcc9d58708a469f)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:35.831623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:35.884837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1caddd55cba4df29bcc9d58708a469f', 'request_id': 'req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.890461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1caddd55cba4df29bcc9d58708a469f', 'request_id': 'req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.899741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1caddd55cba4df29bcc9d58708a469f', 'request_id': 'req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.911226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] The token cache is being invalidate because project e1caddd55cba4df29bcc9d58708a469f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:53:35.911511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.912158 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-22fd7b96-0b7f-4523-9e9c-1fa8b26d97e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:35.913817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4376/8714] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:53:35 2022] DELETE /identity/v3/projects/e1caddd55cba4df29bcc9d58708a469f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:35.919109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:35.919359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:35.919659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:35.938646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:35.939841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:35.958783 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:36.003411 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4339/8715] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:36.011630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.011924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.012206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.031646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:36.032853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:36.041407 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4377/8716] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:36.045664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.055687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb585e8-6f4e-474f-8357-4939e98b5836 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.060207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.060861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.061139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.061408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.062165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:53:36.062462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.064050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.076455 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4340/8717] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 01:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:53:36.080522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.090923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6442f7-b6dd-4f14-aeb7-3f729e3679b5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.095790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.096487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.097354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.097624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.098361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.100306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.131673 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4378/8718] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:53:36.136000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.147911 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acedcc2-6770-471f-88ac-1ad72e4b608b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.209922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.210549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.210799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.211105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.211806 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.213772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.233604 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4341/8719] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:53:36.238029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.248330 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e916-103e-4af7-b3f3-bd09699676c2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.253030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.253708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.253992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.254264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.255001 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.256576 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.266780 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4379/8720] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:53:36.271160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.280822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2247016-b6df-4c9a-94a5-cc324cf20d3e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.286285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.286935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.287214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.287486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.288205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.289858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ee0a9-1928-4196-b3ba-281a471afae4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.299591 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4342/8721] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:53:36.303548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.313496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6fd46-e758-4736-80b0-b627771ecab8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.318295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.319277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.319482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.319718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] PATH_INFO: `/v3/projects/f275b730f5714138a612751454c90697/users/d97ed6d0c2eb4b2eb2aef7c29e18f17e/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.334741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f275b730f5714138a612751454c90697, user_id=d97ed6d0c2eb4b2eb2aef7c29e18f17e, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.337376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.351015 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4380/8722] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:53:36 2022] PUT /identity/v3/projects/f275b730f5714138a612751454c90697/users/d97ed6d0c2eb4b2eb2aef7c29e18f17e/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:36.362667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.362979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.363260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.389254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] MFA Rules not processed for user `d97ed6d0c2eb4b2eb2aef7c29e18f17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:36.390481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:36.455091 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4343/8723] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:36.460326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.482627 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:36.525527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5fac5-4856-481a-b200-0ec540e5c30b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.530612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.531460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.531832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.532206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.532892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.535701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.559746 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4381/8724] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:53:36.563751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.575087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd08790-758a-4fc0-b4c2-00743ec5d01e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.587948 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:36.634346 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.635023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.635307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.635584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.636289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.638247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.657870 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4344/8725] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:53:36.661847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.672306 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67db82-a14b-4ccb-a4b3-11b936b552d4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.676987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.677648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.677995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.678272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.679009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.680599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a5ce-3c79-4c0b-9028-54a49706b773 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.691579 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4382/8726] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 01:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:53:36.695518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.705497 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2db4c-a105-4c7a-90b6-b1fbaba790da admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.711128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.712086 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.712438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.712733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] PATH_INFO: `/v3/projects/b8549a1d1ca0485eb3c605e3fb49e395/users/9dec49bd76cd491cb7f8232fa0ca6a5a/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.727714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8549a1d1ca0485eb3c605e3fb49e395, user_id=9dec49bd76cd491cb7f8232fa0ca6a5a, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.730416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.744402 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4345/8727] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 01:53:36 2022] PUT /identity/v3/projects/b8549a1d1ca0485eb3c605e3fb49e395/users/9dec49bd76cd491cb7f8232fa0ca6a5a/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:36.755124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.755504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.755805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.785007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] MFA Rules not processed for user `9dec49bd76cd491cb7f8232fa0ca6a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:36.785756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:36.849412 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4383/8728] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:36.877445 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:36.879928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:36.951909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15640b-dc23-43e4-a5d0-aed3fc998ec9 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:36.957739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:36.958410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:36.958690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:36.958964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:36.966841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:36.968357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de038127-c816-4757-b3a9-45eee319d597 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:36.976595 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4346/8729] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 01:53:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:53:37.509194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:37.580108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf7da-ce1c-48bf-b28b-b16ba9ed88a9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:37.585055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:37.585960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:37.586247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:37.586530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] PATH_INFO: `/v3/users/d97ed6d0c2eb4b2eb2aef7c29e18f17e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:37.587740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97ed6d0c2eb4b2eb2aef7c29e18f17e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:37.589691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:37.621446 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:37.641479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97ed6d0c2eb4b2eb2aef7c29e18f17e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:37.642160 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97ed6d0c2eb4b2eb2aef7c29e18f17e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:37.649376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97ed6d0c2eb4b2eb2aef7c29e18f17e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:37.656297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97ed6d0c2eb4b2eb2aef7c29e18f17e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:37.668524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97ed6d0c2eb4b2eb2aef7c29e18f17e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:37.674475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4384/8730] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:53:37 2022] DELETE /identity/v3/users/d97ed6d0c2eb4b2eb2aef7c29e18f17e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:37.679805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:37.680310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:37.680416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:37.697440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:53:37.698666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:37.757518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4347/8731] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:53:37.767114 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:37.769213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:37.830829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafcd34-57f9-4a01-a4ec-4c8905d40a10 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:37.835282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:37.835936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:37.836214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:37.836486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:37.845972 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:37.848226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:37.857556 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4385/8732] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:53:38.131074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:38.132542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:38.145098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b271f-2591-49a1-bcee-a189c8d62538 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:38.149836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:38.150702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:38.150984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:38.151880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] PATH_INFO: `/v3/projects/f275b730f5714138a612751454c90697` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:38.152449 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f275b730f5714138a612751454c90697)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:38.154430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:38.164078 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:38.204489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f275b730f5714138a612751454c90697', 'request_id': 'req-22cd42f1-4b4a-4c18-971d-e2b59107c64e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.211383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f275b730f5714138a612751454c90697', 'request_id': 'req-22cd42f1-4b4a-4c18-971d-e2b59107c64e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.216870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f275b730f5714138a612751454c90697', 'request_id': 'req-22cd42f1-4b4a-4c18-971d-e2b59107c64e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.229249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] The token cache is being invalidate because project f275b730f5714138a612751454c90697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:53:38.229540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.230199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.231755 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4348/8733] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:53:38 2022] DELETE /identity/v3/projects/f275b730f5714138a612751454c90697 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:38.236263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:38.246233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df636e66-48d9-484b-978d-bc4f63eecf2d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:38.301721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:38.302586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:38.302916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:38.303131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] PATH_INFO: `/v3/users/9dec49bd76cd491cb7f8232fa0ca6a5a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:38.304299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dec49bd76cd491cb7f8232fa0ca6a5a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:38.306230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:38.352208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dec49bd76cd491cb7f8232fa0ca6a5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.352869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dec49bd76cd491cb7f8232fa0ca6a5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.354514 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:38.361293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dec49bd76cd491cb7f8232fa0ca6a5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.370071 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dec49bd76cd491cb7f8232fa0ca6a5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.382669 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dec49bd76cd491cb7f8232fa0ca6a5a'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.388497 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4386/8734] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:53:38 2022] DELETE /identity/v3/users/9dec49bd76cd491cb7f8232fa0ca6a5a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:38.662747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:53:38.664365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:53:38.678455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd42f1-4b4a-4c18-971d-e2b59107c64e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:53:38.735818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:53:38.736687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:53:38.736973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:53:38.737811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] PATH_INFO: `/v3/projects/b8549a1d1ca0485eb3c605e3fb49e395` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:53:38.739006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8549a1d1ca0485eb3c605e3fb49e395)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:53:38.740923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:53:38.786453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8549a1d1ca0485eb3c605e3fb49e395', 'request_id': 'req-e6a996f2-03ef-4888-ad78-a288076e5ad0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.792443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8549a1d1ca0485eb3c605e3fb49e395', 'request_id': 'req-e6a996f2-03ef-4888-ad78-a288076e5ad0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.797884 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8549a1d1ca0485eb3c605e3fb49e395', 'request_id': 'req-e6a996f2-03ef-4888-ad78-a288076e5ad0'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.810562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] The token cache is being invalidate because project b8549a1d1ca0485eb3c605e3fb49e395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:53:38.810861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.811487 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:53:38.813063 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4349/8735] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:53:38 2022] DELETE /identity/v3/projects/b8549a1d1ca0485eb3c605e3fb49e395 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:53:48.385086 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:53:48.807372 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:12.210871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:12.212400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:12.273242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888ac3f-01ec-410e-a11d-e3105a5349b0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:12.322520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:12.323207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:12.323491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:12.323768 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:12.325536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:12.397355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:12.398739 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d7d0b-d37a-4af8-b402-414c0e7e83e5 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:12.412947 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4387/8736] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:12.585160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:12.586591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:12.601772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a996f2-03ef-4888-ad78-a288076e5ad0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:12.605442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:12.606122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:12.606409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:12.606685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:12.608450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:12.625897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:12.627558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0db647-976e-42ab-a384-6c8adf310956 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:12.643700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4350/8737] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:13.174453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.174744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.175026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.177474 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4388/8738] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 01:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:54:13.183326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.183619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.183903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.203101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:54:13.204296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:13.266761 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4351/8739] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 01:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:54:13.289927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:13.291589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:13.311709 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa6adf-5c64-4f8b-8976-dc586bb1eed5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:13.317047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:13.317658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.317969 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.318245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.326848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:13.328419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acdb23-5a6b-48e1-a0ee-24c0e4e81e25 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:13.338189 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4389/8740] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:13.529047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:13.542768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2aa3a-c2e0-4482-b150-fa63a7962b0d None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:13.546881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:13.547537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.547820 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.548096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.549930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:13.564385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:13.565794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04df7-3a53-4651-aebb-7ac6b8285f59 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:13.577622 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4352/8741] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:13.693536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4470-59dc-4f38-a734-be81fe5562b6 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.693936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4470-59dc-4f38-a734-be81fe5562b6 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.694285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4470-59dc-4f38-a734-be81fe5562b6 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.695722 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4390/8742] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:54:13.700520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.700995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.701258 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.720164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:54:13.721357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:13.730465 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4353/8743] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:54:13.751230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4470-59dc-4f38-a734-be81fe5562b6 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:13.767478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4470-59dc-4f38-a734-be81fe5562b6 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:13.772883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:13.773512 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.773823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.774098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.782246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:13.783814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:13.794260 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4391/8744] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:13.952646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:13.965596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d837b92-6331-4e67-83cb-5f99c6974e4a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:13.969238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:13.969921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:13.970207 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:13.970485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:13.972259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:13.989022 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:13.990619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:14.004030 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4354/8745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:23.790145 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:23.996891 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=50 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:42.339307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:42.340733 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:42.356446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962dd49-eb17-41f6-b6be-5838fcce252b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:42.360402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:42.361085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:42.361319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:42.361594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:42.363369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:42.375487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:42.376911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d3ba-3660-4e32-b2cf-eb921bd81bde service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:42.387640 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4392/8746] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:45.510843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:45.512253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:45.529023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba3b-ba66-419e-8b3f-be126ac6b57e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:45.534539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:45.535181 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:45.535470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:45.536235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:45.538298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:45.598757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:45.600352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:45.610030 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4355/8747] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:54:52.381455 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:54:53.704140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:53.704758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:53.704758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:53.724049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:54:53.725631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:53.732805 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4393/8748] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:54:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:54:54.070333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:54:54.083868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f7f5-de5c-4c57-8501-89c7c1343801 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:54:54.087576 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:54:54.088224 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:54:54.088504 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:54:54.088779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:54:54.090563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:54:54.103279 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:54:54.104822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:54:54.117065 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4356/8749] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:54:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:03.717721 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:04.109433 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=34 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:12.501738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:12.513929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d611486-5a5d-4136-8f9a-edccf0c2f1c5 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:12.517448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:12.518121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:12.518421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:12.518679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:12.520461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:12.582340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:12.583796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:12.593463 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4394/8750] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:14.500622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:14.502163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:14.522025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d43b0-473f-4a91-a76b-1815bb2cd647 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:14.530779 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:14.531482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:14.531766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:14.532044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:14.534591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:14.551848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:14.553488 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:14.567145 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4357/8751] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:22.588969 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=30 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:24.559711 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:26.575358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:26.590164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690674a-1dab-40ce-a4d8-5b3b2609b658 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:26.595538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:26.596168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:26.596448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:26.596720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:26.598504 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:26.660592 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:26.662109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:26.672660 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4395/8752] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:26.831960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:26.843873 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0434a-9fe8-4e26-b2f2-d07cab2a5a66 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:26.847422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:26.848047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:26.848325 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:26.848596 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:26.850359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:26.908647 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:26.910103 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49638f5-2dc2-46a7-979b-82a9e583fdba service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:26.919497 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4358/8753] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:27.858745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:27.876248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53ab2-2836-4542-8079-29e484853e00 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:27.881329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:27.882118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:27.883285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:27.884011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:27.886072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:27.917651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:27.919177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:27.933807 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4396/8754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:55:36.915595 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=28 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:37.927187 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=36 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:40.264121 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:40.264646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:40.264646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:40.283985 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] MFA Rules not processed for user `ecbfd92ba65f40758afcaf692c8aa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:55:40.285205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:40.293697 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4359/8755] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:55:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:55:50.278764 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:55:50.589305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:55:50.613500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a5cdd-593c-4d0f-a032-28aac3cfebed service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:55:50.620551 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:55:50.621208 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:55:50.621568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:55:50.621945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:55:50.624038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:55:50.651129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:55:50.653435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:55:50.671095 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4397/8756] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:55:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:56:00.661655 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:42.620286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:56:42.621770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:42.708209 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d5f5f-fe9d-488b-8019-828a88476ef1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:56:42.714018 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:56:42.714684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:42.714972 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:42.715254 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:42.717249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:42.731624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:56:42.733210 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c732-7055-44a1-9bb6-100632b6667d service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:56:42.746332 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4360/8757] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:56:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:56:51.451891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:56:51.501744 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895c395-9a86-4be9-9619-75812fa526b9 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:56:51.507172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:56:51.507812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:51.508145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:51.508395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:51.510554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:51.525616 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:56:51.527210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f412-3a8a-422f-ab0b-589c42952335 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:56:51.540257 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4398/8758] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:56:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:56:52.741310 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=33 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:56:52.959001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:52.959295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:52.959580 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:52.977233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] MFA Rules not processed for user `36ad5b8d2523473fa2111be3a6b8523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:56:52.978483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:52.986279 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4361/8759] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:56:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:56:53.765422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6ee7-2f0d-4432-a2e0-119a4952a9bb None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:53.765968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6ee7-2f0d-4432-a2e0-119a4952a9bb None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:53.766085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6ee7-2f0d-4432-a2e0-119a4952a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:53.797255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-deaf6ee7-2f0d-4432-a2e0-119a4952a9bb None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:56:53.798451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-deaf6ee7-2f0d-4432-a2e0-119a4952a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:53.809958 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4399/8760] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:56:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:56:53.820006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:56:53.836696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88e1eb-984e-4531-90c7-8b0d6dbcbad4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:56:53.842175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:56:53.842844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:53.843134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:53.843414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:53.852354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:56:53.853995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dee7e-449f-4dd9-898c-30087d66fabb service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:56:53.864442 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4362/8761] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:56:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:56:57.677312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd8c8-95cf-4faa-9b91-1bdb44d1eb03 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:57.677877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd8c8-95cf-4faa-9b91-1bdb44d1eb03 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:57.677877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd8c8-95cf-4faa-9b91-1bdb44d1eb03 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:57.679207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4400/8762] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 01:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:56:57.683932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c81a-e902-4bf0-a71c-57f2fe093058 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:57.684710 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c81a-e902-4bf0-a71c-57f2fe093058 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:57.685362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c81a-e902-4bf0-a71c-57f2fe093058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:57.705880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c697c81a-e902-4bf0-a71c-57f2fe093058 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:56:57.707062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c697c81a-e902-4bf0-a71c-57f2fe093058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:57.716490 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4363/8763] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:56:57.737517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efd8c8-95cf-4faa-9b91-1bdb44d1eb03 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:56:57.754681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efd8c8-95cf-4faa-9b91-1bdb44d1eb03 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:56:57.759775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:56:57.760508 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:57.760865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:57.761213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:57.770825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:56:57.772500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:56:57.783963 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4401/8764] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:56:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:56:58.056138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:58.056423 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:58.056696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:58.076427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:56:58.077636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:56:58.086275 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4364/8765] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 01:56:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:56:58.097942 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:56:58.111794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242dbb-eda9-46ef-b2f5-8a39fbeea687 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:56:58.118013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:56:58.118681 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:56:58.118966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:56:58.119245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:56:58.130935 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:56:58.132618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef9237-4a32-44dd-81e2-f90086bde004 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:56:58.143622 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4402/8766] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:56:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:57:08.070272 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=15 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:08.139362 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=39 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:16.156838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:57:16.171052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405e9c-e8fd-4668-a4e8-9703a7eb7aa4 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:57:16.176341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:57:16.177002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:57:16.177289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:57:16.177575 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:57:16.179396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:57:16.195109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:57:16.196729 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:57:16.212429 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4365/8767] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:57:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:57:22.396571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f47ca-5399-4b28-a32a-18fef5adcabe None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:57:22.397138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f47ca-5399-4b28-a32a-18fef5adcabe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:57:22.397138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f47ca-5399-4b28-a32a-18fef5adcabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:57:22.424040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-3f3f47ca-5399-4b28-a32a-18fef5adcabe None None] MFA Rules not processed for user `ecbfd92ba65f40758afcaf692c8aa33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:57:22.425375 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3f3f47ca-5399-4b28-a32a-18fef5adcabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:57:22.437577 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4403/8768] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 01:57:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:57:26.204358 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:57:32.417233 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:58:41.195709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:58:41.222238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58408174-cec9-43db-b0fc-beb6786e64ba service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:58:41.231048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:58:41.231888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:58:41.232238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:58:41.232589 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:58:41.234672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:58:41.265082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:58:41.266949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:58:41.281468 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4366/8769] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:58:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:58:51.274075 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=14 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:04.406491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:04.406975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:04.407094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:04.456900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:59:04.458240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:04.465037 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4404/8770] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Jul 24 01:59:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:59:04.472244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:04.481562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa651-0d8d-4fea-8da9-6a83cafca8be service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:04.485087 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:04.485758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:04.486059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:04.486362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:04.488434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:04.574060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:04.575437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:04.585960 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4367/8771] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:59:10.790790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:10.816558 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fa261-ca43-4574-ad76-dfb2fb249536 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:10.826968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:10.827573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:10.827913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:10.828121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:10.830088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:10.848282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:10.849971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:10.861036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:10.865869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:10.876127 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4405/8772] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:59:10.895235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6dcfb-865a-4bb7-a49a-562a8da30ab0 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:10.900313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:10.901461 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:10.901588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:10.902047 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] PATH_INFO: `/v3/users/36ad5b8d2523473fa2111be3a6b8523e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:10.929199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ad5b8d2523473fa2111be3a6b8523e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:10.931208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:10.998251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ad5b8d2523473fa2111be3a6b8523e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.005733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ad5b8d2523473fa2111be3a6b8523e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.012776 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ad5b8d2523473fa2111be3a6b8523e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.026057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ad5b8d2523473fa2111be3a6b8523e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.026793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ad5b8d2523473fa2111be3a6b8523e'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.032865 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4368/8773] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:59:10 2022] DELETE /identity/v3/users/36ad5b8d2523473fa2111be3a6b8523e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:59:11.230988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:11.244953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bfbf0-d51e-4097-9ea6-f20e718b9c8f service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:11.312826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:11.313622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:11.313950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:11.314757 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] PATH_INFO: `/v3/projects/03e5e1c5805b4c8895ecc39da9838803` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:11.325783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e5e1c5805b4c8895ecc39da9838803)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:11.327702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:11.373269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e5e1c5805b4c8895ecc39da9838803', 'request_id': 'req-ef4a0722-4fb9-4c44-b223-c9e09b37496e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.379717 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e5e1c5805b4c8895ecc39da9838803', 'request_id': 'req-ef4a0722-4fb9-4c44-b223-c9e09b37496e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.386801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e5e1c5805b4c8895ecc39da9838803', 'request_id': 'req-ef4a0722-4fb9-4c44-b223-c9e09b37496e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.399052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] The token cache is being invalidate because project 03e5e1c5805b4c8895ecc39da9838803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:59:11.399340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.399976 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.401516 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4406/8774] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:59:11 2022] DELETE /identity/v3/projects/03e5e1c5805b4c8895ecc39da9838803 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:59:11.405530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:11.406962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:11.421268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b471e-e6b5-48c8-8c14-f1b9bb70fa68 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:11.455574 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:11.483715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:11.484591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:11.484871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:11.485147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] PATH_INFO: `/v3/users/8fb3126827a34c10a42e46231d48cd5d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:11.499738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb3126827a34c10a42e46231d48cd5d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:11.501689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:11.551490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb3126827a34c10a42e46231d48cd5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.560708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb3126827a34c10a42e46231d48cd5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.569183 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb3126827a34c10a42e46231d48cd5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.581949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb3126827a34c10a42e46231d48cd5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.582623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb3126827a34c10a42e46231d48cd5d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.588518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4369/8775] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 01:59:11 2022] DELETE /identity/v3/users/8fb3126827a34c10a42e46231d48cd5d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:59:11.778096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:59:11.779684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:59:11.793109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0722-4fb9-4c44-b223-c9e09b37496e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:59:11.833360 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:11.860555 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:59:11.861979 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:59:11.862514 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:59:11.862826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] PATH_INFO: `/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:59:11.873967 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb43d0f5ef7d4633aceea86ef6eb289a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:59:11.875876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:59:11.925037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb43d0f5ef7d4633aceea86ef6eb289a', 'request_id': 'req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.930490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb43d0f5ef7d4633aceea86ef6eb289a', 'request_id': 'req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.943340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb43d0f5ef7d4633aceea86ef6eb289a', 'request_id': 'req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.954872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] The token cache is being invalidate because project fb43d0f5ef7d4633aceea86ef6eb289a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:59:11.955161 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.955820 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:59:11.957626 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4407/8776] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 01:59:11 2022] DELETE /identity/v3/projects/fb43d0f5ef7d4633aceea86ef6eb289a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:59:21.585070 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:59:21.951977 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:01.179328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:01.181809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:01.255178 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73e35-353d-455c-af0f-31bc48e5c6f0 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:01.305395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:01.306082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:01.306364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:01.306640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:01.308455 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:01.382519 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:01.383883 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:01.407185 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4370/8777] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:02.584115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:02.585531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:02.598174 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc75dd-29fd-4a35-8a5e-c34bc9513620 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:02.602707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:02.603350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:02.603634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:02.603913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:02.605623 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:02.621704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:02.623135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728351b-5c65-4507-855a-e2fbf2b8c0f2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:02.636814 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4408/8778] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:06.895991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:06.898215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:06.948691 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:06.981276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f44aa-6744-498c-acd6-0cd051c69d24 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:06.985994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:06.987421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:06.987961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:06.988233 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] PATH_INFO: `/v3/users/ecbfd92ba65f40758afcaf692c8aa33d` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:06.989558 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbfd92ba65f40758afcaf692c8aa33d)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:06.991584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:07.040194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbfd92ba65f40758afcaf692c8aa33d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.046915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbfd92ba65f40758afcaf692c8aa33d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.054711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbfd92ba65f40758afcaf692c8aa33d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.067056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbfd92ba65f40758afcaf692c8aa33d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.067706 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-7cebd279-2cbe-4c45-bf50-6792d7eaf348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbfd92ba65f40758afcaf692c8aa33d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.073848 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4371/8779] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:00:06 2022] DELETE /identity/v3/users/ecbfd92ba65f40758afcaf692c8aa33d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:07.078556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.079045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.079159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.104906 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:07.106351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:07.166872 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4409/8780] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:07.176871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.177164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.177443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.195788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:07.196988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:07.247626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4372/8781] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Jul 24 02:00:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:07.253918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:07.263279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee32796-b1e6-4bd7-9c16-3a01cf3b4bc4 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:07.266834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:07.267461 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.267790 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.268069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.276994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:07.278443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:07.288285 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4410/8782] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:07.461871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:07.463293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:07.477996 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065765cb-518c-4d2e-a767-af36313b1d45 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:07.482564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:07.483435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.483718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.483993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] PATH_INFO: `/v3/projects/9cd3d18dd66e4321b11cf7b5fe9a3400` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.485199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd3d18dd66e4321b11cf7b5fe9a3400)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:07.488119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:07.537693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'request_id': 'req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.543833 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'request_id': 'req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.545070 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:07.552285 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd3d18dd66e4321b11cf7b5fe9a3400', 'request_id': 'req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.564387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] The token cache is being invalidate because project 9cd3d18dd66e4321b11cf7b5fe9a3400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:00:07.564742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.565571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.567177 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4373/8783] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:00:07 2022] DELETE /identity/v3/projects/9cd3d18dd66e4321b11cf7b5fe9a3400 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:07.571189 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:07.581687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c41bc-dc64-4861-99e6-429042490c22 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:07.638090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:07.638958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.639244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.639522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] PATH_INFO: `/v3/users/4a16eebe673c4b27a4468aea1a4db43e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.640713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a16eebe673c4b27a4468aea1a4db43e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:07.643191 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:07.688662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a16eebe673c4b27a4468aea1a4db43e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.689269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a16eebe673c4b27a4468aea1a4db43e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.696854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a16eebe673c4b27a4468aea1a4db43e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.704172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a16eebe673c4b27a4468aea1a4db43e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.710182 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:07.717902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fdbcdd5b-8d52-47d6-8d11-0728ff37f995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a16eebe673c4b27a4468aea1a4db43e'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:07.724761 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4411/8784] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:00:07 2022] DELETE /identity/v3/users/4a16eebe673c4b27a4468aea1a4db43e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:07.905138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:07.906678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:07.921105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec347-cf45-4dae-9e00-b6f47c6e5045 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:07.979932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:07.980728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:07.981010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:07.981287 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] PATH_INFO: `/v3/projects/bc08658a31624318825a55992df8ff12` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:07.982505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc08658a31624318825a55992df8ff12)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:07.984404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:08.031099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc08658a31624318825a55992df8ff12', 'request_id': 'req-592232bb-5404-49e7-96d1-cde2b365f111'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:08.038007 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc08658a31624318825a55992df8ff12', 'request_id': 'req-592232bb-5404-49e7-96d1-cde2b365f111'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:08.043605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc08658a31624318825a55992df8ff12', 'request_id': 'req-592232bb-5404-49e7-96d1-cde2b365f111'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:08.056443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] The token cache is being invalidate because project bc08658a31624318825a55992df8ff12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:00:08.056734 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:08.057360 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-592232bb-5404-49e7-96d1-cde2b365f111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:08.058906 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4374/8785] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:00:07 2022] DELETE /identity/v3/projects/bc08658a31624318825a55992df8ff12 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:17.600290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.600860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.600860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.637539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:17.638749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:17.697731 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4412/8786] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:17.707641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.708115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.708342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.726610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:17.727723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:17.735826 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4375/8787] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:17.740749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:17.750451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302ae9-ed8d-4ffa-85b3-addee2c6ebe9 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:17.756249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:17.756909 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.757193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.757470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.758238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:00:17.758546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:17.760140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:17.772824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4413/8788] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:00:17.784814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:17.794590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326d606-3ef5-408e-bf77-7427d390b714 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:17.799200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:17.799847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.800130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.800419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.801695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:17.803590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:17.839301 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4376/8789] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:00:17 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:17.843414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:17.853978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d88a1c-7451-45cc-b29e-9be753cb4461 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:17.912440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:17.913113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.913400 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.913700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.914418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:17.916347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:17.935913 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4414/8790] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:00:17 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:17.940093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:17.950961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114edada-1a9a-415b-a688-1cc4c97c7db8 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:17.955521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:17.956172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.956453 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.957428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.958242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:17.959861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:17.969769 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4377/8791] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:17.973696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:17.983920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51e13-181f-4abf-b570-44dff0100332 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:17.989389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:17.990074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:17.990356 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:17.990629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:17.991353 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:17.992959 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002aa26-1fa0-4b9c-a0c3-76e76db92d17 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.002712 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4415/8792] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:18.007319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.016973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9197530-0367-4b11-812a-990df2dc0436 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.021952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.022855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.023134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.023407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] PATH_INFO: `/v3/projects/5debb64ab18d47ed9fc1871bec377ab3/users/b8e2ebfa34c44e2b9096ca600743bb4c/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.037797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5debb64ab18d47ed9fc1871bec377ab3, user_id=b8e2ebfa34c44e2b9096ca600743bb4c, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.040420 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.049170 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:18.055120 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4378/8793] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:00:18 2022] PUT /identity/v3/projects/5debb64ab18d47ed9fc1871bec377ab3/users/b8e2ebfa34c44e2b9096ca600743bb4c/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:18.069147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.069466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.069912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.096903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] MFA Rules not processed for user `b8e2ebfa34c44e2b9096ca600743bb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:18.098176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:18.124671 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:18.165717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4416/8794] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:18.170269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.232408 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387516-4924-4988-8441-c843087d9f96 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.237187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.238679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.239208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.239498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.240201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.242179 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.267491 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4379/8795] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:00:18 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:18.272034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.282638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67e9b-6ed6-4ccb-b8eb-302d32ecaba3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.339619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.340284 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.340567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.340841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.341528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.343477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.364293 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4417/8796] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:00:18 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:18.368561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.379559 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9640976-3162-4783-b384-7e78c5415eca admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.384166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.384811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.385092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.385367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.386130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.387725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.398471 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4380/8797] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:18.402718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.414781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88588e5a-fc8a-47f8-87a7-5251ac1b97ee admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.419427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.420301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.420585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.420863 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] PATH_INFO: `/v3/projects/60ba04c9595f473aae79d3702147a917/users/39f0a3f7659f42df8f865b052ecc1af5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.436151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ba04c9595f473aae79d3702147a917, user_id=39f0a3f7659f42df8f865b052ecc1af5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.438874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.451254 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4418/8798] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:00:18 2022] PUT /identity/v3/projects/60ba04c9595f473aae79d3702147a917/users/39f0a3f7659f42df8f865b052ecc1af5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:18.455373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.465621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e6eb-ad46-4b61-b632-123968759d3c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.522973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.523571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.523855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.524133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.524864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.526529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dac36-4ccb-4335-a46f-687af6139914 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.536685 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4381/8799] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:18.541074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.552052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9ed7b-9db2-4235-82c7-2aa77371f280 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.556691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.557563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.557876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.558153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] PATH_INFO: `/v3/projects/60ba04c9595f473aae79d3702147a917/users/39f0a3f7659f42df8f865b052ecc1af5/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.560123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ba04c9595f473aae79d3702147a917, user_id=39f0a3f7659f42df8f865b052ecc1af5, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.563066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacb258-701c-4c83-8ecc-3029032d9df9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.574065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4419/8800] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:00:18 2022] PUT /identity/v3/projects/60ba04c9595f473aae79d3702147a917/users/39f0a3f7659f42df8f865b052ecc1af5/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:18.584195 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.584486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.584767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.611717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] MFA Rules not processed for user `39f0a3f7659f42df8f865b052ecc1af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:18.614176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:18.672522 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:18.683502 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4382/8801] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:18.695640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.696144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.696264 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.713807 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] MFA Rules not processed for user `b8e2ebfa34c44e2b9096ca600743bb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:18.715008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:18.769021 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4420/8802] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:18.783555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:18.786069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:18.865938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6976bcf-e17a-43a1-98d5-3502e0250025 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:18.871491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:18.872143 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:18.872425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:18.872702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:18.880771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:18.882399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:18.891163 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4383/8803] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:22.210570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:22.236132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d49685-ca1b-4238-9c20-a690e2038f9b None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:22.243045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:22.243715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:22.243999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:22.244286 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:22.246152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:22.263838 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:22.265481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:22.284261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4421/8804] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:28.126344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:28.127808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:28.185056 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529789f5-e958-400d-8fb9-efe4d5099e70 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:28.188564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:28.189206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:28.189484 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:28.189786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:28.192038 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:28.203869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:28.205290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e872e5-ddfe-4699-8557-d7a32596c5cf service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:28.216892 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4384/8805] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:30.137641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:30.139077 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:30.155832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1f2-081a-468a-a40b-a8e19ad44d07 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:30.161715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:30.162354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.162673 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.162953 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.171359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:30.172955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:30.177412 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:30.184997 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4422/8806] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:30.199354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288422f-eb25-4bf3-b5d5-3e3ecd97bfda None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.199837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288422f-eb25-4bf3-b5d5-3e3ecd97bfda None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.199954 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288422f-eb25-4bf3-b5d5-3e3ecd97bfda None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.201280 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4385/8807] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 02:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:00:30.205624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] Authenticating service token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 02:00:30.219257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:30.227644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b99c2-122a-4903-9707-f556e56271c5 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:30.232188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f0a3f7659f42df8f865b052ecc1af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60ba04c9595f473aae79d3702147a917', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:30.233031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.233311 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.233590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] PATH_INFO: `/v3/projects/60ba04c9595f473aae79d3702147a917` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.234802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: Authorizing `identity:get_project(project_id=60ba04c9595f473aae79d3702147a917)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:30.236567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288f4c2-a075-452a-9824-41f84f5ea56e tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:30.239266 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4423/8808] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 02:00:30 2022] GET /identity/v3/projects/60ba04c9595f473aae79d3702147a917 => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:00:30.385029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288422f-eb25-4bf3-b5d5-3e3ecd97bfda None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:30.395808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288422f-eb25-4bf3-b5d5-3e3ecd97bfda None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:30.399363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:30.399991 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.400270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.400539 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.402310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:30.414864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:30.416291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:30.427324 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4386/8809] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:30.588425 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cb96-d716-4120-9d17-17d644f9a239 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.588713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cb96-d716-4120-9d17-17d644f9a239 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.589016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cb96-d716-4120-9d17-17d644f9a239 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.590408 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4424/8810] 10.222.0.27 () {54 vars in 912 bytes} [Sun Jul 24 02:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:00:30.594969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] Authenticating service token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 24 02:00:30.611162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:30.621354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c0848-e7ee-4c11-b457-b0a312829d02 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:30.625920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39f0a3f7659f42df8f865b052ecc1af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60ba04c9595f473aae79d3702147a917', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:30.626762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.627041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.627316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] PATH_INFO: `/v3/projects/60ba04c9595f473aae79d3702147a917` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.628495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: Authorizing `identity:get_project(project_id=60ba04c9595f473aae79d3702147a917)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:30.630367 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:30.632220 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4387/8811] 10.222.0.27 () {58 vars in 1443 bytes} [Sun Jul 24 02:00:30 2022] GET /identity/v3/projects/60ba04c9595f473aae79d3702147a917 => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:00:30.779201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609cb96-d716-4120-9d17-17d644f9a239 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:30.790484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609cb96-d716-4120-9d17-17d644f9a239 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:30.794179 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:30.794811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:30.795093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:30.795366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:30.797142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:30.809520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:30.810996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558024d-07a9-49b6-a99f-2d4b3c1d45c0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:30.821495 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4425/8812] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:34.825814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:34.893651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761142-3966-478b-bbf0-874c93bedcf0 tempest-ServersAdminNegativeTestJSON-365497989 tempest-ServersAdminNegativeTestJSON-365497989-project-admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:34.898891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:34.899773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:34.900081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:34.900348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] PATH_INFO: `/v3/users/b8e2ebfa34c44e2b9096ca600743bb4c` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:34.901557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e2ebfa34c44e2b9096ca600743bb4c)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:34.903573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:34.906488 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:34.951281 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e2ebfa34c44e2b9096ca600743bb4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:34.959016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e2ebfa34c44e2b9096ca600743bb4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:34.966071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e2ebfa34c44e2b9096ca600743bb4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:34.977891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e2ebfa34c44e2b9096ca600743bb4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:34.978545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e2ebfa34c44e2b9096ca600743bb4c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:34.984427 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4388/8813] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:00:34 2022] DELETE /identity/v3/users/b8e2ebfa34c44e2b9096ca600743bb4c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:34.989912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:34.990458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:34.990458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:35.008704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:35.009950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:35.069377 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4426/8814] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:35.079084 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:35.080531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:35.138008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e368-9b4f-4213-8595-28c7ee7a90a6 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:35.141603 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:35.142373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:35.142652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:35.142926 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:35.152263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:35.153707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:35.163310 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4389/8815] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:35.334857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:35.336294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:35.350232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbbed7-dbdd-4c45-8f74-828244acbde3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:35.355057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:35.355924 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:35.356212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:35.356485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] PATH_INFO: `/v3/projects/5debb64ab18d47ed9fc1871bec377ab3` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:35.357703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5debb64ab18d47ed9fc1871bec377ab3)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:35.359642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:35.407245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5debb64ab18d47ed9fc1871bec377ab3', 'request_id': 'req-cd7b5c71-d388-445a-87b6-78775b28eab9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.413584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5debb64ab18d47ed9fc1871bec377ab3', 'request_id': 'req-cd7b5c71-d388-445a-87b6-78775b28eab9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.421201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5debb64ab18d47ed9fc1871bec377ab3', 'request_id': 'req-cd7b5c71-d388-445a-87b6-78775b28eab9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.432886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] The token cache is being invalidate because project 5debb64ab18d47ed9fc1871bec377ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:00:35.433170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.433826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.435349 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4427/8816] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:00:35 2022] DELETE /identity/v3/projects/5debb64ab18d47ed9fc1871bec377ab3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:35.439332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:35.449457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71a61-e725-4cb8-8126-fab7387e75ea service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:35.504711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:35.505655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:35.506080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:35.506365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] PATH_INFO: `/v3/users/39f0a3f7659f42df8f865b052ecc1af5` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:35.507585 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f0a3f7659f42df8f865b052ecc1af5)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:35.509574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:35.537017 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:35.556741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f0a3f7659f42df8f865b052ecc1af5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.564514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f0a3f7659f42df8f865b052ecc1af5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.574398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f0a3f7659f42df8f865b052ecc1af5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.586800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f0a3f7659f42df8f865b052ecc1af5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.587405 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-5bcb2ec0-ad97-4491-8f16-3bcbbcaf76c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f0a3f7659f42df8f865b052ecc1af5'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:35.593325 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4390/8817] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:00:35 2022] DELETE /identity/v3/users/39f0a3f7659f42df8f865b052ecc1af5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:35.870653 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:35.872271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:35.886686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5c71-d388-445a-87b6-78775b28eab9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:35.945211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:35.946113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:35.946391 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:35.946659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] PATH_INFO: `/v3/projects/60ba04c9595f473aae79d3702147a917` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:35.947839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ba04c9595f473aae79d3702147a917)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:35.949751 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:35.951169 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:35.999078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ba04c9595f473aae79d3702147a917', 'request_id': 'req-72d3c82f-6416-4df4-b5f4-d113baf16e43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:36.004527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ba04c9595f473aae79d3702147a917', 'request_id': 'req-72d3c82f-6416-4df4-b5f4-d113baf16e43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:36.012195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ba04c9595f473aae79d3702147a917', 'request_id': 'req-72d3c82f-6416-4df4-b5f4-d113baf16e43'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:36.024140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] The token cache is being invalidate because project 60ba04c9595f473aae79d3702147a917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:00:36.024431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:36.025072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-72d3c82f-6416-4df4-b5f4-d113baf16e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:00:36.026673 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4428/8818] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:00:35 2022] DELETE /identity/v3/projects/60ba04c9595f473aae79d3702147a917 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:36.032627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.033101 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.033214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.051715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:36.052997 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:36.112400 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4391/8819] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:36.121124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.121124 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.121349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.141074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:36.142308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:36.150971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4429/8820] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:36.155190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.165190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6989663-ea75-4c83-915a-0275d228dca5 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.169782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.170442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.170722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.171001 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.171733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:00:36.172041 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.173639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.186246 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4392/8821] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:00:36.190581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.201574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27374c0b-d0ad-49cc-83b6-d9ab9fe66e87 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.206485 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.207166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.207447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.207724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.209105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.211178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.236568 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4430/8822] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:00:36 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:36.241189 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.251274 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a362-e55e-470c-90ef-07caa3cd0c3b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.307868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.308529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.308809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.309083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.309819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.311723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.331541 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4393/8823] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:00:36 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:00:36.336240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.347113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d875-60a3-448c-9d42-520ca428e5eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.351850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.352502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.352783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.353057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.353869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.355455 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.366815 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4431/8824] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:36.370773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.381370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2ceaa-448f-4146-b516-cba5d7caadd5 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.385937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.386583 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.386862 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.387133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.387851 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.389438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aca009-4968-436c-8833-f03383a49881 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.399371 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4394/8825] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:00:36.403458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.413696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f994d-fa7f-4f0a-95f8-d070a5ac4274 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.418328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.419198 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.419481 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.419758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] PATH_INFO: `/v3/projects/a34fd57f6ade4b8aa075b57ceedf9d5d/users/ee6cfbf69ec74ad1877cd21f10801726/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.434564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34fd57f6ade4b8aa075b57ceedf9d5d, user_id=ee6cfbf69ec74ad1877cd21f10801726, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.437199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.450781 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4432/8826] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:00:36 2022] PUT /identity/v3/projects/a34fd57f6ade4b8aa075b57ceedf9d5d/users/ee6cfbf69ec74ad1877cd21f10801726/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:00:36.455971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3e8fa-fa59-4488-a009-bb6f32969012 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.456265 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3e8fa-fa59-4488-a009-bb6f32969012 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.456542 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3e8fa-fa59-4488-a009-bb6f32969012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.474607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5ef3e8fa-fa59-4488-a009-bb6f32969012 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:36.475804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5ef3e8fa-fa59-4488-a009-bb6f32969012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:36.479691 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:36.538014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4395/8827] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:36.547753 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:36.549463 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:36.607591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9477407-3bac-4423-9a7f-091f665fbec4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:36.611305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:36.611951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:36.612237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:36.612519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:36.622162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:36.623539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269184-7612-4a4d-ac3e-c3d350bb3541 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:36.633039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4433/8828] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:40.637979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:40.638856 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:40.639138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:40.681456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] MFA Rules not processed for user `ee6cfbf69ec74ad1877cd21f10801726`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:40.683384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:40.759175 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4396/8829] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:40.772554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:40.773170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:40.773170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:40.791010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] MFA Rules not processed for user `ee6cfbf69ec74ad1877cd21f10801726`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:40.792230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:40.799367 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4434/8830] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:40.811971 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:40.813831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:40.896187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d324d-051e-4948-a04f-7f146419d3f9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:40.902927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:40.903654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:40.903920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:40.904443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:40.913964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:40.915764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:40.928348 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4397/8831] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:50.081954 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:50.099049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e295-aa7e-42bb-ad2b-cc6a529ab405 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:50.104754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:50.105397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:50.105698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:50.105996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:50.107765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:50.124188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:50.125829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e20c05-01a5-47c8-ba0b-eb95802cd3f9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:50.140724 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4435/8832] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:50.922623 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:52.447415 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:52.448871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:52.461963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669a1a-a1b4-40fd-9480-7d83048ae841 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:52.467648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:52.468337 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:52.468620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:52.468897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:52.470805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:52.483826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:52.485275 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bbcd3-be6c-4e83-ba6b-6a1a534a33cb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:52.496618 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4398/8833] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:52.858287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:52.858884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:52.858884 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:52.860210 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4436/8834] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:00:52.866094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:52.866431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:52.866653 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:52.885345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:00:52.886561 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:52.950916 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4399/8835] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:00:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:00:52.971022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:52.972734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:52.992697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e99b9-cb37-4036-8eff-ec4140eca2fe None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:52.997783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:52.998581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:52.998912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:52.999272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:53.005630 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:00:53.009211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:53.011259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:53.023543 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4437/8836] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:00:53.192075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:00:53.202035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84099158-a6e0-4935-bd1e-faadff65b793 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:00:53.205525 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:00:53.206196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:00:53.206474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:00:53.206766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:00:53.208522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:00:53.224091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:00:53.226129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:00:53.239555 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4400/8837] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:00:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:03.024118 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:03.232124 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=41 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:21.643194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:21.653418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033007ec-8d8d-4d40-8335-1e2cd53a2c7e service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:21.656971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:21.657634 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:21.657963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:21.658219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:21.659986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:21.672799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:21.674277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:21.685088 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4438/8838] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:31.679178 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:32.039671 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.051584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74b23d-a1d3-4516-8719-e7bba6944d6f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.057158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.058076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.058363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.058772 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] PATH_INFO: `/v3/users/ee6cfbf69ec74ad1877cd21f10801726` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.059988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6cfbf69ec74ad1877cd21f10801726)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.061967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.110798 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6cfbf69ec74ad1877cd21f10801726'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.127955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6cfbf69ec74ad1877cd21f10801726'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.134882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6cfbf69ec74ad1877cd21f10801726'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.146536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6cfbf69ec74ad1877cd21f10801726'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.147234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d5ce74ca-595e-491a-9621-1f9e7622eebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6cfbf69ec74ad1877cd21f10801726'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.153118 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4401/8839] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:01:32 2022] DELETE /identity/v3/users/ee6cfbf69ec74ad1877cd21f10801726 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:01:32.327298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.340108 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8934-c068-42ab-80d3-be6afe5da1df service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.398841 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.399703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.399987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.400260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] PATH_INFO: `/v3/projects/a34fd57f6ade4b8aa075b57ceedf9d5d` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.401462 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34fd57f6ade4b8aa075b57ceedf9d5d)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.403423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.448396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'request_id': 'req-f8fce254-c884-4546-a704-4ecfa9fd28d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.453853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'request_id': 'req-f8fce254-c884-4546-a704-4ecfa9fd28d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.461491 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34fd57f6ade4b8aa075b57ceedf9d5d', 'request_id': 'req-f8fce254-c884-4546-a704-4ecfa9fd28d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.472626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] The token cache is being invalidate because project a34fd57f6ade4b8aa075b57ceedf9d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:01:32.472912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.473538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-f8fce254-c884-4546-a704-4ecfa9fd28d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:01:32.475115 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4439/8840] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:01:32 2022] DELETE /identity/v3/projects/a34fd57f6ade4b8aa075b57ceedf9d5d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:01:32.480850 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.481135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.481406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.499407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:32.500595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:32.558953 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4402/8841] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:32.566811 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.567136 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.567444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.586803 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:32.587946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:32.595956 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4440/8842] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:32.600140 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.610057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70310672-c0ae-4d02-a130-c6dd390d56c8 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.614896 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.615554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.615838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.616116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.616845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:01:32.617151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.618781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.630337 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4403/8843] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:01:32.635256 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.644450 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d979b-851f-4071-a57d-f5e8977ba877 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.649818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.650469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.650754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.651031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.651729 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.653624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.679866 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4441/8844] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:01:32.683844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.694529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff050-4abd-4d1d-a3ca-caaafc864554 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.751442 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.752113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.752397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.752672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.753356 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.755331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.762386 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:32.777431 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4404/8845] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:01:32 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 02:01:32.781408 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.792498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc5e2-641e-4833-b200-9dd617ea9c16 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.797127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.797812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.798095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.798369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.799100 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.800685 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.811817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4442/8846] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:01:32.815736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.825925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8dcf9-a002-4210-be5f-9cd974a60649 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.830563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.831218 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.831503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.831780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.832501 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.834156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36324d51-cea2-43fb-bb21-9d787f06aeb3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.845963 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4405/8847] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:01:32.849890 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.860449 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161bf66-50ad-499b-b706-d5862bc872d5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:32.865392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:32.867012 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.867293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.867566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] PATH_INFO: `/v3/projects/017ae15508e74480a8c6ced05bf424df/users/0c2a363c5ed84a84b2e4f00c8aa3b34f/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.883430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017ae15508e74480a8c6ced05bf424df, user_id=0c2a363c5ed84a84b2e4f00c8aa3b34f, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:32.886099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:32.899229 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4443/8848] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:01:32 2022] PUT /identity/v3/projects/017ae15508e74480a8c6ced05bf424df/users/0c2a363c5ed84a84b2e4f00c8aa3b34f/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:01:32.904440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cb8cf-69d8-476c-9157-7bb40f55abae None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:32.904735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cb8cf-69d8-476c-9157-7bb40f55abae None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:32.905016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cb8cf-69d8-476c-9157-7bb40f55abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:32.922652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6a5cb8cf-69d8-476c-9157-7bb40f55abae None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:32.923892 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6a5cb8cf-69d8-476c-9157-7bb40f55abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:32.985957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4406/8849] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:32.995272 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:32.996980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:33.029070 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:33.061434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cc8dd-ab41-470c-8cb0-0c942be8cde9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:33.065059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:33.065720 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:33.066000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:33.066270 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:33.075550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:33.076964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5ca35-0f3e-4787-9648-07259afe9720 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:33.087110 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4444/8850] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:37.242767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:37.243294 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:37.243403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:37.275658 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] MFA Rules not processed for user `0c2a363c5ed84a84b2e4f00c8aa3b34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:37.276493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:37.370801 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4407/8851] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:37.381395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb22443-4fbb-4908-8e8b-f73c09af92da None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:37.382380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb22443-4fbb-4908-8e8b-f73c09af92da None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:37.382661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb22443-4fbb-4908-8e8b-f73c09af92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:37.401026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7eb22443-4fbb-4908-8e8b-f73c09af92da None None] MFA Rules not processed for user `0c2a363c5ed84a84b2e4f00c8aa3b34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:37.402405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7eb22443-4fbb-4908-8e8b-f73c09af92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:37.410207 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4445/8852] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:37.422272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:37.423645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:37.504150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e44b6-4514-4608-92e0-c09c57b57d64 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:37.510026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:37.510684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:37.510969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:37.511247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:37.516241 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:37.520684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:37.523739 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34283ddc-9de0-4988-9f3c-85738cc60dd7 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:37.533917 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4408/8853] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:47.394775 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=17 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:47.529567 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:01:49.516074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:49.516621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:49.516621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:49.518036 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4446/8854] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:01:49.524232 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:49.524759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:49.524869 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:49.573312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:01:49.574541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:49.645553 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4409/8855] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:01:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:01:49.666497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:49.668204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:49.687926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f0614-9865-4f7f-83b2-d366d24e08c3 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:49.692888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:49.693519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:49.694296 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:49.694579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:49.703750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:49.705323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:49.715179 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4447/8856] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:50.590610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:50.604372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66062f-16e0-4190-9c58-5200cbb2776c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:50.609968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:50.610620 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:50.610904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:50.611182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:50.612961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:50.628131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:50.629843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397552b-47da-4ef1-8003-9585f4ab9cdf service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:50.643740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4410/8857] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:01:55.410194 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:01:55.411612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:55.428578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108590-de3d-4132-93af-e9852d437aa1 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:01:55.434468 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:01:55.435119 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:01:55.435402 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:01:55.435678 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:01:55.437496 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:01:55.453971 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:01:55.457041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:01:55.473039 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4448/8858] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:01:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:02:00.636679 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=49 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:05.466366 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:31.648196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b154e-d92e-4fcf-8f8c-c8d7521c3b9e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:31.648687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b154e-d92e-4fcf-8f8c-c8d7521c3b9e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:31.648794 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b154e-d92e-4fcf-8f8c-c8d7521c3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:31.667342 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0e8b154e-d92e-4fcf-8f8c-c8d7521c3b9e None None] MFA Rules not processed for user `0c2a363c5ed84a84b2e4f00c8aa3b34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:02:31.668543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0e8b154e-d92e-4fcf-8f8c-c8d7521c3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:02:31.676600 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4411/8859] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:02:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:02:32.235813 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:02:32.250478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a688a-5f8e-4b0b-89e2-6ad6d51c763a service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:02:32.255488 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:02:32.256134 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:32.256417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:32.256692 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:32.258502 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:02:32.271622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:02:32.273188 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fbae5-0921-49b1-9dbf-5fbada4e4b15 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:02:32.284024 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4449/8860] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:02:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:02:41.662266 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:42.279653 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:45.835026 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cbd6-83cd-457e-8a09-cad88d8721a7 None None] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:45.835595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cbd6-83cd-457e-8a09-cad88d8721a7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:45.835595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01cbd6-83cd-457e-8a09-cad88d8721a7 None None] PATH_INFO: `/` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:45.836954 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4412/8861] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 02:02:45.842098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:45.842529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:45.842908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:45.861654 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:02:45.862903 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:02:45.872987 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4450/8862] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:02:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:02:45.893915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01cbd6-83cd-457e-8a09-cad88d8721a7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:02:45.910889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01cbd6-83cd-457e-8a09-cad88d8721a7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:02:45.915708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:02:45.916335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:45.916614 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:45.916885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:45.925097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:02:45.926695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:02:45.937060 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4413/8863] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:02:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:02:46.150601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:02:46.165090 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cebab2-fe71-4a10-bcbb-a1d32b1c47d0 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:02:46.171385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:02:46.172034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:02:46.172318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:02:46.172593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:02:46.174428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:02:46.186708 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:02:46.188283 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:02:46.198231 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4451/8864] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:02:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:02:55.932289 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:02:56.194081 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:27.066611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.078613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144d825-fc60-4bee-84c1-09901d481a63 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.083216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.084119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.084397 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.084672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] PATH_INFO: `/v3/users/0c2a363c5ed84a84b2e4f00c8aa3b34f` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.086024 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2a363c5ed84a84b2e4f00c8aa3b34f)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.087976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.141612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2a363c5ed84a84b2e4f00c8aa3b34f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.150133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2a363c5ed84a84b2e4f00c8aa3b34f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.158301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2a363c5ed84a84b2e4f00c8aa3b34f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.171021 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2a363c5ed84a84b2e4f00c8aa3b34f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.171623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-347c4231-22c0-413e-a64f-e66fa4a655f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2a363c5ed84a84b2e4f00c8aa3b34f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.177644 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4414/8865] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:03:27 2022] DELETE /identity/v3/users/0c2a363c5ed84a84b2e4f00c8aa3b34f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:03:27.351265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.367101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b312abe-9708-4bb0-94a9-6f061ee249e2 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.427943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.428808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.429094 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.429374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] PATH_INFO: `/v3/projects/017ae15508e74480a8c6ced05bf424df` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.430609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=017ae15508e74480a8c6ced05bf424df)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.432516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.479002 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017ae15508e74480a8c6ced05bf424df', 'request_id': 'req-3f669b6a-30dd-4569-a111-d611a0e0a4ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.484486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017ae15508e74480a8c6ced05bf424df', 'request_id': 'req-3f669b6a-30dd-4569-a111-d611a0e0a4ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.491556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017ae15508e74480a8c6ced05bf424df', 'request_id': 'req-3f669b6a-30dd-4569-a111-d611a0e0a4ee'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.502762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] The token cache is being invalidate because project 017ae15508e74480a8c6ced05bf424df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:03:27.503052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.503697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3f669b6a-30dd-4569-a111-d611a0e0a4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:03:27.505252 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4452/8866] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:03:27 2022] DELETE /identity/v3/projects/017ae15508e74480a8c6ced05bf424df => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:03:27.510373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.510664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.510945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.530427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:27.531667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:27.591247 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4415/8867] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:27.599076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.599316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.599599 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.618275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:27.619482 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:27.628160 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4453/8868] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:27.632359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.642950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f19d3-cf6c-441d-877c-db0a12dfcc8c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.647586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.648242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.648529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.648837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.649564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:03:27.650144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.651511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.663327 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4416/8869] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:03:27.667573 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.677044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a379c0d-0d96-47cb-a981-e0814de81f7f None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.681661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.682331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.682611 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.682881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.683574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.686004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.711396 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4454/8870] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:03:27 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:03:27.715678 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.726463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a4bff-a269-4077-95b5-418a65fb52ee admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.783260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.783925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.784208 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.784485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.785172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.787124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.793581 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:27.808211 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4417/8871] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:03:27 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:03:27.812773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.823507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b796-6479-449f-8230-a935abab60a1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.829038 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.829724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.830042 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.830320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.831051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.832659 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.842993 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4455/8872] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 02:03:27.846834 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.856830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c76d-522d-44df-8daa-313b21c5375c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.861573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.862282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.862565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.862839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.863636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.865498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b476-1eff-4ad5-9079-b2e71b0fda1a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.877974 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4418/8873] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:03:27.882054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:27.893047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43325-3cbd-4cec-9e0e-f928b0dd95d5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:27.897615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:27.898511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.898791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.899066 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] PATH_INFO: `/v3/projects/65afddc02ce0461988f64f41f706be14/users/4ca622718e5c42dc9a71b80fca387e66/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.913285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65afddc02ce0461988f64f41f706be14, user_id=4ca622718e5c42dc9a71b80fca387e66, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:27.915949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:27.928770 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4456/8874] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:03:27 2022] PUT /identity/v3/projects/65afddc02ce0461988f64f41f706be14/users/4ca622718e5c42dc9a71b80fca387e66/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:03:27.933974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a44f7-5089-4abc-8bea-1a69b6551b28 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:27.934521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a44f7-5089-4abc-8bea-1a69b6551b28 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:27.934860 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a44f7-5089-4abc-8bea-1a69b6551b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:27.953563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f51a44f7-5089-4abc-8bea-1a69b6551b28 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:27.954801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f51a44f7-5089-4abc-8bea-1a69b6551b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:28.014626 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4419/8875] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:28.024358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:28.026099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:28.057279 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:28.086307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035547b-67f2-4ab4-8cc5-7e7b557cff29 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:28.089932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:28.090571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:28.090851 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:28.091125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:28.100308 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:28.101896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:28.112116 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4457/8876] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:03:32.176572 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094844-7de8-4798-b479-c18748720e97 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:32.177061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094844-7de8-4798-b479-c18748720e97 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:32.177150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094844-7de8-4798-b479-c18748720e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:32.205787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-da094844-7de8-4798-b479-c18748720e97 None None] MFA Rules not processed for user `4ca622718e5c42dc9a71b80fca387e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:32.207025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-da094844-7de8-4798-b479-c18748720e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:32.290388 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4420/8877] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:03:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:32.305405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:32.306870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:32.390806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5836e-db8a-49f7-8a20-160896d14e6a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:32.396872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:32.397543 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:32.397866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:32.398149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:32.407062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:32.408684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4a85-5e9f-4b04-8209-b1e212a96446 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:32.418575 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4458/8878] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:03:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:03:33.790840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:33.791369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:33.791475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:33.810436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] MFA Rules not processed for user `4ca622718e5c42dc9a71b80fca387e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:33.811695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:33.818901 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4421/8879] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:03:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:42.414017 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=48 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:43.804483 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:03:52.587670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8182eb-7b38-4fb8-aa43-f6260b14c1a7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:52.588141 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8182eb-7b38-4fb8-aa43-f6260b14c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:52.588215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8182eb-7b38-4fb8-aa43-f6260b14c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:52.606027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cc8182eb-7b38-4fb8-aa43-f6260b14c1a7 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:03:52.607871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc8182eb-7b38-4fb8-aa43-f6260b14c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:52.670737 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4459/8880] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jul 24 02:03:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:03:52.683639 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:03:52.684998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:03:52.702529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89916-11bc-407e-8b78-b2902e73f9fa None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:03:52.707470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:03:52.708107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:03:52.708388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:03:52.708665 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:03:52.717663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:03:52.719264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ae97-76ad-44a9-b8ea-6db4c81b98c5 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:03:52.728850 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4422/8881] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:03:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:04:02.661385 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=29 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:02.724805 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:19.288465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94298-16f9-4ccf-9635-19018df10f14 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:19.289020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94298-16f9-4ccf-9635-19018df10f14 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:19.289020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94298-16f9-4ccf-9635-19018df10f14 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:19.290448 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4460/8882] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 02:04:19.295817 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:19.296277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:19.296388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:19.314247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:04:19.315452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:19.324520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4423/8883] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:04:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:04:19.344864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c941-91ca-430b-bd7c-0055a58f930a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:19.345152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c941-91ca-430b-bd7c-0055a58f930a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:19.345427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c941-91ca-430b-bd7c-0055a58f930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:19.363825 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5661c941-91ca-430b-bd7c-0055a58f930a None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:04:19.365262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5661c941-91ca-430b-bd7c-0055a58f930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:19.373856 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4461/8884] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Jul 24 02:04:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:04:19.379822 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:04:19.391792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f16f2-3521-4317-9466-bcfe845a0d57 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:04:19.397145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:04:19.397828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:19.398112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:19.398390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:19.407538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:04:19.409120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:04:19.420135 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4424/8885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:04:19.954529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:19.955128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:19.955415 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:19.975545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:04:19.976749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:19.985416 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4462/8886] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 24 02:04:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:04:19.997106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:04:20.011622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c077-8be1-4180-a73f-aa109d8c8610 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:04:20.017335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:04:20.018015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:20.018301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:20.018574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:20.027311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:04:20.029157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fa92a-e243-4238-a3fd-8b873a9d0c3e service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:04:20.039056 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4425/8887] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:04:29.969017 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:30.034886 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=15 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:33.769342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:04:33.770881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:33.790295 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85820e7-bdf6-4a91-9b52-63a2e960e12a None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:04:33.795879 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:04:33.796536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:33.796822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:33.797101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:33.798873 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:33.816643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:04:33.818476 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:04:33.834738 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4463/8888] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:04:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:04:43.508780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:04:43.509237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:04:43.509327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:04:43.527074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] MFA Rules not processed for user `4ca622718e5c42dc9a71b80fca387e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:04:43.528316 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:04:43.535298 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4426/8889] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:04:43.827037 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:04:53.521722 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:05:59.041980 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:05:59.043484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:05:59.055537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1ef7-1e80-4cd7-920a-ca574e049439 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:05:59.059247 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:05:59.059882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:05:59.060166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:05:59.060445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:05:59.062200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:05:59.079530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:05:59.080961 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:05:59.095092 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4464/8890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:05:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:00.272568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:00.282868 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc154-e30d-4c78-99b0-c0d5d636c13e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:00.286475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:00.287111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:00.287395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:00.287670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:00.289432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:00.306119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:00.307557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:00.322026 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4427/8891] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:02.936442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:02.945544 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51ea64-15d9-455d-8b00-6277a4d1ce3e service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:02.949187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:02.949846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:02.950127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:02.950399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:02.952149 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:02.964809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:02.966273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a3f2-36e2-472e-ae15-fd4134dbeab1 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:02.976930 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4465/8892] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:09.983095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:09.993154 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df636-c1fb-4b17-bd91-7e7214e48a29 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:09.996770 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:09.997414 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:09.997720 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:09.998002 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:09.999940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:10.013113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:10.014630 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3a9a-e802-4e5a-a107-b082e7afafa7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:10.026351 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4428/8893] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:10.106852 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfc1-5023-4e0f-9990-b3f6ee7da8a1 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:10.107360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfc1-5023-4e0f-9990-b3f6ee7da8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:10.107459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfc1-5023-4e0f-9990-b3f6ee7da8a1 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:10.108813 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4466/8894] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:06:10.113953 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:10.114245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:10.114784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:10.133252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:10.134478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:10.143488 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4429/8895] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:06:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:06:10.164021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cfc1-5023-4e0f-9990-b3f6ee7da8a1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:10.182170 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cfc1-5023-4e0f-9990-b3f6ee7da8a1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:10.187410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:10.188045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:10.188327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:10.188632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:10.197637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:10.199261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f00d5-7c4d-4f58-a5fe-0cdfeba89c30 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:10.209762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4467/8896] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:10.367326 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:10.377568 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b03cf3-89ff-4794-94a2-4888cf3535ae None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:10.381228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:10.381925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:10.382211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:10.382485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:10.384243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:10.400696 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:10.402167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb169-9320-4778-a22e-3578fa1ff036 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:10.415450 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4430/8897] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:11.158765 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a867bd5-53c9-4ec4-a44e-78393f363d23 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:11.159294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a867bd5-53c9-4ec4-a44e-78393f363d23 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:11.159294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a867bd5-53c9-4ec4-a44e-78393f363d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:11.199186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6a867bd5-53c9-4ec4-a44e-78393f363d23 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:11.200394 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6a867bd5-53c9-4ec4-a44e-78393f363d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:11.210802 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4468/8898] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 02:06:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:06:12.386214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:12.386701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:12.386701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:12.404980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:12.406220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:12.416253 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4431/8899] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Jul 24 02:06:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:06:18.678285 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a2bd-3ec3-4b24-a0d9-ec8f5d4e4f21 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:18.678826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a2bd-3ec3-4b24-a0d9-ec8f5d4e4f21 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:18.678826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4a2bd-3ec3-4b24-a0d9-ec8f5d4e4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:18.700167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-35f4a2bd-3ec3-4b24-a0d9-ec8f5d4e4f21 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:18.701517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-35f4a2bd-3ec3-4b24-a0d9-ec8f5d4e4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:18.710817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4469/8900] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:06:18.722386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:18.731618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428ae05-244e-4738-aba8-46f1ac5d8dad None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:18.735187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:18.736401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:18.736683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:18.736959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:18.747640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:18.749081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:18.760693 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4432/8901] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:18.926789 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:18.927080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:18.927357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:18.945125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:18.946347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:18.957340 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4470/8902] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:06:18.968656 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:18.978191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022bed-e976-4999-9e80-4f5600b3288a service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:18.981912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:18.982543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:18.982826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:18.983104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:18.994493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:18.995935 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa5620-726d-49aa-a434-72f63a96388f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:19.007457 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4433/8903] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:19.439312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:19.454443 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87aedc0-a987-40ba-95ec-c5138da32909 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:19.461655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:19.462452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:19.462831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:19.463199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:19.465162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:19.481633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:19.483583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:19.500476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4471/8904] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:23.148565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724af19-7a5a-425e-8523-37f310424025 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:23.149129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724af19-7a5a-425e-8523-37f310424025 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:23.149129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724af19-7a5a-425e-8523-37f310424025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:23.167623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-c724af19-7a5a-425e-8523-37f310424025 None None] MFA Rules not processed for user `4ca622718e5c42dc9a71b80fca387e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:23.168838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c724af19-7a5a-425e-8523-37f310424025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:23.176257 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4434/8905] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:06:23.490814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:23.500422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8f38-296c-4b1d-9587-802f1470001c service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:23.504333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:23.505041 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:23.505390 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:23.505785 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:23.507635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:23.521016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:23.523238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a3e7-fad4-4ad4-98fa-55f6fe777382 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:23.537038 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4472/8906] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:26.288904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724af19-7a5a-425e-8523-37f310424025 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:26.299515 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=40 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:26.306249 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724af19-7a5a-425e-8523-37f310424025 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:26.315845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:26.316753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:26.317286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:26.317565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:26.321081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:26.343867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:26.346256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:26.364375 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4435/8907] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:33.529021 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=45 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:36.357999 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:36.987234 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8befee0-3bdd-4a8b-84da-5ec2339c0b5c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:36.987740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8befee0-3bdd-4a8b-84da-5ec2339c0b5c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:36.987834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8befee0-3bdd-4a8b-84da-5ec2339c0b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:37.006587 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-c8befee0-3bdd-4a8b-84da-5ec2339c0b5c None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:06:37.007929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c8befee0-3bdd-4a8b-84da-5ec2339c0b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:06:37.018103 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4473/8908] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:06:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:06:37.030891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:06:37.042670 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0370-ca23-47e5-8a10-4438428a9ca1 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:06:37.048220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:06:37.048969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:06:37.049251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:06:37.049523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:06:37.058728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:06:37.060398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:06:37.071323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4436/8909] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:06:47.001497 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:06:47.066942 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:04.903126 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871e783-38d6-4b51-a18d-c994e7b4fb03 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:04.903620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871e783-38d6-4b51-a18d-c994e7b4fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:04.903764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871e783-38d6-4b51-a18d-c994e7b4fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:04.943219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6871e783-38d6-4b51-a18d-c994e7b4fb03 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:04.944418 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6871e783-38d6-4b51-a18d-c994e7b4fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:04.970712 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4474/8910] 10.222.0.60 () {58 vars in 1015 bytes} [Sun Jul 24 02:07:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:07:04.983566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:05.003111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6af2-48e3-4a2d-9798-4476ebd63de6 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:05.007702 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:05.008379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:05.008660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:05.008937 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:05.016129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:05.017560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:05.025957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4437/8911] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:07:14.968665 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=20 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:15.022505 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=11 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:38.866261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad485ff-0f18-4b87-8699-1175f3c385d7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:38.866836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad485ff-0f18-4b87-8699-1175f3c385d7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:38.866990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad485ff-0f18-4b87-8699-1175f3c385d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:38.885625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6ad485ff-0f18-4b87-8699-1175f3c385d7 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:38.886950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6ad485ff-0f18-4b87-8699-1175f3c385d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:38.894302 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4475/8912] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:07:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:07:38.906616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:38.915688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc0e63-f829-40d5-8023-98c948caaf3b service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:38.919400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:38.920039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:38.920371 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:38.920648 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:38.928081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:38.929513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b2735-6eac-45e5-b026-bcd80e5452a2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:38.938021 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4438/8913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:07:39.020752 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf69cc-e18a-426c-8f41-972b9880f455 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:39.021047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf69cc-e18a-426c-8f41-972b9880f455 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:39.021366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf69cc-e18a-426c-8f41-972b9880f455 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:39.022811 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4476/8914] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:07:39.027364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162460eb-6b8e-4c89-8d75-5e891fb2f9e3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:39.027649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162460eb-6b8e-4c89-8d75-5e891fb2f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:39.027924 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162460eb-6b8e-4c89-8d75-5e891fb2f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:39.057262 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-162460eb-6b8e-4c89-8d75-5e891fb2f9e3 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:39.058475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-162460eb-6b8e-4c89-8d75-5e891fb2f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:39.086559 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4439/8915] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:07:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:07:39.107236 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf69cc-e18a-426c-8f41-972b9880f455 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:39.122639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf69cc-e18a-426c-8f41-972b9880f455 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:39.127745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:39.129060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:39.129470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:39.129783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:39.138689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:39.140293 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:39.150337 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4477/8916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:07:49.080621 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=23 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:49.146255 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:07:52.781500 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb4d1-0f78-4c7a-a404-7318365d32b8 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:52.782082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb4d1-0f78-4c7a-a404-7318365d32b8 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:52.782082 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb4d1-0f78-4c7a-a404-7318365d32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:52.800537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-82dfb4d1-0f78-4c7a-a404-7318365d32b8 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:52.801881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82dfb4d1-0f78-4c7a-a404-7318365d32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:52.808546 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4440/8917] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jul 24 02:07:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:07:52.820586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:52.829784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729fae6-98a1-4ae3-93e6-5ecf8f4adf94 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:52.833320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:52.833982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:52.834258 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:52.834531 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:52.841478 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:52.842932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:52.850689 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4478/8918] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:07:53.254426 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0277-fbea-45c9-bde2-261eb959ca2d None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:53.255399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0277-fbea-45c9-bde2-261eb959ca2d None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:53.255876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0277-fbea-45c9-bde2-261eb959ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:53.275849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-88ad0277-fbea-45c9-bde2-261eb959ca2d None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:53.277078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-88ad0277-fbea-45c9-bde2-261eb959ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:53.287830 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4441/8919] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:07:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:07:53.309382 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:53.329451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2927-2c9d-422c-a9aa-3852a910d89e service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:53.335698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:53.336355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:53.336644 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:53.336925 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:53.346886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:53.348498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:53.361186 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4479/8920] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:07:58.053936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358691-18ba-4b04-9c7c-34d513797ff4 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:58.054431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358691-18ba-4b04-9c7c-34d513797ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:58.054699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358691-18ba-4b04-9c7c-34d513797ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:58.078307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-5b358691-18ba-4b04-9c7c-34d513797ff4 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:07:58.079664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5b358691-18ba-4b04-9c7c-34d513797ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:07:58.090625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4442/8921] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:07:58.107950 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:07:58.125602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd79b-1025-4f34-948e-2399369b5da1 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:07:58.132898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:07:58.133550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:07:58.133871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:07:58.134150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:07:58.143715 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:07:58.146409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed893-3bce-4717-896c-f999e7fc8c4a service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:07:58.156850 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4480/8922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:08:08.073112 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:08.152621 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=18 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:09.312522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:08:09.313019 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:08:09.313124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:08:09.330940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] MFA Rules not processed for user `4ca622718e5c42dc9a71b80fca387e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:08:09.332842 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:08:09.340000 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4443/8923] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:08:09.641812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:08:09.642316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:08:09.642316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:08:09.659694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:08:09.661219 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:08:09.667589 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4481/8924] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:08:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:08:09.679498 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:08:09.689201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21c8c3-5ed1-440f-aede-2cdccca7aa21 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:08:09.693469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:08:09.694151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:08:09.694439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:08:09.694722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:08:09.702030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:08:09.703463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:08:09.711566 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4444/8925] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:08:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:08:10.045036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:08:10.058069 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849b7fc-f801-4b60-9bf0-658aea26035d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:08:10.062983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:08:10.063632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:08:10.063911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:08:10.064180 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:08:10.065970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:08:10.077995 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:08:10.079674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee531af4-648f-40e2-87e5-dc7d4df4d5c3 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:08:10.090414 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4482/8926] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:08:19.708047 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:20.085813 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:08:55.548436 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:08:55.560903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae84b07-12ba-4a20-94ee-c1dfdb6c95ac service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:08:55.565908 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:08:55.566536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:08:55.566819 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:08:55.567093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:08:55.576062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:08:55.577631 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:08:55.587486 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4445/8927] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:08:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:09:05.583227 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:25.504062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3f47-92ef-44ba-b557-779db7401d23 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:25.504500 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3f47-92ef-44ba-b557-779db7401d23 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:25.504598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3f47-92ef-44ba-b557-779db7401d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:25.552839 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-e3bb3f47-92ef-44ba-b557-779db7401d23 None None] MFA Rules not processed for user `5a901a3ca2b749adb54c7b99a7ff1e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:09:25.554081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e3bb3f47-92ef-44ba-b557-779db7401d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:09:25.614099 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4483/8928] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Jul 24 02:09:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:09:25.620431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:09:25.629432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaec07-a6a9-48be-ad2e-d1134fa56765 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:09:25.633048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:09:25.633714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:25.633994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:25.634272 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:25.642567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:09:25.644000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88d360-725b-4d0c-8c4b-bc269843ea76 service cinder] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:09:25.653700 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4446/8929] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:09:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:09:35.610785 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=38 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:35.648806 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:38.332237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41428d1-7a34-419d-87d7-c378860ec87b None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:38.332782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41428d1-7a34-419d-87d7-c378860ec87b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:38.332782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41428d1-7a34-419d-87d7-c378860ec87b None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:38.334291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4484/8930] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:09:38.339964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:38.340446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:38.340546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:38.358609 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:09:38.359829 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:09:38.369509 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4447/8931] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:09:38.390381 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:38.390675 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:38.390958 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:38.409362 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:09:38.410598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:09:38.419286 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4485/8932] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Jul 24 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:09:38.425052 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:09:38.436170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d4340-f251-480c-8fdd-7766361b74c2 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:09:38.441255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:09:38.441940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:38.442225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:38.442527 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:38.451668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:09:38.453253 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:09:38.463228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4448/8933] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:09:38.674815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:09:38.686115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3a903-0087-4092-95f8-9541196eb877 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:09:38.691501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:09:38.692147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:09:38.692434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:09:38.692808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:09:38.694645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:09:38.706222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:09:38.707794 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:09:38.717811 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4486/8934] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:09:48.458932 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:09:48.713756 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=9 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:03.408023 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:03.419042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5f0f-3d58-4ccf-98fa-f8aaf7d570a5 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:03.424155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:03.424810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:03.425091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:03.425364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:03.434936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:03.436544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd482f6-c520-41c6-9980-fcf7c9c1b915 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:03.447952 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4449/8935] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:10:13.442890 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:46.498129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:46.517196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8860bc-5953-42bf-816e-6e0f3d0b6649 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:46.520706 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:46.521338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:46.521621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:46.521926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:46.531131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:46.532568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:46.561008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4487/8936] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:10:49.429548 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:49.430062 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:49.430170 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:49.463428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:49.464976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:49.475326 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4450/8937] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:10:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:49.513910 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:49.527192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030f159-9aec-4655-b508-c80221c2c0b6 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:49.530577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:49.533014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:49.533701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:49.533992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:49.534444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:49.544377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:49.546020 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:49.555384 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba724e-7f39-4820-8529-9ff977995239 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:49.558008 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4488/8938] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:10:49.561390 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:49.562339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:49.562621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:49.562895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] PATH_INFO: `/v3/users/4ca622718e5c42dc9a71b80fca387e66` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:49.564142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca622718e5c42dc9a71b80fca387e66)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:49.566115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:49.617651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca622718e5c42dc9a71b80fca387e66'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.625368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca622718e5c42dc9a71b80fca387e66'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.632235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca622718e5c42dc9a71b80fca387e66'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.646825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca622718e5c42dc9a71b80fca387e66'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.647582 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-d71f3db1-fd3a-45bc-b7ce-b1ce0a10a035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca622718e5c42dc9a71b80fca387e66'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.654729 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4451/8939] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:10:49 2022] DELETE /identity/v3/users/4ca622718e5c42dc9a71b80fca387e66 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:10:49.836816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:49.848609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ab5-d34e-4a29-ac57-83835f91bee8 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:49.905866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:49.906735 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:49.907018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:49.907297 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] PATH_INFO: `/v3/projects/65afddc02ce0461988f64f41f706be14` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:49.908480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65afddc02ce0461988f64f41f706be14)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:49.910454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:49.957511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65afddc02ce0461988f64f41f706be14', 'request_id': 'req-8c8cd8e2-1b99-4db3-940e-1a218d213c15'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.964068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65afddc02ce0461988f64f41f706be14', 'request_id': 'req-8c8cd8e2-1b99-4db3-940e-1a218d213c15'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.971626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65afddc02ce0461988f64f41f706be14', 'request_id': 'req-8c8cd8e2-1b99-4db3-940e-1a218d213c15'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.995047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] The token cache is being invalidate because project 65afddc02ce0461988f64f41f706be14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:10:49.995334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.995960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-8c8cd8e2-1b99-4db3-940e-1a218d213c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:10:49.997506 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4489/8940] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:10:49 2022] DELETE /identity/v3/projects/65afddc02ce0461988f64f41f706be14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:10:50.002511 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.002799 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.003073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.049949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:50.051199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:50.111579 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4452/8941] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:50.120248 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.120540 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.120823 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.138507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:50.139691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:50.147630 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4490/8942] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:50.152313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.161925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3ea7-4319-4050-ba7d-194e1d2bf904 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.167115 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.167761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.168040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.168311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.169032 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:10:50.169333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.170957 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.182573 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4453/8943] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:10:50.186902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.196225 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a122c1-a4b3-4590-9cd3-7d165bb63b04 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.200939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.201586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.201918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.202199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.202949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.204848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.224920 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:50.242869 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4491/8944] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:10:50 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:10:50.247072 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.256885 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f7b01-b620-4390-abf6-44bd3a6e5d35 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.285339 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:50.314742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.315399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.315682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.315956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.316651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.318597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.338409 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4454/8945] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:10:50 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:10:50.342569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.352684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ed2f-4ecf-45e7-94de-c4fdce2769de admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.357483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.358172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.358452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.358724 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.359444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.361030 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.371696 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4492/8946] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:10:50.375524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.386196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1daebb-f217-435b-90e3-ffba79fe451c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.390796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.391446 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.391726 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.392000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.392750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.394373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b399-5494-4ea1-84ae-73f426a189ba admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.404181 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4455/8947] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:10:50.408165 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.418703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cce15-d142-49ec-a928-82e335e5fd91 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.423352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.424227 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.424515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.424824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] PATH_INFO: `/v3/projects/5aced8671cd34fd5bbc3f9e8a0e08a4a/users/b9da4dd8be354487bd7e6ea155c3aadb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.440006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aced8671cd34fd5bbc3f9e8a0e08a4a, user_id=b9da4dd8be354487bd7e6ea155c3aadb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.442728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.455089 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4493/8948] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:10:50 2022] PUT /identity/v3/projects/5aced8671cd34fd5bbc3f9e8a0e08a4a/users/b9da4dd8be354487bd7e6ea155c3aadb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:10:50.460169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7486-b9a6-4a93-b593-54c2816386a6 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.460640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7486-b9a6-4a93-b593-54c2816386a6 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.460750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7486-b9a6-4a93-b593-54c2816386a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.479359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-05da7486-b9a6-4a93-b593-54c2816386a6 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:50.480554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-05da7486-b9a6-4a93-b593-54c2816386a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:50.538340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4456/8949] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:50.548911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:50.550743 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:50.621542 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7773-99b0-4a87-9750-f58d985ae45f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:50.625190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:50.625877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:50.626156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:50.626427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:50.635570 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:50.636988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18306dc9-7fdd-4250-95a8-c1673fac712a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:50.646462 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4494/8950] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:10:54.774540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:54.775844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:54.775844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:54.803424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] MFA Rules not processed for user `b9da4dd8be354487bd7e6ea155c3aadb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:54.804839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:54.882909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4457/8951] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:54.893521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512a4e5-d7e6-40c6-aa49-10ffa76b5041 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:54.894075 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512a4e5-d7e6-40c6-aa49-10ffa76b5041 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:54.894168 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512a4e5-d7e6-40c6-aa49-10ffa76b5041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:54.913091 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6512a4e5-d7e6-40c6-aa49-10ffa76b5041 None None] MFA Rules not processed for user `b9da4dd8be354487bd7e6ea155c3aadb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:54.914316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6512a4e5-d7e6-40c6-aa49-10ffa76b5041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:54.921472 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4495/8952] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:10:54.933768 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:54.935333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:54.983094 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:10:55.048276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048bc77-7c20-4e65-a65d-f6d6b4871f61 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:55.054269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:55.054960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:55.055300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:55.055588 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:55.064982 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:55.066616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:55.076836 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4458/8953] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:10:55.340151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d43426-53af-43f9-ac36-ec2cef925f55 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:55.340151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d43426-53af-43f9-ac36-ec2cef925f55 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:55.340360 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d43426-53af-43f9-ac36-ec2cef925f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:55.379128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-23d43426-53af-43f9-ac36-ec2cef925f55 None None] MFA Rules not processed for user `c3abde5d3aa4477c972e6be521345741`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:10:55.380370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-23d43426-53af-43f9-ac36-ec2cef925f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:10:55.387503 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4496/8954] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:10:55.399278 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:10:55.408606 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76421-2e82-4b63-8848-05d27da8a617 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:10:55.412228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:10:55.412866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:10:55.413153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:10:55.413428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:10:55.421512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:10:55.422990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:10:55.431765 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4459/8955] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:10:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:05.376458 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:05.428081 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=34 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:06.473647 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:06.474152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:06.474263 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:06.491779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] MFA Rules not processed for user `b9da4dd8be354487bd7e6ea155c3aadb`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:06.493469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:06.500211 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4497/8956] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:16.486301 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:18.831686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:18.841306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75aa7-5030-4317-b8ea-9d5295d01d29 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:18.846354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:18.847031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:18.847317 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:18.847595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:18.849389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:18.866078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:18.867520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:18.880106 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4460/8957] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:20.327843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:20.338361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37a31-9e83-4fba-8f07-4c519bed35b1 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:20.342022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:20.342687 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:20.342974 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:20.343254 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:20.345036 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:20.359351 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:20.360783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:20.372993 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4498/8958] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:28.875490 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:30.368022 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:31.035839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.046675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439fca1-b2fb-43cb-b34a-f45d8937c149 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.051234 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.052120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.052393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.052688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] PATH_INFO: `/v3/users/b9da4dd8be354487bd7e6ea155c3aadb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.053925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9da4dd8be354487bd7e6ea155c3aadb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.056520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.103422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9da4dd8be354487bd7e6ea155c3aadb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.110481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9da4dd8be354487bd7e6ea155c3aadb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.120413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9da4dd8be354487bd7e6ea155c3aadb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.132738 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9da4dd8be354487bd7e6ea155c3aadb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.134128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b5e4204f-db70-4e30-b0b3-232504c8d033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9da4dd8be354487bd7e6ea155c3aadb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.140061 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4461/8959] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:11:31 2022] DELETE /identity/v3/users/b9da4dd8be354487bd7e6ea155c3aadb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:31.318000 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.337268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6ea8a-97f5-44aa-93b7-ac2c5ef1aa92 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.401832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.402722 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.402999 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.403271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] PATH_INFO: `/v3/projects/5aced8671cd34fd5bbc3f9e8a0e08a4a` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.404448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aced8671cd34fd5bbc3f9e8a0e08a4a)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.406414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.451680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'request_id': 'req-4f9e3996-6be2-4665-abc6-175c94f43d29'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.457050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'request_id': 'req-4f9e3996-6be2-4665-abc6-175c94f43d29'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.464938 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aced8671cd34fd5bbc3f9e8a0e08a4a', 'request_id': 'req-4f9e3996-6be2-4665-abc6-175c94f43d29'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.475821 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] The token cache is being invalidate because project 5aced8671cd34fd5bbc3f9e8a0e08a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:11:31.476109 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.477140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4f9e3996-6be2-4665-abc6-175c94f43d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:31.478845 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4499/8960] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:11:31 2022] DELETE /identity/v3/projects/5aced8671cd34fd5bbc3f9e8a0e08a4a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:31.483977 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf474e-8078-4579-8789-6b026b429489 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.484297 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf474e-8078-4579-8789-6b026b429489 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.484764 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf474e-8078-4579-8789-6b026b429489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.503491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-26bf474e-8078-4579-8789-6b026b429489 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:31.504683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26bf474e-8078-4579-8789-6b026b429489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:31.562009 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4462/8961] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:31.569782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.570073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.570869 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.590262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:31.591452 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:31.599378 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4500/8962] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:31.603364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf474e-8078-4579-8789-6b026b429489 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.612979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf474e-8078-4579-8789-6b026b429489 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.617958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.618711 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.618999 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.619359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.620180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:11:31.620486 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.622147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.635191 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4463/8963] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:11:31.639266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.649031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5245c-50e4-4b2d-b8e9-f34eaaed575e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.653648 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.654333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.654613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.654886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.655590 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.657459 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.683896 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4501/8964] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:11:31 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:31.688054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.699142 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9cd3e-c2cf-4ad0-9fd2-1da9ade28e43 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.755944 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.756538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.756821 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.757096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.758412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.760332 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.766842 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:31.781127 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4464/8965] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:11:31 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:31.785427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.796023 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b7d1-31b3-4b85-abae-8b1d23c93522 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.800625 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.801280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.801566 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.801874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.802651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.804250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.816710 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4502/8966] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:31.821573 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.831918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0270-b386-4bdb-96c2-3bffe8b94683 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.836962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.837625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.837945 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.838240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.839118 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.840723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021586d5-a4da-432b-8eb0-8d545211e322 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.850692 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4465/8967] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:31.854887 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:31.864843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42693f8-f7a9-44de-a550-607b8a7bf3b9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:31.870275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:31.871143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.871421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.871695 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] PATH_INFO: `/v3/projects/d6a2e8a1e16b4d07b8daae74ed6eb324/users/4671a40573454b4792309d5cb559b214/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.886583 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a2e8a1e16b4d07b8daae74ed6eb324, user_id=4671a40573454b4792309d5cb559b214, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:31.889214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:31.900998 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4503/8968] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:11:31 2022] PUT /identity/v3/projects/d6a2e8a1e16b4d07b8daae74ed6eb324/users/4671a40573454b4792309d5cb559b214/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:31.911095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344543-a21b-4db3-8be4-e1f8d1533808 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:31.911391 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344543-a21b-4db3-8be4-e1f8d1533808 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:31.911699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344543-a21b-4db3-8be4-e1f8d1533808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:31.938828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7f344543-a21b-4db3-8be4-e1f8d1533808 None None] MFA Rules not processed for user `4671a40573454b4792309d5cb559b214`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:31.940045 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7f344543-a21b-4db3-8be4-e1f8d1533808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:32.010467 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4466/8969] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:32.020586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:32.022305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:32.052462 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:32.082357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c571aa-7327-4796-ae0a-e5ce5451df17 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:32.086359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:32.086968 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:32.087257 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:32.087537 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:32.096145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:32.097581 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:32.107136 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4504/8970] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:38.144184 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:38.145148 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:38.145468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:38.165468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:38.166874 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:38.240193 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4467/8971] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:38.252896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:38.254952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:38.273044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781e445-8eca-4277-a8ee-7a7067ab8d65 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:38.278255 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:38.278907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:38.279186 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:38.279456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:38.289798 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:38.291799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b7468-4ec1-4616-ab59-0fa681666e5f service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:38.302922 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4505/8972] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:45.134421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.200938 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6a866-0fea-40c5-9421-820265fbb6ff None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.205753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:45.206642 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.206925 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.207230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] PATH_INFO: `/v3/users/4671a40573454b4792309d5cb559b214` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.208474 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4671a40573454b4792309d5cb559b214)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:45.210462 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:45.216219 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:45.264524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4671a40573454b4792309d5cb559b214'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.271848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4671a40573454b4792309d5cb559b214'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.280122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4671a40573454b4792309d5cb559b214'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.293562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4671a40573454b4792309d5cb559b214'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.294227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4671a40573454b4792309d5cb559b214'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.300677 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4468/8973] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:11:45 2022] DELETE /identity/v3/users/4671a40573454b4792309d5cb559b214 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:45.305007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.305547 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.305721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.322518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:45.323736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:45.387065 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4506/8974] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:45.396769 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.398266 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:45.457987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0823d6e-6b84-4509-966d-3f2133a8e1d3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.461728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:45.463014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.463300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.463579 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.472679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:45.474157 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310219e-260e-40c0-81de-3f1c3cd9a1ed service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:45.484642 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4469/8975] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:45.662516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.664035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:45.678237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815ee4-e493-4faf-8fe0-1628bf902bc7 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.683620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:45.684501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.684788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.685087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] PATH_INFO: `/v3/projects/d6a2e8a1e16b4d07b8daae74ed6eb324` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.686342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a2e8a1e16b4d07b8daae74ed6eb324)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:45.688259 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:45.734404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a2e8a1e16b4d07b8daae74ed6eb324', 'request_id': 'req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.739864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a2e8a1e16b4d07b8daae74ed6eb324', 'request_id': 'req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.747876 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a2e8a1e16b4d07b8daae74ed6eb324', 'request_id': 'req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.758784 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] The token cache is being invalidate because project d6a2e8a1e16b4d07b8daae74ed6eb324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:11:45.759079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.759705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-b2ad249d-fe6b-487a-b8cc-834794b3f0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:45.761281 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4507/8976] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:11:45 2022] DELETE /identity/v3/projects/d6a2e8a1e16b4d07b8daae74ed6eb324 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:45.766421 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.766731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.767009 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.784216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:45.785432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:45.846621 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4470/8977] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:45.855025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.855317 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.855595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.874893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:45.876097 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:45.884067 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4508/8978] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:45.888043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.897753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f095858-5bf0-4091-8192-0e92025ca74c None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.903172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:45.903825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.904109 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.904387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.905116 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:11:45.905427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:45.907063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:45.919563 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4471/8979] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:11:45.923843 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.932978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef1b0a-843f-47e6-b031-c458671b1830 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.937539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:45.938216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:45.938494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:45.938767 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:45.939444 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:45.941344 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:45.966919 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4509/8980] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:11:45 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:45.971169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:45.982633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ad447-8705-4f09-9494-bdfd5bb7258c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:45.991786 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:46.046305 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:46.046974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.047256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.047528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.048213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:46.050153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:46.073014 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4472/8981] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:11:45 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:46.077169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:46.088026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da414-dd9e-4d2d-a59b-5a5713a659ff admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:46.092519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:46.093200 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.093483 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.093786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.094511 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:46.096087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:46.101424 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:46.109274 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4510/8982] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 02:11:46.113138 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:46.123839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338206d-7819-4091-b804-d0cd352edc27 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:46.128780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:46.129524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.129844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.130147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.130876 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:46.132477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55879d5a-d6fe-4f3f-be79-06aec5398762 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:46.143174 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4473/8983] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:46.147388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:46.158046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcee98d-048b-4059-9beb-13a8d664f0d9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:46.162564 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:46.163434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.163712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.163984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] PATH_INFO: `/v3/projects/266914d4511441508d0f77c9ba0948b5/users/b9edf26d377b4ec0b014984fd72ecdcb/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.178882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266914d4511441508d0f77c9ba0948b5, user_id=b9edf26d377b4ec0b014984fd72ecdcb, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:46.181726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:46.195027 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4511/8984] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:11:46 2022] PUT /identity/v3/projects/266914d4511441508d0f77c9ba0948b5/users/b9edf26d377b4ec0b014984fd72ecdcb/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:46.205949 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.206243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.206541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.233958 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] MFA Rules not processed for user `b9edf26d377b4ec0b014984fd72ecdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:46.235188 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:46.301508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4474/8985] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:46.311304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:46.313122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:46.370252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cec82-1dc5-4459-92ee-e9ab50605de0 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:46.373836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:46.374472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:46.374750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:46.375024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:46.383369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:46.385427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e5cd-4e9e-4fdd-9e97-9819b00322d4 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:46.394319 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4512/8986] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:50.999730 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.061886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d6367-8156-422e-bbfd-f4e434e63800 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.066308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.067168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.067447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.067715 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] PATH_INFO: `/v3/users/b9edf26d377b4ec0b014984fd72ecdcb` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.068880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9edf26d377b4ec0b014984fd72ecdcb)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.071837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.094832 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:51.120936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9edf26d377b4ec0b014984fd72ecdcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.128743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9edf26d377b4ec0b014984fd72ecdcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.136814 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9edf26d377b4ec0b014984fd72ecdcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.148742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9edf26d377b4ec0b014984fd72ecdcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.150223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9edf26d377b4ec0b014984fd72ecdcb'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.156303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4475/8987] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:11:50 2022] DELETE /identity/v3/users/b9edf26d377b4ec0b014984fd72ecdcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:51.160806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.161271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.161376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.178637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:51.179837 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:51.240758 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4513/8988] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:51.251012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.252721 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:51.315495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da362c4-e1df-42ad-94f6-a928f12baaeb admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.319361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.320028 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.320312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.320590 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.330930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.332404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54256a91-ea3c-43f3-9bfa-e346c4bc4fe5 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.342437 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4476/8989] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:51.516517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.518185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:51.531076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c08a-4890-4179-bc03-2bee9101e80c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.535712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.536579 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.536857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.537130 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] PATH_INFO: `/v3/projects/266914d4511441508d0f77c9ba0948b5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.538320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266914d4511441508d0f77c9ba0948b5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.541183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.589731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266914d4511441508d0f77c9ba0948b5', 'request_id': 'req-e4e958de-417b-4523-b83c-ab0da601d7e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.595318 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266914d4511441508d0f77c9ba0948b5', 'request_id': 'req-e4e958de-417b-4523-b83c-ab0da601d7e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.602004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266914d4511441508d0f77c9ba0948b5', 'request_id': 'req-e4e958de-417b-4523-b83c-ab0da601d7e2'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.613057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] The token cache is being invalidate because project 266914d4511441508d0f77c9ba0948b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:11:51.613323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.613970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-e4e958de-417b-4523-b83c-ab0da601d7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:11:51.615756 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4514/8990] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:11:51 2022] DELETE /identity/v3/projects/266914d4511441508d0f77c9ba0948b5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:51.621737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3349-8837-40bc-9865-50595829ba4b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.622168 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3349-8837-40bc-9865-50595829ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.622617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3349-8837-40bc-9865-50595829ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.640749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-111b3349-8837-40bc-9865-50595829ba4b None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:51.641979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-111b3349-8837-40bc-9865-50595829ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:51.701304 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4477/8991] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:11:51.709102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.709392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.709697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.716791 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:51.732078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:51.733281 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:51.742278 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4515/8992] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:51.746537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3349-8837-40bc-9865-50595829ba4b None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.756244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3349-8837-40bc-9865-50595829ba4b None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.761956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.762560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.762839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.763112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.763877 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:11:51.764182 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.765879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.778329 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4478/8993] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:11:51.782489 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.791915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35ec1-3e4d-430a-8f30-41fe53e7f71c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.796792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.797498 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.797817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.798096 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.798822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.800756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.832657 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4516/8994] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:11:51 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:51.837904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.847886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd71a-23a7-4a6f-882d-6b558adb8c51 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.876641 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:51.906494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.907161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.907441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.907714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.908409 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.910439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.929303 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4479/8995] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:11:51 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:51.934190 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.944550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58944-f952-4aee-8bd6-8276d592faf4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.949936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.950591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.950871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.951147 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.951872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.953458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.963933 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4517/8996] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:51.967899 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:51.978211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec36a-124a-4d0a-8c22-fbd66cb2d75b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:51.982803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:51.983451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:51.983733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:51.984008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:51.984731 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:51.986355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aa6b9-f934-4c53-9af8-824ea204c720 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:51.997530 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4480/8997] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:52.001776 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:52.012487 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7452a-e9e0-430c-a916-8c2cec47e0e4 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:52.017433 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:52.018342 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:52.018621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:52.018892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] PATH_INFO: `/v3/projects/8e7f43fc61f442d2b8c5e847099d7268/users/603b9d20e2a94b0c99f9820f8374d0fa/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:52.033148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7f43fc61f442d2b8c5e847099d7268, user_id=603b9d20e2a94b0c99f9820f8374d0fa, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:52.035815 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:52.048675 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4518/8998] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:11:52 2022] PUT /identity/v3/projects/8e7f43fc61f442d2b8c5e847099d7268/users/603b9d20e2a94b0c99f9820f8374d0fa/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:52.053931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566a4c-5079-4473-97c6-5e4dd61c30c3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:52.054373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566a4c-5079-4473-97c6-5e4dd61c30c3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:52.054510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57566a4c-5079-4473-97c6-5e4dd61c30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:52.074323 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-57566a4c-5079-4473-97c6-5e4dd61c30c3 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:52.075546 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-57566a4c-5079-4473-97c6-5e4dd61c30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:52.136920 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4481/8999] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:52.146656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:52.148446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:52.206466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214501c-4153-4d45-a93a-d98d03b5c72d admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:52.210222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:52.210871 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:52.211154 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:52.211435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:52.220466 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:52.221927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:52.231450 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4519/9000] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:11:56.295240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.295786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.296523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.333969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] MFA Rules not processed for user `603b9d20e2a94b0c99f9820f8374d0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:11:56.336452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:11:56.422392 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4482/9001] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:11:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:11:56.426970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.437636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daf202-6445-4181-a1f8-ac8079ab642d service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.442559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.443231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.443509 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.443782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.444492 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.447131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.478134 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4520/9002] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:56.482227 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.495547 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ba7e8-7472-4dc5-9f78-3c529402b01a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.536149 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:11:56.556686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.557368 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.557650 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.557964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.558668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.560578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.581864 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4483/9003] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:11:56 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:11:56.585994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.597196 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f01b-a770-4baa-b855-a0fed6956991 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.601952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.603301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.603618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.603895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.604636 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.606301 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.618335 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4521/9004] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:56.622725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.633905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecbb45-e578-4cac-bd2a-9be7be2e7cc3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.638923 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.639827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.640120 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.640394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] PATH_INFO: `/v3/projects/7d1f17bdcc90474c80c73147570dabca/users/04441239769642d2b41525b853fbd973/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.657162 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1f17bdcc90474c80c73147570dabca, user_id=04441239769642d2b41525b853fbd973, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.660054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.675044 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4484/9005] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:11:56 2022] PUT /identity/v3/projects/7d1f17bdcc90474c80c73147570dabca/users/04441239769642d2b41525b853fbd973/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:11:56.679237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.695379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c296146-a4d3-4d29-8bfb-248acae3c9eb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.761299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.762026 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.762309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.762585 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.763328 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.764940 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77379772-1b46-4e81-aa1f-31853e837359 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.776236 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4522/9006] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:11:56.780602 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:11:56.795607 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae92637-0f65-42d1-aef9-0adde5356447 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:11:56.803538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:11:56.804537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:11:56.804915 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:11:56.805437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] PATH_INFO: `/v3/projects/7d1f17bdcc90474c80c73147570dabca/users/04441239769642d2b41525b853fbd973/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:11:56.807998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1f17bdcc90474c80c73147570dabca, user_id=04441239769642d2b41525b853fbd973, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:11:56.812563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:11:56.826168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4485/9007] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:11:56 2022] PUT /identity/v3/projects/7d1f17bdcc90474c80c73147570dabca/users/04441239769642d2b41525b853fbd973/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:12:01.171153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de834f0-07ef-4f3e-9f9f-8eb8b37fa906 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:01.171630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de834f0-07ef-4f3e-9f9f-8eb8b37fa906 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:01.171868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de834f0-07ef-4f3e-9f9f-8eb8b37fa906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:01.178711 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:01.210896 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9de834f0-07ef-4f3e-9f9f-8eb8b37fa906 None None] MFA Rules not processed for user `04441239769642d2b41525b853fbd973`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:12:01.212430 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9de834f0-07ef-4f3e-9f9f-8eb8b37fa906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:01.295862 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4523/9008] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:12:01.314524 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:12:01.316948 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:01.397736 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee96f8-5e62-433e-8688-41bae886262d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:12:01.404248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047def31-cf6e-4292-8037-28e3930939df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:12:01.404933 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def31-cf6e-4292-8037-28e3930939df service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:01.405235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def31-cf6e-4292-8037-28e3930939df service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:01.405495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047def31-cf6e-4292-8037-28e3930939df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:01.466069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047def31-cf6e-4292-8037-28e3930939df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:12:01.467716 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047def31-cf6e-4292-8037-28e3930939df service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:12:01.478463 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4486/9009] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:12:01.551738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:01.552121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:01.552477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:01.572175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] MFA Rules not processed for user `603b9d20e2a94b0c99f9820f8374d0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:12:01.573403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:01.580453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4524/9010] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:12:04.189980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047def31-cf6e-4292-8037-28e3930939df service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:12:04.231360 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:04.261413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047def31-cf6e-4292-8037-28e3930939df service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:12:04.266085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:12:04.266748 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:04.267029 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:04.267302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:04.269238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:04.280616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:12:04.282123 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ae74-2e52-480e-8cf3-8cfebc7800d7 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:12:04.291639 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4487/9011] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:12:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:12:05.048829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:12:05.052771 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:05.086244 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7edd8a-b192-4a24-8093-0e7d13e1b448 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:12:05.094929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:12:05.095996 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:05.096436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:05.096888 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:05.099117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:05.125831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:12:05.128385 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:12:05.144983 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4525/9012] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:12:14.287883 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=13 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:14.746787 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868548-612e-4580-9029-e272876567f5 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:14.747078 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868548-612e-4580-9029-e272876567f5 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:14.747377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868548-612e-4580-9029-e272876567f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:14.775400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-aa868548-612e-4580-9029-e272876567f5 None None] MFA Rules not processed for user `5a901a3ca2b749adb54c7b99a7ff1e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:12:14.776695 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-aa868548-612e-4580-9029-e272876567f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:14.827632 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4488/9013] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Jul 24 02:12:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:12:14.833650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:12:14.842857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109b61-1b4b-4963-9152-2a6090f00345 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:12:14.846401 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a901a3ca2b749adb54c7b99a7ff1e04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:12:14.847027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:14.847304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:14.847575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:14.856936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:12:14.858378 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:12:14.868836 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4526/9014] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:12:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:12:24.822012 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=27 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:24.863652 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=47 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:12:39.901836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:12:39.902306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:12:39.902424 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:12:39.920375 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] MFA Rules not processed for user `603b9d20e2a94b0c99f9820f8374d0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:12:39.921545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:12:39.928356 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4489/9015] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:12:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:12:49.914552 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:24.480316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:24.544833 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d01c3-6837-4e3b-aec2-ecaef2d5eabe service cinder] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:24.549365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:24.550266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:24.550546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:24.550817 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] PATH_INFO: `/v3/users/603b9d20e2a94b0c99f9820f8374d0fa` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:24.552014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603b9d20e2a94b0c99f9820f8374d0fa)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:24.554376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:24.599637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603b9d20e2a94b0c99f9820f8374d0fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.600216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603b9d20e2a94b0c99f9820f8374d0fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.608185 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603b9d20e2a94b0c99f9820f8374d0fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.615157 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603b9d20e2a94b0c99f9820f8374d0fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.627549 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603b9d20e2a94b0c99f9820f8374d0fa'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.633717 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4527/9016] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:13:24 2022] DELETE /identity/v3/users/603b9d20e2a94b0c99f9820f8374d0fa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:24.807468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:24.818902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1bf79-483f-4407-82e5-454f2b0a9200 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:24.876936 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:24.877759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:24.878050 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:24.878331 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] PATH_INFO: `/v3/projects/8e7f43fc61f442d2b8c5e847099d7268` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:24.879560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7f43fc61f442d2b8c5e847099d7268)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:24.881499 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:24.930134 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7f43fc61f442d2b8c5e847099d7268', 'request_id': 'req-81fd6d23-5f2f-4051-ab86-84e188fb3966'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.936105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7f43fc61f442d2b8c5e847099d7268', 'request_id': 'req-81fd6d23-5f2f-4051-ab86-84e188fb3966'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.941468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7f43fc61f442d2b8c5e847099d7268', 'request_id': 'req-81fd6d23-5f2f-4051-ab86-84e188fb3966'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.953481 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] The token cache is being invalidate because project 8e7f43fc61f442d2b8c5e847099d7268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:13:24.953792 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.954566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:24.956162 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4490/9017] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:13:24 2022] DELETE /identity/v3/projects/8e7f43fc61f442d2b8c5e847099d7268 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:24.960565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:24.962055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:24.976571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab37c-47bc-4049-afe7-b55acd713848 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.032018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.032882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.033159 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.033432 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] PATH_INFO: `/v3/users/04441239769642d2b41525b853fbd973` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.034640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04441239769642d2b41525b853fbd973)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.036532 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.059980 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:25.085008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04441239769642d2b41525b853fbd973'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.086334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04441239769642d2b41525b853fbd973'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.093533 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04441239769642d2b41525b853fbd973'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.100380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04441239769642d2b41525b853fbd973'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.112060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-0d5a30ed-9389-481b-a581-121c8a99c38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04441239769642d2b41525b853fbd973'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.118582 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4528/9018] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:13:24 2022] DELETE /identity/v3/users/04441239769642d2b41525b853fbd973 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:25.300520 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.302490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:25.317841 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d23-5f2f-4051-ab86-84e188fb3966 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.529826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.530687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.530969 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.531246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] PATH_INFO: `/v3/projects/7d1f17bdcc90474c80c73147570dabca` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.532428 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1f17bdcc90474c80c73147570dabca)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.534395 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.568653 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:25.581679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1f17bdcc90474c80c73147570dabca', 'request_id': 'req-992d5fda-c884-4608-9022-7a846b8d4f3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.588451 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1f17bdcc90474c80c73147570dabca', 'request_id': 'req-992d5fda-c884-4608-9022-7a846b8d4f3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.594073 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1f17bdcc90474c80c73147570dabca', 'request_id': 'req-992d5fda-c884-4608-9022-7a846b8d4f3c'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.606478 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] The token cache is being invalidate because project 7d1f17bdcc90474c80c73147570dabca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:13:25.606765 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.607387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-992d5fda-c884-4608-9022-7a846b8d4f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:13:25.608909 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4491/9019] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:13:25 2022] DELETE /identity/v3/projects/7d1f17bdcc90474c80c73147570dabca => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:25.613994 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.614434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.614604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.633795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:25.634951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:25.693737 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4529/9020] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:25.702187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.702476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.702751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.722015 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:25.723211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:25.731602 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4492/9021] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:25.736047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.746986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3ccf-df0a-49b3-81c5-f7b2ec133a65 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.751565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.752214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.752494 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.752769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.753501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:13:25.753835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.755429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.767261 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4530/9022] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:13:25.771430 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.780761 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970191-aba7-40ba-afa5-dfca5a4ec5cb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.785355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.786036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.786315 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.786586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.787289 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.789737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.815691 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4493/9023] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:13:25 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:13:25.819966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.831125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484e01-aeff-4937-95b2-f7dc69f48684 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.889261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.889886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.890166 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.890440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.891128 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.893022 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.911950 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4531/9024] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:13:25 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:13:25.916689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.926733 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f91d-91d2-4bfc-933b-6421e92f782d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.932389 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.933069 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.933347 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.933613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.934369 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.935943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.946738 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4494/9025] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:13:25.950630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.961059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684f10-cbc8-4448-b073-a3bb5dec4c1e admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.965859 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.966521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.966832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.967110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:25.967865 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:25.969460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81831d03-f4fe-48f3-a262-9cd02efc8c6c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:25.979447 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4532/9026] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:13:25.983336 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:25.993882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74c07-3e0e-423b-8cea-f24e2f91711b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:25.998411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:25.999270 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:25.999554 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:25.999828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] PATH_INFO: `/v3/projects/3f362209460b447eafc746d78d91f589/users/436ffbb8d49e46a9be0520b19ba223d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:26.015240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f362209460b447eafc746d78d91f589, user_id=436ffbb8d49e46a9be0520b19ba223d5, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:26.017974 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:26.031022 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4495/9027] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:13:25 2022] PUT /identity/v3/projects/3f362209460b447eafc746d78d91f589/users/436ffbb8d49e46a9be0520b19ba223d5/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:26.036345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7961f-0ee1-44a9-9bbb-d5dc5ec2daf8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:26.036640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7961f-0ee1-44a9-9bbb-d5dc5ec2daf8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:26.036927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7961f-0ee1-44a9-9bbb-d5dc5ec2daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:26.044395 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:26.056874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-7ca7961f-0ee1-44a9-9bbb-d5dc5ec2daf8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:26.058102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ca7961f-0ee1-44a9-9bbb-d5dc5ec2daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:26.117544 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4533/9028] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:26.128450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:26.130175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:26.186216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799e5d5-44ca-4e76-9ac6-da4f4598fd1d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:26.189796 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:26.190438 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:26.190719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:26.190994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:26.200827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:26.202298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:26.211850 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4496/9029] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:13:29.983840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:29.984304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:29.984619 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.013355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] MFA Rules not processed for user `436ffbb8d49e46a9be0520b19ba223d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:30.014674 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:30.081642 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4534/9030] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:30.086598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.096180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe29b94-a704-471d-84fc-190f2d734ffa service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.101663 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.102374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.102657 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.102930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.103618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.105521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.137068 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4497/9031] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:13:30 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:13:30.141073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.152135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759c274-54af-4e1b-9423-0211640be2b8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.212429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.213152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.213435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.213845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.214563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.216522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.237555 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4535/9032] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:13:30 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:13:30.242566 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.253363 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a3e5a-b355-42e4-83a2-ec1c938a5a24 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.258567 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.259386 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.259797 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.260187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.260932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.262618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.273970 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4498/9033] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:13:30.278377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.290123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2503519-da58-466c-8fbb-83729a072e83 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.295184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.296105 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.296388 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.296672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] PATH_INFO: `/v3/projects/bb07609c5d6c4f1abe432f73a529b86a/users/551457be17af47debbb803ec72bb33b1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.312904 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb07609c5d6c4f1abe432f73a529b86a, user_id=551457be17af47debbb803ec72bb33b1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.315736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.325136 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:30.330593 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4536/9034] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:13:30 2022] PUT /identity/v3/projects/bb07609c5d6c4f1abe432f73a529b86a/users/551457be17af47debbb803ec72bb33b1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:30.334848 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.345659 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf404be-e1fd-4686-9703-0b99316f1fd2 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.370941 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:30.427292 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.427962 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.428243 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.428517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.429612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.431244 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc8cae-78b0-4c48-be8c-cf819ddedb44 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.447362 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4499/9035] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:13:30.448529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:30.459238 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691eae6-38eb-4e6d-b76b-a382ebe7e764 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:30.464252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:30.465151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:30.465428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:30.465755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] PATH_INFO: `/v3/projects/bb07609c5d6c4f1abe432f73a529b86a/users/551457be17af47debbb803ec72bb33b1/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:30.467858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb07609c5d6c4f1abe432f73a529b86a, user_id=551457be17af47debbb803ec72bb33b1, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:30.470577 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260315e3-a785-455c-af41-f35141614bf7 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:30.482401 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4537/9036] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:13:30 2022] PUT /identity/v3/projects/bb07609c5d6c4f1abe432f73a529b86a/users/551457be17af47debbb803ec72bb33b1/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:13:35.038403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:35.038879 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:35.040139 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:35.083153 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] MFA Rules not processed for user `551457be17af47debbb803ec72bb33b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:35.085870 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:35.177008 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4500/9037] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:35.217834 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd718-0dae-447d-9960-2476c2d3696b None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:35.218287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd718-0dae-447d-9960-2476c2d3696b None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:35.218287 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd718-0dae-447d-9960-2476c2d3696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:35.277657 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eecfd718-0dae-447d-9960-2476c2d3696b None None] MFA Rules not processed for user `1d7eafaa369f49bb9ea2c818d977d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:35.278987 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eecfd718-0dae-447d-9960-2476c2d3696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:35.355817 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4538/9038] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Jul 24 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:35.362010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:35.373968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a6d22-84ab-4da7-bbc9-2047ead8f1a9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:35.381031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:35.382652 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:35.383240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:35.383672 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:35.452485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:35.454163 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccb37-fd78-418a-a5c8-3c6df976a575 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:35.464449 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4501/9039] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:13:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:13:35.590712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:35.591205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:35.591672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:35.810694 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:35.811970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:35.887925 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4539/9040] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:35.939251 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848128-0591-4a23-a12a-98f692172518 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:35.939635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848128-0591-4a23-a12a-98f692172518 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:35.939975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848128-0591-4a23-a12a-98f692172518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:35.994133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-79848128-0591-4a23-a12a-98f692172518 None None] MFA Rules not processed for user `fdc4ad8dc59b4974a08e687a78764471`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:35.995373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-79848128-0591-4a23-a12a-98f692172518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:36.014814 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:36.075179 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4502/9041] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Jul 24 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:36.081294 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:36.094131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f760ab0-6cf4-42e0-aebf-bea7a4de887d None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:36.099178 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:36.099855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:36.100131 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:36.100639 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:36.109600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:36.111214 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:36.130291 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4540/9042] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:13:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:13:45.113298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44676f4-09f2-4731-a237-1d888e2c1573 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:45.113803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44676f4-09f2-4731-a237-1d888e2c1573 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:45.113898 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44676f4-09f2-4731-a237-1d888e2c1573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:45.134577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b44676f4-09f2-4731-a237-1d888e2c1573 None None] MFA Rules not processed for user `436ffbb8d49e46a9be0520b19ba223d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:45.135784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b44676f4-09f2-4731-a237-1d888e2c1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:45.142664 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4503/9043] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:45.716203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:45.717650 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:45.745910 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:45.801062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a80c-69d7-471c-9fc1-b2e1d91da0db service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:45.806913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:45.807553 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:45.807831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:45.808101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:45.809899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:45.821596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:45.823266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:45.833692 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4541/9044] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:13:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:13:47.040402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:47.040886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:47.040983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:47.059106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:13:47.060322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:13:47.067662 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4504/9045] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:13:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:13:47.081606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:13:47.092949 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315926be-c085-40f3-be3a-eaa9684dba2a service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:13:47.098369 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:13:47.099016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:13:47.099298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:13:47.099574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:13:47.108213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:13:47.109836 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:13:47.119710 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4542/9046] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:13:57.053722 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=29 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:13:57.116324 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=32 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:01.560097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:14:01.573125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe4bf-5763-4dda-980f-e040f0797844 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:14:01.578293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:14:01.578886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:14:01.579166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:14:01.579441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:14:01.581240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:14:01.594578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:14:01.596199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:14:01.608134 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4505/9047] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:14:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:14:04.524853 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:14:04.526630 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:14:04.608640 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203275c-2cbb-4b01-a6aa-27be5b25578c service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:14:04.614221 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:14:04.614868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:14:04.615719 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:14:04.616253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:14:04.618298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:14:04.632684 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:14:04.634331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:14:04.645237 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4543/9048] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:14:11.603724 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:14.641256 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=34 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:14:22.388743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:14:22.440398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01023f3-0432-4f8c-8ca6-9d852062b19c service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:14:22.443905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:14:22.445129 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:14:22.445411 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:14:22.445694 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:14:22.454530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:14:22.455961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:14:22.465241 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4506/9049] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:14:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:14:32.461214 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=26 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:15:10.398629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:15:10.400029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:15:10.414232 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ce07-453e-43d5-8c39-70c1cb2cdd2d service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:15:10.419204 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:15:10.419835 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:15:10.420120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:15:10.420399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:15:10.422266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:15:10.433323 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:15:10.434923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:15:10.444734 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4544/9050] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:15:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:15:20.440715 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:37.943206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:16:37.952220 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74533a-dfcf-4f70-bb64-f4a127b93c9c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:16:37.956150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:16:37.956795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:16:37.957108 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:16:37.957431 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:16:37.960043 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:16:37.974510 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:16:37.976017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:16:37.987197 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4507/9051] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:16:39.257783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:16:39.267216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433da7d-0a48-4c37-bc26-9730572f4849 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:16:39.270872 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:16:39.271505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:16:39.271788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:16:39.272067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:16:39.273864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:16:39.287341 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:16:39.288764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:16:39.299539 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4545/9052] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:16:47.982293 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:16:49.294864 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:17:15.888490 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:17:15.908290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba286-ccaf-422e-a45b-64d5ef385fa3 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:17:15.912017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:17:15.912723 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:17:15.913000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:17:15.913280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:17:15.915085 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:17:15.943277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:17:15.945302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e928-fbd8-4dd2-8348-4dae59d99581 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:17:15.953169 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4508/9053] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:17:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:17:25.949727 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=19 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:13.906260 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:13.907731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:14.015155 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7fc8-c0a0-48d8-a8f1-79d43b422690 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:14.022672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:14.023983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:14.024679 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:14.025156 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:14.027829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:14.043271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:14.045086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:14.059767 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4546/9054] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:18:24.052557 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=28 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:27.836853 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb262f7-87bd-458a-a721-b4e978928f02 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:27.837321 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb262f7-87bd-458a-a721-b4e978928f02 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:27.837425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb262f7-87bd-458a-a721-b4e978928f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:27.854313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9fb262f7-87bd-458a-a721-b4e978928f02 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:18:27.855503 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9fb262f7-87bd-458a-a721-b4e978928f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:27.862582 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4509/9055] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 02:18:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:18:27.903056 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:27.914855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef195ca-371c-4797-a709-1b14f1bca0cf service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:27.919726 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:27.920380 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:27.920660 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:27.920933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:27.930215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:27.931775 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:27.939709 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4547/9056] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:18:28.383353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:28.383649 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:28.383934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:28.401786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:18:28.402984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:28.410124 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4510/9057] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:18:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:18:28.422860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:28.434086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de63e-1df4-4fad-bfb3-23afc3633f77 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:28.439129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:28.439762 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:28.440046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:28.440327 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:28.448334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:28.450055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9de9f2-55da-40de-a6f2-780130553a27 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:28.458356 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4548/9058] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:18:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:18:36.522827 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:36.535364 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a9d1-b8c8-4d79-8b4d-7e2359c50a92 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:36.541404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:36.542075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:36.542354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:36.542624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:36.550361 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:36.551930 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:36.561469 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4511/9059] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:18:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:18:36.626529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:36.627037 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:36.627142 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:36.644451 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] MFA Rules not processed for user `436ffbb8d49e46a9be0520b19ba223d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:18:36.645629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:36.652547 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4549/9060] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:18:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:18:36.912625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:36.921889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ebf76-e135-44f6-8bfc-4257b989b067 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:36.925427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:36.926095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:36.926377 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:36.926654 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:36.928740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:36.938146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:36.939513 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbd3e2-45c0-4119-894a-86c3e3cde94b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:36.947725 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4512/9061] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:18:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:18:37.275698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:37.287689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3623-de97-49f0-92ba-f2bf0ad3bd88 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:37.292700 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:37.293352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:37.293638 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:37.293946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:37.295741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:37.321111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:37.322741 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:37.333244 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4550/9062] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:18:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:18:38.521610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:38.522130 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:38.522404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:38.543252 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:18:38.544450 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:18:38.551606 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4513/9063] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:18:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:18:38.564167 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:18:38.575916 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bffb4-31bd-40f9-bb10-e15dae28ecc6 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:18:38.580858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:18:38.581567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:18:38.581951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:18:38.582291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:18:38.591407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:18:38.593050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:18:38.601487 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4551/9064] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:18:48.537688 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=21 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:18:48.597933 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=32 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:05.515392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:19:05.528291 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be854-4384-47cb-bec6-75bb377a37f9 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:19:05.533222 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:19:05.533897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:19:05.534180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:19:05.534456 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:19:05.543886 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:19:05.545470 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:19:05.555813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4514/9065] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:19:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:19:14.753421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:19:14.769207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d47e-0bb8-43bb-b238-26e32ac7cef6 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:19:14.776396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:19:14.777314 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:19:14.777661 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:19:14.778251 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:19:14.781448 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:19:14.795646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:19:14.797442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef3fbd-cc49-4726-b67e-be948169a444 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:19:14.812859 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4552/9066] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:19:15.551242 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:19:24.806000 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:20:16.860512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:20:16.871979 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a282cd2-18b6-4718-b699-15630e3b6312 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:20:16.877158 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:20:16.877812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:20:16.878096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:20:16.878372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:20:16.886967 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:20:16.888537 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:20:16.898589 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4515/9067] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:20:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:20:26.894188 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:36.866766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:36.867226 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:36.867324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:36.884858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:36.886073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:36.901289 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4553/9068] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:36.941584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:36.953060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b605e9-cfc0-468b-a6b5-663b8a316926 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:36.958060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:36.958693 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:36.959006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:36.959288 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:36.967763 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:36.969327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:36.978046 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4516/9069] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:21:37.325939 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:37.344135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da1e9-358a-4fa7-9939-aaf98b939120 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:37.347620 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:37.348253 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:37.348530 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:37.348802 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:37.419312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:37.420746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:37.439513 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4554/9070] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:40.632919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:40.658235 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575e1f-b5c3-41e7-b4f5-1ca54e887fac service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:40.666995 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:40.667660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:40.667941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:40.668219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:40.670201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:40.686708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:40.688808 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:40.704261 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4517/9071] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:43.931442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:43.941707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e3fbd-fb52-490f-a551-d3231b4a78a9 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:43.947209 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:43.948093 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:43.948379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:43.948664 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] PATH_INFO: `/v3/users/436ffbb8d49e46a9be0520b19ba223d5` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:43.949960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436ffbb8d49e46a9be0520b19ba223d5)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:43.951947 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:43.999964 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436ffbb8d49e46a9be0520b19ba223d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.000632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436ffbb8d49e46a9be0520b19ba223d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.008137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436ffbb8d49e46a9be0520b19ba223d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.015280 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436ffbb8d49e46a9be0520b19ba223d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.027850 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436ffbb8d49e46a9be0520b19ba223d5'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.034025 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4555/9072] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:21:43 2022] DELETE /identity/v3/users/436ffbb8d49e46a9be0520b19ba223d5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:44.210385 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:44.233008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b64bcd-694c-44eb-8bce-014a8f3289ef service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:44.290216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:44.291076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:44.291355 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:44.291628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] PATH_INFO: `/v3/projects/3f362209460b447eafc746d78d91f589` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:44.292789 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f362209460b447eafc746d78d91f589)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:44.294750 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:44.340335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f362209460b447eafc746d78d91f589', 'request_id': 'req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.346298 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f362209460b447eafc746d78d91f589', 'request_id': 'req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.351983 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f362209460b447eafc746d78d91f589', 'request_id': 'req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.377295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] The token cache is being invalidate because project 3f362209460b447eafc746d78d91f589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:21:44.377512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.378177 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.379709 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4518/9073] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:21:44 2022] DELETE /identity/v3/projects/3f362209460b447eafc746d78d91f589 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:44.384844 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:44.386277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:44.399273 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d987c-c82f-44f7-b0d6-b14c303632e2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:44.423261 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:44.456982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:44.457900 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:44.458183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:44.458458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] PATH_INFO: `/v3/users/551457be17af47debbb803ec72bb33b1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:44.459747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551457be17af47debbb803ec72bb33b1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:44.461690 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:44.508336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551457be17af47debbb803ec72bb33b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.509039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551457be17af47debbb803ec72bb33b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.516113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551457be17af47debbb803ec72bb33b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.523084 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551457be17af47debbb803ec72bb33b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.534845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-4c1e2693-c2dd-4ab4-9386-a300fc2531f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551457be17af47debbb803ec72bb33b1'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.541231 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4556/9074] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:21:44 2022] DELETE /identity/v3/users/551457be17af47debbb803ec72bb33b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:44.724357 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:44.725881 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:44.738785 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19f82-ef0b-42d4-b087-dbf3c634dd3d admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:44.787500 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:44.798644 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:44.799536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:44.799813 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:44.800081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] PATH_INFO: `/v3/projects/bb07609c5d6c4f1abe432f73a529b86a` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:44.801247 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb07609c5d6c4f1abe432f73a529b86a)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:44.803800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:44.848353 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb07609c5d6c4f1abe432f73a529b86a', 'request_id': 'req-18a407a8-7119-4570-bed5-d93f43810f07'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.854690 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb07609c5d6c4f1abe432f73a529b86a', 'request_id': 'req-18a407a8-7119-4570-bed5-d93f43810f07'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.860051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb07609c5d6c4f1abe432f73a529b86a', 'request_id': 'req-18a407a8-7119-4570-bed5-d93f43810f07'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.872747 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] The token cache is being invalidate because project bb07609c5d6c4f1abe432f73a529b86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:21:44.873034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.873651 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-18a407a8-7119-4570-bed5-d93f43810f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:21:44.875183 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4519/9075] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:21:44 2022] DELETE /identity/v3/projects/bb07609c5d6c4f1abe432f73a529b86a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:44.880279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:44.880563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:44.880934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:44.939604 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:44.940718 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:44.999557 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4557/9076] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:45.006961 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.007250 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.007523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.027053 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:45.028261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:45.036184 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4520/9077] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:45.041436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.051073 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fe863-2dc0-4f6c-acf6-983097933e33 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.056205 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.056845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.057125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.057399 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.058153 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:21:45.058457 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.060043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.072924 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4558/9078] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:21:45.077172 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.086625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bb9a6-129d-4017-b49e-88c91f99036f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.091241 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.091890 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.092166 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.092437 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.093151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.095081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.133490 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4521/9079] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:21:45.137641 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.142811 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:45.149117 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65ac7a-f55b-424f-a308-5a085b1eb35a admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.206211 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.206800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.207078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.207349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.208055 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.210847 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.230022 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4559/9080] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 02:21:45.234133 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.244976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8f1c-4cde-42fc-b0a6-c19a9e2c72b3 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.249541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.250228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.250509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.250783 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.251508 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.253104 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.263786 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4522/9081] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:21:45.267699 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.278454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad34a32-97bd-4c08-9c30-a1cf5188106f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.283062 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.283804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.284087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.284363 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.285095 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.286728 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a23631-46c0-4caa-b090-6bb0ce778065 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.297192 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4560/9082] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:21:45.301365 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.311310 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281fa00-8be5-446f-afeb-3a1f60e6809f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.315844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.316709 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.316988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.317257 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] PATH_INFO: `/v3/projects/577aa474166845ffbc0ddc0c23b5a6cc/users/a8ddac1d257f460e9115ab3f02942692/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.332058 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577aa474166845ffbc0ddc0c23b5a6cc, user_id=a8ddac1d257f460e9115ab3f02942692, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.334901 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.347696 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4523/9083] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:21:45 2022] PUT /identity/v3/projects/577aa474166845ffbc0ddc0c23b5a6cc/users/a8ddac1d257f460e9115ab3f02942692/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:45.358014 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.358304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.358605 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.385340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:45.386622 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:45.450600 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4561/9084] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:45.455042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.516667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b54bbb-75fe-4a2a-9720-fbe6dc5d7f34 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.521302 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.522219 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.522521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.522782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.523479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.525382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.539308 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:45.558070 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4524/9085] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:21:45.559683 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.571006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0868-0224-485d-9ca7-5566caf75860 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.627646 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.628343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.628629 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.628923 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.629713 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.631746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.646138 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:45.653835 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4562/9086] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:21:45.656778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.668113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0cdf-01fb-41bc-a8e6-157a2917f960 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.672685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.673341 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.673623 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.673934 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.674688 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.676295 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.686708 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4525/9087] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:21:45.690867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.701410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef5880-3f8f-4794-8117-050cb0123130 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.706517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.707392 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.707676 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.707986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] PATH_INFO: `/v3/projects/ccf58ad0da04471982e6cfbd97365be6/users/f50d354b756045a19ddb5bc3e584f4b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.723365 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf58ad0da04471982e6cfbd97365be6, user_id=f50d354b756045a19ddb5bc3e584f4b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.727164 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.739475 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4563/9088] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:21:45 2022] PUT /identity/v3/projects/ccf58ad0da04471982e6cfbd97365be6/users/f50d354b756045a19ddb5bc3e584f4b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:45.743959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.753955 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512977dd-8bf7-4e89-8039-d203ff6fcb03 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.810918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.811616 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.811900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.812175 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.812913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.814531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75b50-f25e-4b71-bd88-9f19e2d08a1f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.824903 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4526/9089] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:21:45.829028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.839831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7785ad-d8fe-4b71-b7d9-ffb12434187b admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:45.844397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:45.845268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.845545 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.845857 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] PATH_INFO: `/v3/projects/ccf58ad0da04471982e6cfbd97365be6/users/f50d354b756045a19ddb5bc3e584f4b6/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.847795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf58ad0da04471982e6cfbd97365be6, user_id=f50d354b756045a19ddb5bc3e584f4b6, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:45.851011 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:45.861277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4564/9090] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:21:45 2022] PUT /identity/v3/projects/ccf58ad0da04471982e6cfbd97365be6/users/f50d354b756045a19ddb5bc3e584f4b6/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:21:45.872350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:45.872641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:45.872920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:45.899888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] MFA Rules not processed for user `f50d354b756045a19ddb5bc3e584f4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:45.901083 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:45.971144 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4527/9091] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:45.984902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:45.986759 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:46.082412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c95be-fefa-43c3-9001-23713f07346c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:46.088316 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:46.088966 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:46.089249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:46.089529 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:46.146559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:46.148162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb1bc-abd3-4970-9f86-1d12aeda1075 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:46.157171 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4565/9092] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:48.841800 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:48.843756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:48.915427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a99b8f-2bbf-4216-9153-cf2709b23eb3 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:48.918989 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:48.919640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:48.919921 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:48.920194 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:48.929699 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:48.931155 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:48.935306 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=100 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:48.944631 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4528/9093] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:51.833181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:51.834357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:51.834357 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:51.852241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:21:51.853454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:51.861218 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4566/9094] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:21:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:21:51.906636 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:51.908749 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:51.972549 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683955a0-4572-4ae7-b75b-4cb1114ca625 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:51.977051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:51.977536 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:51.977861 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:51.978127 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:51.980535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:52.003191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:52.004846 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:52.017416 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4529/9095] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:52.343146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:52.344667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:52.360123 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3007a-620d-420f-bc47-0031669d66f8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:52.371398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:52.372278 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:52.372747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:52.373321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:52.376565 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:52.392031 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:52.394359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:52.411050 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4567/9096] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:52.842447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:52.852424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:52.854006 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:52.856838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879eaa-b659-46ee-a685-55779b5794f9 service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:52.861311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:52.862301 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:52.862570 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:52.862844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:52.864880 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:52.882957 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:21:52.910374 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:52.912689 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:52.931949 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4530/9097] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:21:52.967403 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f3d2-bed1-473b-a56f-88f2ae6410a2 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:52.979797 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:52.980206 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:52.980524 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:52.980801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:52.990423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:53.006686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:53.008348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:53.018476 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4568/9098] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:21:55.774099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:21:55.783144 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb5608-b8c6-492b-8df0-ef896428228f service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:21:55.788496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:21:55.789160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:21:55.789518 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:21:55.789831 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:21:55.791904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:21:55.802959 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:21:55.804628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfa16a-0f24-48f4-8af5-8dd682c4b94b service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:21:55.814644 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4531/9099] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:22:01.595769 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:22:01.597331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:22:01.613608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0f8b-0bca-4860-919c-00016637c922 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:22:01.619610 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:22:01.620265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:22:01.620572 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:22:01.620829 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:22:01.622635 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:22:01.635519 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:22:01.637115 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:22:01.649162 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4569/9100] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:22:05.809802 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=39 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:11.643539 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=29 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:22:59.478968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:22:59.479532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:22:59.479805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:22:59.503401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:22:59.504628 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:22:59.515813 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4532/9101] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:23:02.359571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:23:02.370848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f524fa9-1c98-4552-a745-03c7a1ab1f19 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:23:02.377412 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:23:02.378704 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:23:02.378988 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:23:02.379262 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:23:02.382125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:23:02.393338 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:23:02.394907 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:23:02.404671 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4570/9102] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:23:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:23:09.496386 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:12.400565 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:23:14.322268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:23:14.336970 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0581-563e-436a-8885-ef58dc31f45a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:23:14.342626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:23:14.343707 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:23:14.343992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:23:14.344269 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:23:14.346782 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:23:14.359635 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:23:14.361400 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:23:14.377546 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4533/9103] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:23:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:23:24.369376 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:24:14.546335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:24:14.547764 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:24:14.572034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2b67-076e-4934-ac35-1a777ea75b6c service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:24:14.577370 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:24:14.578047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:24:14.578329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:24:14.578602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:24:14.580343 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:24:14.592199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:24:14.593786 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:24:14.603392 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4571/9104] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:24:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:24:24.599291 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=10 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:21.062627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:25:21.074992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5052-c5df-4f7f-acce-c665180da46e service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:25:21.080452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:25:21.085531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:25:21.085932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:25:21.086221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:25:21.088167 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:25:21.101560 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:25:21.103263 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239e4da-5b58-41cc-b2e9-8d2e9fbf30f9 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:25:21.116515 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4534/9105] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:25:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:25:31.110635 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:33.449977 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:25:33.460624 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42323-0a70-46f5-a408-dbb99c1f3639 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:25:33.466017 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:25:33.466672 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:25:33.466952 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:25:33.467224 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:25:33.469016 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:25:33.481216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:25:33.482933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:25:33.493626 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4572/9106] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:25:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:25:39.251491 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:25:39.251992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:25:39.252077 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:25:39.273836 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:25:39.275722 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:25:39.284646 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4535/9107] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:25:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:25:39.625087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:25:39.634787 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5eefa-b8c0-457f-ba31-3fc716ab0430 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:25:39.639076 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:25:39.639721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:25:39.640003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:25:39.640279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:25:39.642086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:25:39.651840 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:25:39.654447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:25:39.663779 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4573/9108] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:25:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:25:49.265502 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:25:49.659532 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:05.212125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:05.225340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2683fe-ce99-482d-b269-476ceff763c7 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:05.230976 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:05.231837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.232017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.232239 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.240328 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:05.241939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:05.251619 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4536/9109] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:05.433970 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:05.443172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b16dca-80d0-4b0d-a8cd-f7176b8364e0 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:05.446734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:05.447366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.447643 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.447918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.448216 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:05.449651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:27:05.458261 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded820f-a052-4b9b-a18d-db8fe2649eb1 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:05.459568 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:05.460981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf911f1a-17a3-40dc-a1ed-4ef22f57a245 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:05.461871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:05.462505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.462788 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.463060 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.469160 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4574/9110] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:05.474149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:05.475581 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2fb8e-1f05-4eaa-a344-82d4c51e15bb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:05.488847 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4537/9111] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:27:05.586021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b430-d2cb-4ff3-9c24-44d87f074c69 None None] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.586313 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b430-d2cb-4ff3-9c24-44d87f074c69 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.586615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b430-d2cb-4ff3-9c24-44d87f074c69 None None] PATH_INFO: `/` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.588017 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4575/9112] 10.222.0.27 () {54 vars in 921 bytes} [Sun Jul 24 02:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 02:27:05.593812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8149-7217-4b5c-995d-e9dde73f0b6b None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.594100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8149-7217-4b5c-995d-e9dde73f0b6b None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.594402 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a8149-7217-4b5c-995d-e9dde73f0b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.642055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-b52a8149-7217-4b5c-995d-e9dde73f0b6b None None] MFA Rules not processed for user `b53dad04ecf24d408a3551814785a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:27:05.643225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b52a8149-7217-4b5c-995d-e9dde73f0b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:27:05.651694 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4538/9113] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:27:05.672609 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46b430-d2cb-4ff3-9c24-44d87f074c69 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:05.686682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46b430-d2cb-4ff3-9c24-44d87f074c69 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:05.691546 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:05.692175 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.692458 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.692736 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.701137 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:05.702795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:05.712377 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4576/9114] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:05.867530 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.867818 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.868095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.904373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:27:05.905506 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:27:05.914897 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4539/9115] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:27:05.925899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:05.935597 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df049-02a8-4a23-b63d-19257ed928c3 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:05.939195 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:05.939822 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:05.940101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:05.940374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:05.950202 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:05.952307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:05.962832 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4577/9116] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:06.024102 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:06.035403 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aafa83-55c2-4aea-beb3-c3c5d223d025 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:06.040396 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:06.041034 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:06.041313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:06.041587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:06.043370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:27:06.054475 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:06.056044 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:06.066550 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4540/9117] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:06.694120 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:06.702982 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01e44d-7da8-4196-99d1-64c3740f7322 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:06.706658 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:06.707290 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:06.707575 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:06.707855 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:06.719756 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:06.721184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:06.733194 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4578/9118] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:16.062473 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=40 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:16.727932 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=24 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:19.516119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:19.525728 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9765-6410-479f-89b8-3d6b63efb808 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:19.529858 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:19.530543 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:19.530824 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:19.531097 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:19.538236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:19.539660 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:19.548228 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4541/9119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:19.958662 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:19.977044 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d0a31-e46d-45ff-9ea1-9f7dc2441a12 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:20.001046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:20.002795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:20.003324 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:20.004336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:20.006595 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:27:20.027548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:20.031748 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:20.046858 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4579/9120] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:27:25.121611 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:27:25.134928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5333-198c-4e7e-b70a-89d2f99d9ee2 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:27:25.141425 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:27:25.142122 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:27:25.142407 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:27:25.142683 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:27:25.155159 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:27:25.159059 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0f5ee-626f-4b6d-a50e-838474d36de9 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:27:25.171359 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4542/9121] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:27:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:27:30.039820 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:27:35.165809 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=12 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:03.295810 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:28:03.305334 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598020b-824b-417b-b5f3-e7d0c5a15125 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:28:03.308943 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:28:03.310184 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:28:03.310477 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:28:03.310761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:28:03.320046 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:28:03.321486 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:28:03.331541 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4580/9122] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:28:06.342335 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:28:06.344111 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:28:06.344718 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:28:06.375964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:28:06.377627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:28:06.385952 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4543/9123] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:28:07.072039 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:28:07.085129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358a7-e9b3-45b9-872b-84fffa60731a service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:28:07.091569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:28:07.092132 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:28:07.092422 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:28:07.092781 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:28:07.102434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:28:07.104035 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:28:07.117043 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4581/9124] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:28:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:28:09.890939 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:28:09.902980 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7428a-474e-4222-bf70-47dcc2d55200 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:28:09.908387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:28:09.909149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:28:09.909619 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:28:09.910125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:28:09.918255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:28:09.920452 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:28:09.931108 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4544/9125] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:28:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:28:17.110841 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=12 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:28:19.927608 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=9 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:29:19.524522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:29:19.566527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7ca3-201c-489f-b243-a01766c7a6d5 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:29:19.571567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:29:19.572201 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:29:19.572484 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:29:19.572755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:29:19.581497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:29:19.583098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:29:19.593926 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4582/9126] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:29:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:29:29.588634 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=20 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:25.025273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:30:25.047290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57d638-294a-4309-b974-b618fbc4b015 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:30:25.052293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:30:25.052940 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:30:25.053221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:30:25.053495 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:30:25.062313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:30:25.063903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35052fe-0314-402a-8099-91dd3532fd97 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:30:25.073651 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4545/9127] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:30:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:30:35.069548 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=11 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:30:49.263140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:30:49.274881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354655b-147a-4545-ba34-90b08e3ce7c4 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:30:49.280505 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:30:49.281146 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:30:49.281427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:30:49.281750 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:30:49.283593 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:30:49.342305 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:30:49.344231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:30:49.354762 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4583/9128] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:30:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:30:55.053604 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:30:55.054096 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:30:55.054318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:30:55.073803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] MFA Rules not processed for user `a8ddac1d257f460e9115ab3f02942692`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:30:55.075282 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:30:55.083993 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4546/9129] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:30:55.420828 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:30:55.430613 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f990e4-df57-481e-9e85-ecd63224657b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:30:55.434578 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:30:55.435445 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:30:55.435824 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:30:55.436766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:30:55.445053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:30:55.446846 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:30:55.456040 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4584/9130] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:31:05.068072 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:05.452339 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=25 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:08.606151 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:08.621236 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64691c-6780-4304-a4ad-d51e90649e2f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:08.630621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:08.631563 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:08.631838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:08.632276 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:08.642494 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:08.644267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:08.656754 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4547/9131] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:31:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:31:18.650821 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:49.531633 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:49.545808 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931ab0-952f-4448-be2c-587c65ee85b8 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:49.551606 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:49.552345 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:49.552702 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:49.553047 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:49.562407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:49.564068 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ca5a8-3cad-4f0c-b7d4-632254292395 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:49.574659 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4585/9132] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:31:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:31:49.809068 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:49.812198 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:49.907587 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ab57-a444-411b-8454-72847dc5ecfd service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:49.912533 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:49.913319 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:49.913591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:49.913903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] PATH_INFO: `/v3/users/a8ddac1d257f460e9115ab3f02942692` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:49.928784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ddac1d257f460e9115ab3f02942692)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:49.930956 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:49.977383 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ddac1d257f460e9115ab3f02942692'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:49.985529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ddac1d257f460e9115ab3f02942692'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:49.992714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ddac1d257f460e9115ab3f02942692'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.006012 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ddac1d257f460e9115ab3f02942692'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.006655 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ddac1d257f460e9115ab3f02942692'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.012961 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4548/9133] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:31:49 2022] DELETE /identity/v3/users/a8ddac1d257f460e9115ab3f02942692 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:50.017614 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:50.017936 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:50.018212 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:50.047567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:31:50.048721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:50.106282 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4586/9134] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:31:50.116667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:50.118107 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:50.162246 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:50.198737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494c41-4a19-4c00-b846-7fcfb706005f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:50.202562 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:50.203204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:50.203482 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:50.203759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:50.212617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:50.214079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:50.224320 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4549/9135] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:31:50.403517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:50.405584 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:50.419129 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da52ebd-e15d-49df-af57-64f708e2d8f8 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:50.424434 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:50.425310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:50.425589 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:50.425899 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] PATH_INFO: `/v3/projects/577aa474166845ffbc0ddc0c23b5a6cc` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:50.438279 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577aa474166845ffbc0ddc0c23b5a6cc)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:50.440197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:50.485665 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577aa474166845ffbc0ddc0c23b5a6cc', 'request_id': 'req-7296c5db-f146-42a7-a740-6d1616ad7645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.491321 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577aa474166845ffbc0ddc0c23b5a6cc', 'request_id': 'req-7296c5db-f146-42a7-a740-6d1616ad7645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.498024 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577aa474166845ffbc0ddc0c23b5a6cc', 'request_id': 'req-7296c5db-f146-42a7-a740-6d1616ad7645'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.510541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] The token cache is being invalidate because project 577aa474166845ffbc0ddc0c23b5a6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:31:50.510826 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.511447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.512969 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4587/9136] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:31:50 2022] DELETE /identity/v3/projects/577aa474166845ffbc0ddc0c23b5a6cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:50.517283 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:50.527256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0d7b1-4183-4c95-86b1-023b64a3333e service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:50.583113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:50.583913 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:50.584200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:50.584477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] PATH_INFO: `/v3/users/f50d354b756045a19ddb5bc3e584f4b6` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:50.598793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50d354b756045a19ddb5bc3e584f4b6)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:50.600717 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:50.647918 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50d354b756045a19ddb5bc3e584f4b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.657035 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50d354b756045a19ddb5bc3e584f4b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.664303 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50d354b756045a19ddb5bc3e584f4b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.676565 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50d354b756045a19ddb5bc3e584f4b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.677204 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-2750cafb-b256-44a9-8ecd-75e479fa1e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50d354b756045a19ddb5bc3e584f4b6'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:50.683096 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4550/9137] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:31:50 2022] DELETE /identity/v3/users/f50d354b756045a19ddb5bc3e584f4b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:50.965389 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:50.966955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:50.982319 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c5db-f146-42a7-a740-6d1616ad7645 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.035141 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:51.043144 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.044082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.044574 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.044874 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] PATH_INFO: `/v3/projects/ccf58ad0da04471982e6cfbd97365be6` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.055731 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf58ad0da04471982e6cfbd97365be6)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.057626 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.103453 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf58ad0da04471982e6cfbd97365be6', 'request_id': 'req-028a8456-f6d1-44d3-b627-6598e0e63235'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:51.109435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf58ad0da04471982e6cfbd97365be6', 'request_id': 'req-028a8456-f6d1-44d3-b627-6598e0e63235'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:51.116528 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf58ad0da04471982e6cfbd97365be6', 'request_id': 'req-028a8456-f6d1-44d3-b627-6598e0e63235'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:51.130893 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] The token cache is being invalidate because project ccf58ad0da04471982e6cfbd97365be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:31:51.131213 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:51.131866 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-028a8456-f6d1-44d3-b627-6598e0e63235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:31:51.133430 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4588/9138] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:31:50 2022] DELETE /identity/v3/projects/ccf58ad0da04471982e6cfbd97365be6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:51.138679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.139767 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.140076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.182978 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:51.192963 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:31:51.194213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:51.254340 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4551/9139] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:31:51.262210 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.262499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.262804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.280335 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:31:51.281541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:51.289453 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4589/9140] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:31:51.293493 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.303673 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8af00b-dd09-493c-9aa9-59a363f04f1f None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.308354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.309017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.309300 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.309577 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] PATH_INFO: `/v3/domains` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.310345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:31:51.311413 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.313110 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.324743 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4552/9141] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 02:31:51.329085 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.338245 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c26d5-cd2b-46b4-9bcb-87174cbc146e None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.344183 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.344831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.345111 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.345387 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.346121 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.348013 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.384012 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4590/9142] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:31:51 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:31:51.389754 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.400406 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f7392-5965-4e84-8f9d-f74b250cc6df admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.457113 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.457811 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.458098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.458373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.459076 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.460981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.479578 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4553/9143] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:31:51 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:31:51.484355 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.494975 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562299cc-0355-464e-8ebe-614565356de2 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.502703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.503361 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.503649 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.503926 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.504689 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.506329 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.516500 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4591/9144] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:31:51.520571 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.531308 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9ad2-2591-490f-a138-1fe4adeccc0e admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.535973 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.536624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.536902 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.537174 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.537927 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.539515 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb708f-0a3b-4ada-aec4-28408f6f1435 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.550263 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4554/9145] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:31:51.554276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.564395 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21c51-9ad8-47ea-8359-e927d5a3b5e1 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.568955 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.569858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.570138 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.570410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] PATH_INFO: `/v3/projects/645e564a038c4ecfb26eac5a0cceb11b/users/c73ce3dd61734afe9f5b876975b6bcc9/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.585057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645e564a038c4ecfb26eac5a0cceb11b, user_id=c73ce3dd61734afe9f5b876975b6bcc9, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.587716 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.600752 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4592/9146] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:31:51 2022] PUT /identity/v3/projects/645e564a038c4ecfb26eac5a0cceb11b/users/c73ce3dd61734afe9f5b876975b6bcc9/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:51.605893 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b32d-57f2-4bda-a5cc-920729996ff2 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.606225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b32d-57f2-4bda-a5cc-920729996ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.606502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b32d-57f2-4bda-a5cc-920729996ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.624981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-7eb2b32d-57f2-4bda-a5cc-920729996ff2 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:31:51.626214 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-7eb2b32d-57f2-4bda-a5cc-920729996ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:51.683586 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4555/9147] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:31:51.693268 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:51.694992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:51.752886 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13395-c4a7-4a88-ad21-986160731e72 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:51.756550 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:51.757223 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:51.757507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:51.757818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:51.766960 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:51.768384 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:51.777824 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4593/9148] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:31:55.891514 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:55.892124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:55.892124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:55.917157 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:55.921849 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] MFA Rules not processed for user `c73ce3dd61734afe9f5b876975b6bcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:31:55.923994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:31:56.021652 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4556/9149] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:31:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:31:56.026081 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.041298 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46d77f-2b28-4457-8fa4-d0e103792c3f service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.046276 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.047199 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.047325 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.047602 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.048303 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.050261 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.053855 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:31:56.083438 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4594/9150] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:31:56 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:31:56.088051 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.101267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc68ad-5a4e-4957-80b6-bf3ea6c6ca4e None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.172392 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.173070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.173351 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.173626 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] PATH_INFO: `/v3/users` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.174352 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.176268 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.197520 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4557/9151] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:31:56 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:31:56.202233 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.212902 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255036d1-fc79-4ffd-a58e-e25f46a782fb admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.218271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.218963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.219241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.219513 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.220240 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.221918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.233638 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4595/9152] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 02:31:56.237928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.248523 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ff41d-3414-47b0-be6a-bb62a2ab6285 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.254079 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.254975 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.255264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.255517 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] PATH_INFO: `/v3/projects/9f40991757994ac0a4a0a6af391e9319/users/fa80a9aabec64376bf971708ece06b94/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.272040 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40991757994ac0a4a0a6af391e9319, user_id=fa80a9aabec64376bf971708ece06b94, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.274668 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.289937 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4558/9153] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:31:56 2022] PUT /identity/v3/projects/9f40991757994ac0a4a0a6af391e9319/users/fa80a9aabec64376bf971708ece06b94/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:31:56.294150 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.305288 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73034-b9f0-4420-8bf1-e01b01fd3562 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.367465 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.368143 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.368427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.368707 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.369440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.371080 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086553-9ad8-4e91-b81e-c26670534e2e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.390771 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4596/9154] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 02:31:56.394990 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:31:56.406443 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15354-ef5b-4da2-ac0e-6729d6cad347 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:31:56.411591 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:31:56.412362 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:31:56.412638 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:31:56.412920 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] PATH_INFO: `/v3/projects/9f40991757994ac0a4a0a6af391e9319/users/fa80a9aabec64376bf971708ece06b94/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:31:56.414984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40991757994ac0a4a0a6af391e9319, user_id=fa80a9aabec64376bf971708ece06b94, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:31:56.417664 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:31:56.430348 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4559/9155] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:31:56 2022] PUT /identity/v3/projects/9f40991757994ac0a4a0a6af391e9319/users/fa80a9aabec64376bf971708ece06b94/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 02:32:00.895033 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a44e7-b367-46d4-8746-bb96cff0d270 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:00.895503 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a44e7-b367-46d4-8746-bb96cff0d270 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:00.895666 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a44e7-b367-46d4-8746-bb96cff0d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:00.926446 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d11a44e7-b367-46d4-8746-bb96cff0d270 None None] MFA Rules not processed for user `fa80a9aabec64376bf971708ece06b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:32:00.928007 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d11a44e7-b367-46d4-8746-bb96cff0d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:01.010927 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4597/9156] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:32:01.028112 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:32:01.030070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:01.109999 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:01.173100 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b1a68-0ad2-413a-a57c-0d0e052c1a82 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:32:01.178686 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:32:01.179344 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:01.179621 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:01.179895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:01.242598 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:32:01.244211 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:32:01.255835 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4560/9157] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:32:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:32:02.261436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:02.261962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:02.261962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:02.292569 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] MFA Rules not processed for user `c73ce3dd61734afe9f5b876975b6bcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:32:02.294053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:02.302914 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4598/9158] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:32:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:32:02.634382 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:32:02.636472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:02.709645 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e55b06-6e13-4d5f-bcf5-5f0c33fc89a7 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:32:02.713373 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:32:02.714074 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:02.714354 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:02.714830 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:02.716916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:02.728128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:32:02.729618 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:32:02.741938 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4561/9159] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:32:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:32:06.524271 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:32:06.535101 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86262f57-8b76-4138-8e42-5d59e6053527 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:32:06.538864 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:32:06.539517 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:06.539799 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:06.540207 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:06.542065 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:06.556777 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:32:06.558291 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:32:06.571324 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4599/9160] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:32:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:32:07.754993 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:32:07.764601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6e4c-9bc9-4c51-b569-044ad6b3cffb service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:32:07.768314 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:32:07.768951 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:07.769237 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:07.769512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:07.771322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:32:07.785745 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:32:07.787180 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:32:07.798282 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4562/9161] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:32:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:32:15.123548 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:32:15.132732 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c39b7-83bf-4452-86dc-f35bfd8faf03 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:32:15.136379 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:32:15.137028 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:32:15.137312 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:32:15.137586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:32:15.148535 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:32:15.150009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:32:15.159747 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4600/9162] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:32:17.793279 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=75 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:32:25.155638 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:33:28.641742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:33:28.650555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76580beb-41f0-4205-bbb4-356d86d10dfe service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:33:28.654176 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:33:28.654840 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:33:28.655119 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:33:28.655393 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:33:28.657131 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:33:28.666545 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:33:28.667968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:33:28.675749 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4563/9163] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:33:38.672338 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:23.506187 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:34:23.507612 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:34:23.584993 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be84b-593b-4f65-b69f-3c4568fccaa6 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:34:23.590169 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:34:23.590812 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:34:23.591099 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:34:23.591376 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:34:23.593140 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:34:23.604333 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:34:23.605984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88b46c-7e37-493c-9836-719f3eb28e71 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:34:23.615716 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4601/9164] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:34:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:34:33.611596 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=36 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:34:59.023432 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:34:59.042931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb917-2924-4b1f-bc0f-28993a2901d8 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:34:59.048666 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:34:59.049538 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:34:59.049855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:34:59.050132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:34:59.051912 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:34:59.065737 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:34:59.067339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:34:59.078063 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4564/9165] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:34:59.799440 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e138-9c92-4666-a117-2510c60cff92 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:34:59.799929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e138-9c92-4666-a117-2510c60cff92 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:34:59.800025 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e138-9c92-4666-a117-2510c60cff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:34:59.847656 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-af08e138-9c92-4666-a117-2510c60cff92 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:34:59.848868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-af08e138-9c92-4666-a117-2510c60cff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:34:59.917523 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4602/9166] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:34:59.964348 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:34:59.966215 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:00.063238 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b648b9-c896-4ab9-8afc-7b11ac032507 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:00.068031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:00.068676 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:00.068952 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:00.069223 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:00.077187 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:00.078784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:00.086612 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4565/9167] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:35:09.914522 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=40 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:10.083490 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=47 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:12.057087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:12.057588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:12.057944 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:12.076522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] MFA Rules not processed for user `301e817770344ea89321aa8d85756547`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:35:12.078059 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.087510 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4603/9168] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Jul 24 02:35:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:35:12.100313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:12.101773 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.184528 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585eee7-6ac4-4913-8486-204ce1d258b3 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:12.188213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:12.188867 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:12.189145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:12.189417 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:12.201463 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:12.203039 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:12.214807 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4566/9169] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:35:12.532373 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:12.542703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677894c-817c-4177-9ef3-00fb63d5084c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:12.546299 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:12.547008 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:12.547409 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:12.547796 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:12.549621 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.560086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:12.561497 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:12.569272 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4604/9170] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:35:12.642037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:12.651496 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde3cbf-810d-44b2-9dec-debb5e4788bb service glance] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:12.655055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:12.655682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:12.655960 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:12.656228 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:12.658000 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.671505 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:12.672907 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b64589-e539-4185-bb3b-496e8ce97f93 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:12.683886 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4567/9171] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:35:12.743309 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:12.744792 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.760118 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327381f-97fa-4d7a-b350-8c24b6295c81 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:12.764990 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:12.765618 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:12.765929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:12.766197 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:12.767905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:12.780366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:12.781986 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:12.792213 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4605/9172] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:35:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:35:14.560221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:14.560669 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:14.560774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:14.578679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:35:14.579863 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:14.586872 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4568/9173] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:35:14.598697 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:14.609740 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1543be-6a76-4eaa-ad33-fd8414114844 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:14.614711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:14.615347 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:14.615631 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:14.615908 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:14.624315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:14.625913 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24c20c-5080-4f15-ab7a-8106627450c8 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:14.634160 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4606/9174] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:35:24.573955 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=44 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:24.630915 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=21 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:30.318190 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:30.331080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d4d3-5b3e-493f-90e6-0374788ff3c1 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:30.336037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:30.336687 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:30.336968 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:30.337246 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:30.340005 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:30.351578 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:30.353165 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:30.363702 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4569/9175] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:35:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:35:34.766419 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:34.766912 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:34.767015 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:34.784586 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:35:34.785831 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:35:34.793016 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4607/9176] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:35:34.804998 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:35:34.817006 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c1-7fd1-42b2-b6c9-c424dc84f52d service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:35:34.822758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:35:34.823401 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:35:34.823685 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:35:34.823964 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:35:34.832099 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:35:34.833701 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:35:34.841773 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4570/9177] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:35:44.779316 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:35:44.839128 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=12 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:12.116269 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:12.126559 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b1501-3a4c-4e71-a081-86e928e8609c None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:12.130534 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:12.131193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:12.131472 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:12.131755 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:12.140934 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:12.142398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:12.151079 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4608/9178] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:13.016191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:13.036071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f826d-4dfb-4479-92ba-fb7139c65021 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:13.041778 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:13.042469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:13.042756 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:13.043042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:13.044807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:37:13.059089 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:13.060845 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:13.072407 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4571/9179] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:13.210010 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:13.218932 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecf6e-aeab-45b1-84cc-1821e79e75be service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:13.222773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:13.223411 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:13.223691 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:13.223965 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:13.234410 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:13.235818 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea9fa8-6ba8-4a6e-9e50-41d4b9f4ea0c service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:13.247252 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4609/9180] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:14.426132 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:14.435472 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0a9c8-23a4-4c42-9b9d-c30f62e5126b service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:14.439147 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:14.439843 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:14.440124 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:14.440398 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:14.453048 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:14.454521 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:14.467740 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4572/9181] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:17.936651 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:17.937172 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:17.937277 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:17.954340 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] MFA Rules not processed for user `c73ce3dd61734afe9f5b876975b6bcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:37:17.955527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:37:17.962277 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4610/9182] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:37:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:37:24.460866 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=12 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:27.949445 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=15 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:33.403667 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:33.412008 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb64a2-d135-432f-9698-a1e802a43454 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:33.415540 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:33.416164 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:33.416447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:33.417293 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:33.424313 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:33.425757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:33.433445 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4573/9183] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:33.868113 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:33.883563 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba4081-106d-49be-b65c-a8e00d533f13 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:33.890479 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:33.891135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:33.891414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:33.891686 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:33.893515 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:37:33.906698 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:33.908300 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:33.919001 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4611/9184] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:43.430222 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:43.914499 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:37:54.025419 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:54.034030 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982b1c2-ed68-4514-a899-eb64c1618243 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:54.037586 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:54.038273 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:54.038555 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:54.038838 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:54.048531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:54.049994 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:54.059627 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4574/9185] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:37:55.652506 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:37:55.653989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:37:55.669456 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c49e9-7e84-43f2-8c85-a377a47ea0d9 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:37:55.675217 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:37:55.675867 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:37:55.676152 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:37:55.676431 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:37:55.678231 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:37:55.691266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:37:55.693193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:37:55.704041 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4612/9186] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:37:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:38:04.055162 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:38:05.699462 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:38:28.124601 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:38:28.135522 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170727-62f6-4047-bc90-c73b27d47ce1 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:38:28.139460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:38:28.140126 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:38:28.140404 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:38:28.140646 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:38:28.148981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:38:28.150480 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:38:28.158662 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4575/9187] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:38:38.154991 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:39:29.530139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:39:29.561368 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707257c-aaa7-45e1-b3c8-c1d9b3bff5e9 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:39:29.566895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:39:29.567520 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:39:29.567795 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:39:29.568067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:39:29.576510 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:39:29.578102 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:39:29.588367 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4613/9188] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:39:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:39:39.584345 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=15 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:08.375531 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:40:08.392483 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40df8b-1edf-479c-b298-63ed1ee43e6c service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:40:08.398780 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:40:08.399801 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:40:08.400248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:40:08.400681 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:40:08.411433 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:40:08.413286 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:40:08.426450 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4576/9189] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:40:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:40:12.652911 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:40:12.662891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceb856-66d1-48cf-98e8-ff51c8824161 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:40:12.666490 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:40:12.667125 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:40:12.667404 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:40:12.667680 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:40:12.669429 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:40:12.678832 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:40:12.680241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:40:12.688074 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4614/9190] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:40:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:40:18.420998 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:22.684715 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:40:37.310106 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:40:37.332684 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b522b-1de8-4232-9e42-bc9fb65019ce service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:40:37.337804 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:40:37.338457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:40:37.338741 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:40:37.339017 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:40:37.348691 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:40:37.350327 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:40:37.360365 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4577/9191] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:40:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:40:47.356146 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=11 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:51.082003 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:51.124004 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0046-6c04-439b-9e45-6ae5cc26c5f7 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:51.127989 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:51.128645 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:51.129193 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:51.129467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:51.201981 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:51.203428 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:51.223019 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4615/9192] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:41:54.229762 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:54.242987 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e17297-8e6d-4ed6-89e3-0fefec306ed9 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:54.249624 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:54.250320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:54.250675 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:54.251476 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:54.253260 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:54.329422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:54.331864 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:54.352030 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4578/9193] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:41:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:41:57.561346 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:57.563556 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:57.589711 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2554f59-871a-4a1c-800f-c53bb488f7be service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:57.595173 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:57.596049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:57.596331 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:57.596608 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] PATH_INFO: `/v3/users/c73ce3dd61734afe9f5b876975b6bcc9` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:57.610424 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73ce3dd61734afe9f5b876975b6bcc9)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:57.612358 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:57.659040 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73ce3dd61734afe9f5b876975b6bcc9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:57.659761 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73ce3dd61734afe9f5b876975b6bcc9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:57.678800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73ce3dd61734afe9f5b876975b6bcc9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:57.686642 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73ce3dd61734afe9f5b876975b6bcc9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:57.698359 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73ce3dd61734afe9f5b876975b6bcc9'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:57.701172 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:57.706222 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4616/9194] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:41:57 2022] DELETE /identity/v3/users/c73ce3dd61734afe9f5b876975b6bcc9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:41:57.878784 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:57.890255 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e4174-4187-479d-a9a0-4ae88be481ae service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:57.953941 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:57.954810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:57.955094 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:57.955370 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] PATH_INFO: `/v3/projects/645e564a038c4ecfb26eac5a0cceb11b` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:57.966978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] RBAC: Authorizing `identity:delete_project(project_id=645e564a038c4ecfb26eac5a0cceb11b)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:57.968943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.014735 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645e564a038c4ecfb26eac5a0cceb11b', 'request_id': 'req-11a3e87b-3101-4168-a29c-b55e582c946f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.021105 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645e564a038c4ecfb26eac5a0cceb11b', 'request_id': 'req-11a3e87b-3101-4168-a29c-b55e582c946f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.026812 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645e564a038c4ecfb26eac5a0cceb11b', 'request_id': 'req-11a3e87b-3101-4168-a29c-b55e582c946f'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.039855 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] The token cache is being invalidate because project 645e564a038c4ecfb26eac5a0cceb11b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:41:58.040149 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.040793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.042352 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4579/9195] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:41:57 2022] DELETE /identity/v3/projects/645e564a038c4ecfb26eac5a0cceb11b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:41:58.046447 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.047861 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:58.060983 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f768-9072-4bea-a98f-0b87e659a0c8 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.117176 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.118145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.118427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.118703 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] PATH_INFO: `/v3/users/fa80a9aabec64376bf971708ece06b94` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.132915 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa80a9aabec64376bf971708ece06b94)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.134895 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.180237 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa80a9aabec64376bf971708ece06b94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.180881 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa80a9aabec64376bf971708ece06b94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.188266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa80a9aabec64376bf971708ece06b94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.195366 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa80a9aabec64376bf971708ece06b94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.207591 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-3be90ea7-e948-4775-9535-62ed70a68f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa80a9aabec64376bf971708ece06b94'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.213378 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4617/9196] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:41:58 2022] DELETE /identity/v3/users/fa80a9aabec64376bf971708ece06b94 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:41:58.394359 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.395795 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:58.410388 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e87b-3101-4168-a29c-b55e582c946f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.455839 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:58.470916 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.471781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.472055 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.472322 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] PATH_INFO: `/v3/projects/9f40991757994ac0a4a0a6af391e9319` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.482932 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f40991757994ac0a4a0a6af391e9319)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.484897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.531435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f40991757994ac0a4a0a6af391e9319', 'request_id': 'req-efe5bece-2967-4f58-a96e-66de6ee476c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.539071 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f40991757994ac0a4a0a6af391e9319', 'request_id': 'req-efe5bece-2967-4f58-a96e-66de6ee476c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.544905 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f40991757994ac0a4a0a6af391e9319', 'request_id': 'req-efe5bece-2967-4f58-a96e-66de6ee476c3'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.556928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] The token cache is being invalidate because project 9f40991757994ac0a4a0a6af391e9319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:41:58.557213 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.557910 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-efe5bece-2967-4f58-a96e-66de6ee476c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:41:58.560033 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4580/9197] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:41:58 2022] DELETE /identity/v3/projects/9f40991757994ac0a4a0a6af391e9319 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:41:58.565436 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.566005 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.566148 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.622696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:41:58.623905 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:58.656118 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:58.686582 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4618/9198] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:41:58.695025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.695477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.695757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.713633 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:41:58.714839 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:58.722781 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4581/9199] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:41:58.726766 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.737407 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121bf87-3f3b-4455-8640-9ff8b0ff0e96 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.741891 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.742536 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.742814 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.743086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.743809 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 02:41:58.744110 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.745705 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.757971 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4619/9200] 10.222.0.27 () {58 vars in 1152 bytes} [Sun Jul 24 02:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 02:41:58.762070 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.771339 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbce0-348a-4470-8358-b2e8c1447a55 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.775888 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.776529 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.776807 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.777080 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.777793 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.779866 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.818957 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4582/9201] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:41:58 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:41:58.823074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.833567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98b2b-793c-496d-873c-cfcd80174ed6 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.889603 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.890292 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.890571 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.890842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.891518 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.893414 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.912465 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4620/9202] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:41:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:41:58.916613 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.927387 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25416c9-fe72-4956-85a5-296e87ce5acd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.931965 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.932617 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.932891 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.933161 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.933928 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.936290 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.946190 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4583/9203] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:41:58.950032 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.959984 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4c1d-84de-4a33-ab44-9c277a80779f admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.964875 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.965539 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.966072 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.966354 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:58.967116 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:58.968754 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72fa0-021b-4dd6-b3e8-4b2effd1e03e admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:58.978725 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4621/9204] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:41:58.983343 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:58.993173 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17e74-2816-4a8d-9545-166b521366fc admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:58.998532 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:58.999434 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] REQUEST_METHOD: `PUT` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:58.999713 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:58.999984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] PATH_INFO: `/v3/projects/f2c291c486e64d78851ea5ea19f3cde8/users/8f0012c044964dd2853db1c71fe62f36/roles/46803c1bdede4cdebd5ce9ec067eb1a1` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:59.015063 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c291c486e64d78851ea5ea19f3cde8, user_id=8f0012c044964dd2853db1c71fe62f36, role_id=46803c1bdede4cdebd5ce9ec067eb1a1)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:59.017805 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:59.030623 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4584/9205] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:41:58 2022] PUT /identity/v3/projects/f2c291c486e64d78851ea5ea19f3cde8/users/8f0012c044964dd2853db1c71fe62f36/roles/46803c1bdede4cdebd5ce9ec067eb1a1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:41:59.035734 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcadc7-6e3a-4cec-b721-9b1a15dc02a5 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:59.036029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcadc7-6e3a-4cec-b721-9b1a15dc02a5 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:59.036310 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcadc7-6e3a-4cec-b721-9b1a15dc02a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:59.054266 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d9dcadc7-6e3a-4cec-b721-9b1a15dc02a5 None None] MFA Rules not processed for user `e0e735ce611649f28deffe005a930461`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:41:59.055469 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d9dcadc7-6e3a-4cec-b721-9b1a15dc02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:59.114534 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4622/9206] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:41:59.124416 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:41:59.126160 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:41:59.190284 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:41:59.196439 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5152aa4-86ae-4701-a12c-1d7a0ae8f46c admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:41:59.201185 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:41:59.201872 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:41:59.202156 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:41:59.202435 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:41:59.211467 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:41:59.212900 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:41:59.223066 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4585/9207] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:02.979078 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:02.979600 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:02.979701 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.008780 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] MFA Rules not processed for user `8f0012c044964dd2853db1c71fe62f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:42:03.009951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:03.048726 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:03.088193 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4623/9208] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:42:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:42:03.093753 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.103823 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a248-9ddc-4b53-97d0-b2b89de19827 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.108544 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.109201 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.109477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.109786 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.110512 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.112477 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.149907 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4586/9209] 10.222.0.27 () {60 vars in 1152 bytes} [Sun Jul 24 02:42:03 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 02:42:03.151021 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.162315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0a1cc-034b-40c0-9358-1c8ddced6593 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.227963 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.229275 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.229738 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.229933 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.230632 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.233307 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.259198 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4624/9210] 10.222.0.27 () {60 vars in 1143 bytes} [Sun Jul 24 02:42:03 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 02:42:03.262882 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.274311 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472e954-bb16-4d53-900f-cf7942971edd admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.279318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.280075 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.280441 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.280777 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.281610 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.283306 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.294657 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4587/9211] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:42:03.298927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.310667 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ba036-c2ee-4c85-ae55-9eefc850a1f9 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.315398 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.316516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.316804 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.317087 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] PATH_INFO: `/v3/projects/4658e386d7454a48a85cb9ca4d1fe863/users/1e2b3a18367d47c3a4761c6c51862738/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.333919 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4658e386d7454a48a85cb9ca4d1fe863, user_id=1e2b3a18367d47c3a4761c6c51862738, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.336788 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.350643 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4625/9212] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:42:03 2022] PUT /identity/v3/projects/4658e386d7454a48a85cb9ca4d1fe863/users/1e2b3a18367d47c3a4761c6c51862738/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 02:42:03.354719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.365267 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe97c6-a53f-4dde-a0e6-c23d41733c9f admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.425245 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.426091 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.426394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.426674 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.427410 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.429010 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d4e6b-277b-4431-a327-d555b71a63e5 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.439511 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4588/9213] 10.222.0.27 () {58 vars in 1121 bytes} [Sun Jul 24 02:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 02:42:03.443763 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:03.454770 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66151492-914f-487a-bb1c-3ec1a0ae2f6c admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:03.459352 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:03.460222 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:03.460501 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:03.460773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] PATH_INFO: `/v3/projects/4658e386d7454a48a85cb9ca4d1fe863/users/1e2b3a18367d47c3a4761c6c51862738/roles/acd1f0a52de7401597f9dc3d88354f7e` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:03.462870 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4658e386d7454a48a85cb9ca4d1fe863, user_id=1e2b3a18367d47c3a4761c6c51862738, role_id=acd1f0a52de7401597f9dc3d88354f7e)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:03.465495 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:03.476077 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4626/9214] 10.222.0.27 () {60 vars in 1482 bytes} [Sun Jul 24 02:42:03 2022] PUT /identity/v3/projects/4658e386d7454a48a85cb9ca4d1fe863/users/1e2b3a18367d47c3a4761c6c51862738/roles/acd1f0a52de7401597f9dc3d88354f7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:42:08.333553 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36fb-b39a-4b82-b90f-d43b6fe53356 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:08.334042 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36fb-b39a-4b82-b90f-d43b6fe53356 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:08.334137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b36fb-b39a-4b82-b90f-d43b6fe53356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:08.389904 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-935b36fb-b39a-4b82-b90f-d43b6fe53356 None None] MFA Rules not processed for user `1e2b3a18367d47c3a4761c6c51862738`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:42:08.391372 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-935b36fb-b39a-4b82-b90f-d43b6fe53356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:08.495219 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4589/9215] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:42:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:42:08.513145 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:08.515315 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:08.640763 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:08.652747 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17099d04-a0f5-4f1e-9fa1-8f8d0d35ced5 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:08.659670 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:08.660397 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:08.660746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:08.661034 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:08.733991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:08.735800 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:08.746458 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4627/9216] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:42:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:09.826242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:09.826771 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:09.826895 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:09.845191 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] MFA Rules not processed for user `8f0012c044964dd2853db1c71fe62f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:42:09.846422 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:09.853199 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4590/9217] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:42:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:42:13.319241 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:13.321405 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:13.339868 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d37-0c20-4e86-9d97-2939a6deaf31 service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:13.355945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:13.357135 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:13.357471 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:13.357773 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:13.359758 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:13.374435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:13.376050 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:13.389069 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4628/9218] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:13.929093 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:13.963713 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:13.988221 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6ae3-c9da-4a01-a32b-15c36ecbbbeb None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:13.991766 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:13.992412 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:13.992719 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:13.992992 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:13.994774 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:14.008981 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:14.010457 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:14.022273 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4591/9219] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:15.198383 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:15.208230 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56003cfe-9cd5-4f66-86c8-ecff3a02558d service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:15.211816 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:15.212442 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:15.212721 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:15.212992 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:15.214783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:42:15.228018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:15.229427 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:15.240954 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4629/9220] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:42:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:21.415196 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:42:21.424584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f41c3-a584-415f-b2b1-dcf774470840 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:42:21.428692 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:42:21.429318 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:42:21.429597 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:42:21.429897 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:42:21.439320 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:42:21.440743 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:42:21.450323 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4592/9221] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:42:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:42:25.236012 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=41 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:42:31.446021 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=18 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:43:34.057598 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:43:34.059045 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:43:34.069607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c8fb0-e4a6-4f47-942f-0189feb28ef0 service neutron] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:43:34.073177 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:43:34.073854 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:43:34.074122 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:43:34.074396 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:43:34.076067 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:43:34.085749 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:43:34.087171 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d564-54a1-4fe3-9f66-b2fa8c98cf36 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:43:34.095874 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4630/9222] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:43:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:43:44.091521 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=6 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:32.495509 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:44:32.496931 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:44:32.575340 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eab7a2-52b4-48ab-aad8-a7c74502ba89 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:44:32.581137 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:44:32.581825 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:44:32.582114 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:44:32.582394 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:44:32.584203 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:44:32.596256 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:44:32.597871 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:44:32.607625 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4593/9223] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:44:42.603500 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=36 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:44:59.873746 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7d8a-3623-4531-86a5-0cad04771529 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:44:59.874883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7d8a-3623-4531-86a5-0cad04771529 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:44:59.874883 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7d8a-3623-4531-86a5-0cad04771529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:44:59.932978 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-6bdb7d8a-3623-4531-86a5-0cad04771529 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:44:59.934139 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6bdb7d8a-3623-4531-86a5-0cad04771529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:00.003351 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4631/9224] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:45:00.049810 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:00.051231 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:00.141984 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f38d2-f642-4b5e-8498-3b9078c19044 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:00.147199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:00.147844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:00.148125 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:00.148399 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:00.157600 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:00.159206 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:00.167518 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4594/9225] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:45:09.367246 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:09.367783 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:09.367889 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:09.386052 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] MFA Rules not processed for user `8f0012c044964dd2853db1c71fe62f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:45:09.387192 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:09.395113 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4632/9226] 10.222.0.27 () {58 vars in 957 bytes} [Sun Jul 24 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 02:45:09.716418 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:09.726081 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b75d3-16ca-411b-862c-3e0cd453a958 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:09.729612 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:09.730277 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:09.730557 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:09.730832 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:09.732595 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:09.742828 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:09.744259 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fe463-e5a7-45be-bae6-1e8044672282 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:09.752226 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4595/9227] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:45:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:45:10.085601 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:10.100538 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b8f20-7bf1-4cb9-b30d-1f5318c6b746 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:10.105937 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:10.106594 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:10.106877 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:10.107151 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:10.109265 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:10.122421 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:10.124053 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:10.135409 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4633/9228] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:45:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:45:11.261605 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:11.262098 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:11.262312 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:11.281714 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:45:11.283036 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:11.290621 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4596/9229] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:45:11.302860 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:11.314417 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba91d-2635-4b94-9ee4-21efd566e3d4 service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:11.319426 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:11.320060 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:11.320336 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:11.320607 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:11.330215 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:11.332009 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:11.340865 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4634/9230] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:45:13.907150 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:13.923629 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca90ee-3ff2-4711-a00b-adfa2818a401 None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:13.928978 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:13.929627 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:13.930037 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:13.930307 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:13.932199 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:13.946440 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:13.948330 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:13.970936 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4597/9231] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:45:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 02:45:18.801320 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:18.811106 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf2b7e-6079-4137-9e03-842694253344 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:18.814920 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:18.815567 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:18.815848 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:18.816127 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:18.817927 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:18.828079 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:18.829507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1302-8b8a-4304-a43c-59095556b435 service neutron] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:18.837415 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4635/9232] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:45:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:45:23.962346 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=56 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:28.833886 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=65 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:45:42.334625 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:45:42.336014 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:42.351919 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539e5c-0e15-4a9c-938e-475b523e2589 service nova] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:45:42.356758 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:45:42.358128 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:45:42.358485 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:45:42.358757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:45:42.360622 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:45:42.371903 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:45:42.374067 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:45:42.384168 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4598/9233] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:45:52.379693 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=6 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:46:53.700423 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f6-e839-4dcb-8134-6907d527a128 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:46:53.700946 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f6-e839-4dcb-8134-6907d527a128 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:46:53.701049 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f6-e839-4dcb-8134-6907d527a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:46:53.718929 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-d578d6f6-e839-4dcb-8134-6907d527a128 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:46:53.720133 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d578d6f6-e839-4dcb-8134-6907d527a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:46:53.727428 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4636/9234] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Jul 24 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:46:53.768909 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:46:53.780943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9c3f-be32-49d1-83b2-01648cfba9c6 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:46:53.785847 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:46:53.786479 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:46:53.786759 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:46:53.787031 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:46:53.796061 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:46:53.797641 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:46:53.805655 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4599/9235] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:47:02.731862 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] REQUEST_METHOD: `POST` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:02.732393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:02.732393 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:02.749712 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.auth.core [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:47:02.750918 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:02.758496 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4637/9236] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:47:02.770988 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:02.781865 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c91bd-486b-4cef-aa26-24eaedc93a91 service swift] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:02.786826 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:02.787460 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:02.787740 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:02.788016 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:02.796574 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:02.798200 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5115-2a89-44ac-a53b-66de68364d4b service swift] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:02.806137 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4600/9237] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:47:06.409805 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:06.424962 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee931-bb5f-4ede-a4ea-10ddf0c56359 None None] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:06.430588 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '301e817770344ea89321aa8d85756547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:06.431242 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:06.431596 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:06.431882 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:06.433842 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:06.447470 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:06.449054 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:06.461115 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4638/9238] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:47:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:47:07.944682 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f97c2-6420-4cdb-b2b7-c2987c041f1a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:07.945135 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f97c2-6420-4cdb-b2b7-c2987c041f1a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:07.945230 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f97c2-6420-4cdb-b2b7-c2987c041f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:07.963025 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-0f5f97c2-6420-4cdb-b2b7-c2987c041f1a None None] MFA Rules not processed for user `588446ab55aa4942b399ca411380e13a`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:47:07.964205 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-0f5f97c2-6420-4cdb-b2b7-c2987c041f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:07.971508 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4601/9239] 10.222.0.27 () {58 vars in 967 bytes} [Sun Jul 24 02:47:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:47:07.983374 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:07.994349 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643cec2-9c72-48ba-975b-91861ba7c5dd service nova] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:07.999892 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc4ad8dc59b4974a08e687a78764471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:08.000522 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:08.000806 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:08.001082 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:08.009507 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:08.011088 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:08.019681 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4639/9240] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Jul 24 02:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 02:47:08.408803 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] REQUEST_METHOD: `POST` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:08.409095 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:08.409376 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:08.457535 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.auth.core [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] MFA Rules not processed for user `1d7eafaa369f49bb9ea2c818d977d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 02:47:08.458751 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:08.519013 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4602/9241] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Jul 24 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 02:47:08.525074 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:08.534348 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a14ad-b152-4bc1-9abc-e8abc7404e84 service swift] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:08.537845 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d7eafaa369f49bb9ea2c818d977d3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:08.538467 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:08.538745 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:08.539018 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:08.548086 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:08.549527 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:08.558220 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4640/9242] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:47:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:47:13.249427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:13.259469 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e96df9-c0a0-4946-a74c-3cee27792f3a None None] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:13.263146 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3abde5d3aa4477c972e6be521345741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:13.263854 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:13.264264 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:13.265145 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:13.328092 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:13.329541 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:13.339410 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4603/9243] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:47:16.489521 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:16.507541 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3ab8-0420-48cf-a72c-86bdc025b0f8 service glance] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:16.513371 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:16.515057 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:16.515435 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:16.515782 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:16.517951 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:16.536793 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:16.538682 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:16.553786 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4641/9244] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:47:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:47:19.808679 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:19.819837 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ea08a-32d8-4b95-8edc-7a63613b8fd4 service neutron] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:19.824742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:19.825640 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:19.825950 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:19.826225 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] PATH_INFO: `/v3/users/8f0012c044964dd2853db1c71fe62f36` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:19.827564 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0012c044964dd2853db1c71fe62f36)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:19.829468 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:19.864875 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:19.878296 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0012c044964dd2853db1c71fe62f36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:19.889489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0012c044964dd2853db1c71fe62f36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:19.896489 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0012c044964dd2853db1c71fe62f36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:19.909584 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0012c044964dd2853db1c71fe62f36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:19.910345 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0012c044964dd2853db1c71fe62f36'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:19.916548 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4604/9245] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:47:19 2022] DELETE /identity/v3/users/8f0012c044964dd2853db1c71fe62f36 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:47:20.097801 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:20.104581 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=31 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:20.111791 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537b9a7-ea3f-4c49-9eb4-001e12eb072b service placement] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:20.174637 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:20.175499 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:20.175779 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:20.176051 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] PATH_INFO: `/v3/projects/f2c291c486e64d78851ea5ea19f3cde8` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:20.177228 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c291c486e64d78851ea5ea19f3cde8)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:20.179162 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:20.226945 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c291c486e64d78851ea5ea19f3cde8', 'request_id': 'req-fff3d582-39c7-4693-b8ef-1296b17e9fde'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.232282 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c291c486e64d78851ea5ea19f3cde8', 'request_id': 'req-fff3d582-39c7-4693-b8ef-1296b17e9fde'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.239830 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c291c486e64d78851ea5ea19f3cde8', 'request_id': 'req-fff3d582-39c7-4693-b8ef-1296b17e9fde'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.251332 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] The token cache is being invalidate because project f2c291c486e64d78851ea5ea19f3cde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:47:20.251615 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.252250 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.254026 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4642/9246] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:47:20 2022] DELETE /identity/v3/projects/f2c291c486e64d78851ea5ea19f3cde8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:47:20.258280 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:20.259742 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:20.273757 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697517e-231a-4b0d-9712-dbc4492f769b admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:20.330378 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:20.331169 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:20.331447 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:20.331725 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] PATH_INFO: `/v3/users/1e2b3a18367d47c3a4761c6c51862738` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:20.332922 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2b3a18367d47c3a4761c6c51862738)` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:20.334889 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:20.384708 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2b3a18367d47c3a4761c6c51862738'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.392637 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2b3a18367d47c3a4761c6c51862738'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.399917 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2b3a18367d47c3a4761c6c51862738'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.412242 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2b3a18367d47c3a4761c6c51862738'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.412943 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.notifications [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2b3a18367d47c3a4761c6c51862738'} {{(pid=80591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.419153 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4605/9247] 10.222.0.27 () {58 vars in 1223 bytes} [Sun Jul 24 02:47:20 2022] DELETE /identity/v3/users/1e2b3a18367d47c3a4761c6c51862738 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:47:20.625216 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:47:20.626663 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:47:20.643454 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d582-39c7-4693-b8ef-1296b17e9fde admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:47:20.704696 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e735ce611649f28deffe005a930461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a456f944370a42eaa59b5a1926c8339d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:47:20.705655 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:47:20.706029 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:47:20.706304 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] PATH_INFO: `/v3/projects/4658e386d7454a48a85cb9ca4d1fe863` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:47:20.707480 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4658e386d7454a48a85cb9ca4d1fe863)` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:47:20.709377 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:47:20.747262 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:20.759350 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4658e386d7454a48a85cb9ca4d1fe863', 'request_id': 'req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.765181 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4658e386d7454a48a85cb9ca4d1fe863', 'request_id': 'req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.773516 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4658e386d7454a48a85cb9ca4d1fe863', 'request_id': 'req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567'} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.786043 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] The token cache is being invalidate because project 4658e386d7454a48a85cb9ca4d1fe863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 02:47:20.786326 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.786991 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.notifications [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 02:47:20.788546 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4643/9248] 10.222.0.27 () {58 vars in 1232 bytes} [Sun Jul 24 02:47:20 2022] DELETE /identity/v3/projects/4658e386d7454a48a85cb9ca4d1fe863 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 02:47:30.415472 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=70,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:47:30.783074 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:49:35.488240 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:49:35.489643 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:49:35.578809 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5923-f902-4755-8315-7ce7b148db97 admin admin] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:49:35.639852 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:49:35.640502 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:49:35.640781 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:49:35.641057 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:49:35.642844 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:49:35.654033 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:49:35.655594 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:49:35.665260 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4606/9249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:49:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:49:45.661195 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=67 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:50:48.291098 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Authenticating user token {{(pid=80590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:50:48.292554 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:50:48.329027 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf6aa-5cab-4d46-b6c4-9d8c537b7567 admin admin] Validating token access rules against request {{(pid=80590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:50:48.334252 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:50:48.334898 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] REQUEST_METHOD: `GET` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:50:48.335182 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] SCRIPT_NAME: `/identity` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:50:48.335460 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:50:48.337203 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.fernet_utils [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:50:48.349249 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:50:48.350858 n-d-master-1 devstack@keystone.service[80590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483e634-b0a6-4d0f-9761-67ed64ae693e service placement] RBAC: Authorization granted {{(pid=80590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:50:48.361225 n-d-master-1 devstack@keystone.service[80590]: [pid: 80590|app: 0|req: 4644/9250] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:50:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:50:58.356358 n-d-master-1 devstack@keystone.service[80590]: DEBUG dbcounter [-] [80590] Writing DB stats keystone:SELECT=15 {{(pid=80590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 02:54:41.458427 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] Authenticating user token {{(pid=80591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 02:54:41.459929 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.fernet_utils [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 02:54:41.536350 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4f19-efe0-471a-be2b-fd52de956a76 service placement] Validating token access rules against request {{(pid=80591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 02:54:41.541379 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dad04ecf24d408a3551814785a20c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83474ff648624529bb5284cc6cfdd928', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 02:54:41.542054 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] REQUEST_METHOD: `GET` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 02:54:41.542333 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 02:54:41.542608 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 02:54:41.551680 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 02:54:41.553248 n-d-master-1 devstack@keystone.service[80591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e7a6a-59c6-4ba0-be23-7b021e5e72c6 service placement] RBAC: Authorization granted {{(pid=80591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 02:54:41.563918 n-d-master-1 devstack@keystone.service[80591]: [pid: 80591|app: 0|req: 4607/9251] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Jul 24 02:54:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 02:54:51.559694 n-d-master-1 devstack@keystone.service[80591]: DEBUG dbcounter [-] [80591] Writing DB stats keystone:SELECT=28 {{(pid=80591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}